-- Logs begin at Wed 2021-12-15 15:30:43 UTC, end at Wed 2021-12-15 16:29:54 UTC. -- Dec 15 15:57:26.565078 dv-cinder-800704-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Dec 15 15:57:26.572942 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Dec 15 15:57:26.577413 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 15:57:26 2021] *** Dec 15 15:57:26.577413 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 15:57:26.577413 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 15:57:26.577413 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: nodename: dv-cinder-800704-2-iscsi Dec 15 15:57:26.577413 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: machine: x86_64 Dec 15 15:57:26.577413 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: clock source: unix Dec 15 15:57:26.577413 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: pcre jit disabled Dec 15 15:57:26.577413 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: detected number of CPU cores: 4 Dec 15 15:57:26.577413 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: current working directory: / Dec 15 15:57:26.577413 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: detected binary path: /usr/bin/uwsgi-core Dec 15 15:57:26.577413 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: your processes number limit is 47680 Dec 15 15:57:26.577413 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: your memory page size is 4096 bytes Dec 15 15:57:26.577413 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: detected max file descriptor number: 2048 Dec 15 15:57:26.577413 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: lock engine: pthread robust mutexes Dec 15 15:57:26.577413 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: thunder lock: enabled Dec 15 15:57:26.577413 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Dec 15 15:57:26.577413 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 15:57:26.621014 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: Python main interpreter initialized at 0x55f0b4d5a9c0 Dec 15 15:57:26.621014 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: python threads support enabled Dec 15 15:57:26.621014 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: your server socket listen backlog is limited to 100 connections Dec 15 15:57:26.621014 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: your mercy for graceful operations on workers is 90 seconds Dec 15 15:57:26.621347 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 15:57:26.621468 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: *** Operational MODE: preforking *** Dec 15 15:57:26.621757 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: *** uWSGI is running in multiple interpreter mode *** Dec 15 15:57:26.621757 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: spawned uWSGI master process (pid: 79276) Dec 15 15:57:26.621958 dv-cinder-800704-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Dec 15 15:57:26.622514 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: spawned uWSGI worker 1 (pid: 79289, cores: 1) Dec 15 15:57:26.622846 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: spawned uWSGI worker 2 (pid: 79290, cores: 1) Dec 15 15:57:26.623621 dv-cinder-800704-2-iscsi devstack@keystone.service[79276]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 15:57:31.982618 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 15:57:31.982618 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: from cryptography.utils import int_from_bytes Dec 15 15:57:31.983426 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 15:57:31.983426 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: from cryptography.utils import int_from_bytes Dec 15 15:57:31.990106 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 15:57:31.990106 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: from cryptography.utils import int_from_bytes Dec 15 15:57:31.990590 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 15:57:31.990590 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: from cryptography.utils import int_from_bytes Dec 15 15:57:32.032083 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 15:57:32.032274 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 15:57:32.032466 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] command line args: [] {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 15:57:32.032734 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 15:57:32.032911 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ================================================================================ {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 15:57:32.033165 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] admin_token = **** {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.033431 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] config_dir = [] {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.033620 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.033800 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] config_source = [] {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.033979 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] debug = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.034177 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.035823 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.035823 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.035823 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.035823 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.035823 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] list_limit = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.035823 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] log_config_append = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.036251 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.036251 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] log_dir = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.036398 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] log_file = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.037264 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.037484 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.037790 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.037972 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.038155 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.038303 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.038470 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 15:57:32.038639 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.038781 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 15:57:32.038955 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.039121 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] command line args: [] {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 15:57:32.039291 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.039457 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 15:57:32.039593 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.039765 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ================================================================================ {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 15:57:32.039934 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.040118 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] admin_token = **** {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.040295 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.040462 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] config_dir = [] {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.040602 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.040776 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.040776 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] config_source = [] {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.041109 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.041329 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] debug = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.041329 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.041739 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.041924 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.041924 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.042187 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.042332 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.042924 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] publish_errors = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.043011 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.043099 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.043176 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] list_limit = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.043252 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.043329 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] log_config_append = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.043404 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.043488 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.043571 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.043648 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] log_dir = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.043723 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.043794 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] log_file = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.043869 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] standard_threads = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.043951 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.044023 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.044107 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.044182 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.044257 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.044328 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.044405 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.044484 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] use_journal = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.044555 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.044630 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] use_json = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.044705 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.044779 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] use_stderr = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.044779 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] use_syslog = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.044909 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.044980 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.045048 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.045117 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.045196 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.045342 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.045454 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.045533 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.045614 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.045691 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.045761 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.045835 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.045905 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.045974 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.046050 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.046126 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.046202 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.046278 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.046278 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.046410 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.046487 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.046564 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] publish_errors = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.046634 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.046708 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.046792 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.046864 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.046938 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.047014 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.047167 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.047253 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.047414 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.047489 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.047659 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.047737 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] standard_threads = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.047895 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.047973 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.048141 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.048226 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.048304 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.048381 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.048484 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] use_journal = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.048625 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.048710 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] use_json = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.048826 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] use_stderr = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.048902 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.049003 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] use_syslog = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.049084 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.049238 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 15:57:32.049330 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.049526 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.049607 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.049772 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.049849 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.050037 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.050126 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.050282 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.050365 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.050514 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.050591 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.050751 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.050837 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.051000 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.051084 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.051241 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.051323 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.051472 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.051551 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.051704 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.051777 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.051950 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.052060 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.052230 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.052306 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.052466 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.052533 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.052711 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.052803 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.052964 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.053039 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.053217 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.053284 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.053481 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.053553 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.053729 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.053810 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.053962 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.054046 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.054193 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.054276 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.054425 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.054509 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.054661 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.054743 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.054910 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.054988 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.055142 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.055221 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.055377 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.055455 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.055608 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.055692 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.055843 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.055922 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.056078 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.056161 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.056322 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.056398 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.056549 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.056627 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.056786 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.056863 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.057021 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.057100 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.057255 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.057334 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.057510 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.057591 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.057771 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.057861 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.057975 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.058050 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.058221 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.058295 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.058457 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.058524 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.058689 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.058768 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.058968 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.059087 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.059225 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.059333 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.059446 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.059582 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.059692 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.059780 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.059852 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.059917 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.060037 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.060116 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.060291 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.060376 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.060527 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.060614 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.060765 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.060857 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.060997 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.061073 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.061236 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.061312 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.061492 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.061588 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.061729 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.061809 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.061966 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.062044 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.062198 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.062285 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.062434 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.062513 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.062667 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.062793 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.062904 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.062990 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.063143 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.063266 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.063377 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.063456 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.063604 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.063690 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.063833 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.063996 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.064077 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.064200 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.064282 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.064363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.064497 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.064585 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.064737 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.064816 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.064972 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.065125 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.065220 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.065305 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.065477 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.065558 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.065733 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.065823 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.065974 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.066052 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.066219 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.066296 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.066450 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] auth.external = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.066537 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.066680 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.066762 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.066927 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.067004 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.067167 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.067253 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.067407 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] auth.password = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.067493 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.067636 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] auth.token = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.067838 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.067913 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.068074 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.068162 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.068331 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.068411 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.068589 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.068666 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.068833 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.068922 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.069074 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.069202 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.069304 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.069408 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.069561 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] credential.caching = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.069649 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.069798 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.069875 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.070045 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.070123 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.070278 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.070363 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.070515 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.070593 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.070755 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.070832 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.070985 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.071070 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.071229 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.071309 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.071482 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.071561 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.071718 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.071805 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.071970 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.072049 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.072209 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] auth.external = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.072317 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.072446 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.072533 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.072736 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.072825 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.072970 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.073049 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.073206 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] auth.password = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.073285 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.073463 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] auth.token = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.073558 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] federation.caching = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.073708 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.073788 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.073946 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.074025 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.074190 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.074276 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.074420 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.074500 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.074665 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.074751 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.074899 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.074986 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.075132 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.075213 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.075370 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] credential.caching = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.075450 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.075619 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.075705 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.075859 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.075975 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.076095 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.076169 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.076323 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] identity.caching = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.076401 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.076563 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.076627 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.076810 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.076893 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.077040 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.077129 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.077276 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.077357 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.077549 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.077629 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.077772 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.077849 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.078003 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.078086 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.078259 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.078339 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.078509 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.078590 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.078740 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.078830 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.078969 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.079049 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.079189 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.079260 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] federation.caching = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.079762 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.079842 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.079904 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.079964 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.080032 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.080094 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.080154 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.080225 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.080724 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.080805 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.080878 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.080941 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.081001 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.081071 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.081134 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.081194 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.081600 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.081686 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.081750 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.081811 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.081871 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.081930 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.082002 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.082098 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] identity.caching = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.082240 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.082404 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.082479 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.082706 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.082793 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.082857 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.082918 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.083256 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.083899 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.083965 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.084050 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.084118 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.084179 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.084529 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.084616 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.084679 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.084748 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.084812 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.084872 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.085165 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.085246 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.085310 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.085379 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.085465 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.085541 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.085704 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.085802 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.085942 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.086042 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.086178 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.086268 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.086414 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.086504 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.086660 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.086758 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.086906 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.086996 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.087146 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.087247 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.087370 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.087467 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.087595 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.087684 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.087841 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.087931 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.088075 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.088173 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.088309 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.088399 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.088542 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.088631 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.088771 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.user = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.088869 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.089007 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.089097 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.089260 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.089351 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.089505 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.089594 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.089751 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.089839 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.089996 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.090076 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.090239 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.090319 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.090479 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.090560 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.090709 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.090796 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.090944 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.091025 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.091175 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.091255 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.091408 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.091487 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.091639 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.091722 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.091879 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.091962 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.092120 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.092201 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.092360 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.092442 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.092603 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.092689 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.092848 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.092929 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.093077 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.093163 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.093308 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.093410 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.093568 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.093658 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.093803 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.093885 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.094040 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.094142 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.094271 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.094359 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.094506 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.094587 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.094741 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.user = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.094821 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.094972 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.095053 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.095226 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.095308 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.095454 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.095534 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.095697 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.095778 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.095932 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.096013 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.096163 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.096243 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.096399 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.096480 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.096633 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.096713 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.096870 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.096949 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.097099 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.097180 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.097332 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.097444 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.097593 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] resource.caching = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.097675 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.097843 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.097922 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.098085 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.098167 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.098317 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.098398 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.098564 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.098645 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.098812 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.098892 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.099593 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.099685 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.099849 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.099928 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.100083 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.100164 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.100323 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.100408 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.100556 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] role.caching = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.100636 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.100798 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.100878 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] role.driver = sql {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.101025 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.101104 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.101273 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.101354 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.101542 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.101626 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.101789 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.101870 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.102035 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.102115 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.102281 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.102363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.102528 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.102607 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.102767 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.102847 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.102997 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.103074 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.103229 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.103309 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.103474 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.103566 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.103708 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.103787 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.103947 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.104027 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.104190 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] resource.caching = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.104278 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.104445 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.104589 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.104695 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.104829 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.104934 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.105080 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.105185 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.105330 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.105473 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.105603 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.105685 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.105854 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.105937 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.106087 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.106167 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.106338 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.106418 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.106588 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.106669 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] role.caching = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.106825 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.106905 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] role.driver = sql {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.107056 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.107136 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.107287 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.107369 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.107517 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.107596 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.107763 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.107843 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.108014 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.108094 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.108256 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.108335 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.108493 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.108573 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.108726 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.108808 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.108956 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.109026 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.109192 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] token.caching = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.109288 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.109444 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.109529 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.109691 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.109772 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.109926 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.110006 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.110179 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.110261 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.110429 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.110594 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.110674 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.110840 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.110922 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.111098 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.111179 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.111353 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.111433 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.111584 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.111665 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.111821 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.111901 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.112054 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.112134 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.112299 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.112381 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.112546 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.112626 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.112801 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.112889 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.113006 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.113088 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.113244 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.113324 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.113506 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.113588 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] database.connection = **** {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.113760 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.113841 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.114005 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.114085 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.114241 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.114321 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.114478 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.114574 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.114755 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.114836 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.114991 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.115217 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.115304 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.115380 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] token.caching = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.115452 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.115524 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.115703 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.115784 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.115938 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.116028 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.116179 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.116260 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.116413 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.116493 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.116660 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.116749 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.116893 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.116974 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.117137 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.117218 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.117368 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.117481 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.117626 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.117708 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.117859 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.117939 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.118012 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 15:57:32.118093 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.118338 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.118591 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.118825 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.119073 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.119342 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.119606 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] database.connection = **** {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.119851 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.120101 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.120340 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.120584 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.120828 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.121067 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.121304 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.121567 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.121849 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.122088 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.122335 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.122576 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.122830 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.123069 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.123316 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.123549 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.123793 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.124030 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 15:57:32.124201 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 15:57:32.147601 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.147827 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.148052 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.149993 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.150232 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.150462 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.156774 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.159241 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.187264 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.187491 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.188085 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.188324 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.241335 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.242050 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.291324 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.291549 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.292684 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.292925 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.365747 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.365967 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.366186 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.366273 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.366402 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.366487 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.366614 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.366698 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.366823 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.366908 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.367124 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.367345 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.389790 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.390020 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.390192 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.390277 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.390429 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.390512 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.390652 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.390734 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.390866 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.390949 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.391080 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.391162 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.391292 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.391511 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.402355 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.402939 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.415647 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.415878 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.416098 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.416221 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.416308 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.416456 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.416549 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.416683 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.416766 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.416907 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.416993 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.417126 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.417343 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.417596 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 15:57:32.434448 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.434651 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 15 15:57:32.434980 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.435138 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.435221 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 15 15:57:32.435352 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 15 15:57:32.435434 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.435667 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.435756 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.435874 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 15 15:57:32.435955 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.436140 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.436221 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.436397 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.436653 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.436909 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.446764 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.447033 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.447294 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.447567 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.447649 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.447898 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.448163 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.448442 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.455594 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.456547 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.458907 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.459184 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.459461 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.459735 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.459960 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.460043 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.460241 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.460323 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.460498 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.460586 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.460762 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.460844 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.461023 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.461104 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.461289 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.461379 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.461572 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.461653 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.461843 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.462113 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.462386 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.462652 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.487658 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.489214 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.489297 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.489536 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.491488 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.491719 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.495284 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.496878 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.497193 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.497508 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.498872 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.499158 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.504563 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.504840 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.506517 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.506798 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.509269 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.509573 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.509850 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.510125 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.510394 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.510660 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.510921 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.511179 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.511260 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.511470 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.511748 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.512023 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.512292 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.512562 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.512832 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.513119 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.529789 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.530059 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.531701 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.531977 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.534476 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.537208 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.539049 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.539448 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.541545 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.541545 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.544334 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.546318 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.547858 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.549885 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.551412 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.551701 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.551975 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.552793 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.553061 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.553345 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.554400 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.554739 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.555050 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.555341 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.555622 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.555915 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.572091 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.572368 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.572630 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.572884 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.574873 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.575175 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.575423 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.575689 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.580520 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.582193 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.582465 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.583580 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.585273 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.585571 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.585698 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.585982 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.586255 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.586536 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.586816 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.588669 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.588952 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.589245 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.589555 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.589844 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.600345 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.600616 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.600889 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.601161 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.601555 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.601827 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.602097 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.603323 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.603605 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.603886 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.604166 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.604538 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.604821 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.605101 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.620677 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.623237 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.623850 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.626450 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.627118 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.628870 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.629726 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.630501 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.630843 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.631043 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.631558 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.633164 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.633470 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.633754 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.638107 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.639636 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.640917 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.642511 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.642758 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.643052 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.643453 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.643725 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.645694 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.646554 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.646929 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.647217 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.653182 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.653495 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.653820 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.656260 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.656616 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.656961 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.662358 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.662636 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.662909 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.663178 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.663444 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.663832 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.664114 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.664375 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.664651 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.664914 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.665178 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.665476 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.665605 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 15:57:32.665755 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.665889 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.666010 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.666171 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.666449 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.666722 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.667114 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.667401 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.667686 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.667962 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.668235 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.668509 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.668795 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.669073 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.669334 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 15:57:32.710312 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f0b4d5a9c0 pid: 79290 (default app) Dec 15 15:57:32.711234 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f0b4d5a9c0 pid: 79289 (default app) Dec 15 15:57:32.713834 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3135f-d974-4810-8d90-cedb7049e4d5 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:32.714125 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3135f-d974-4810-8d90-cedb7049e4d5 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:32.714400 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3135f-d974-4810-8d90-cedb7049e4d5 None None] PATH_INFO: `/v3` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:32.718548 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Wed Dec 15 15:57:32 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:57:40.586586 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e2057-3f7c-4fae-9c00-ff0ff2a88349 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:40.587100 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e2057-3f7c-4fae-9c00-ff0ff2a88349 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:40.587204 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e2057-3f7c-4fae-9c00-ff0ff2a88349 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:40.592162 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:57:40 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:57:40.598271 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4b23d-02ca-4d1e-aac3-67ee7a6b22c3 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:40.598665 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4b23d-02ca-4d1e-aac3-67ee7a6b22c3 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:40.598819 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4b23d-02ca-4d1e-aac3-67ee7a6b22c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:40.629172 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG oslo_db.sqlalchemy.engines [None req-bdf4b23d-02ca-4d1e-aac3-67ee7a6b22c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 15:57:40.821201 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG passlib.handlers.bcrypt [None req-bdf4b23d-02ca-4d1e-aac3-67ee7a6b22c3 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79290) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 15 15:57:40.821637 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG passlib.handlers.bcrypt [None req-bdf4b23d-02ca-4d1e-aac3-67ee7a6b22c3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79290) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 15 15:57:40.876264 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-bdf4b23d-02ca-4d1e-aac3-67ee7a6b22c3 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:57:40.877857 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-bdf4b23d-02ca-4d1e-aac3-67ee7a6b22c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:57:41.003496 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:57:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:57:41.155775 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e2057-3f7c-4fae-9c00-ff0ff2a88349 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:41.190140 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG oslo_db.sqlalchemy.engines [None req-6c5e2057-3f7c-4fae-9c00-ff0ff2a88349 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 15:57:41.319095 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e2057-3f7c-4fae-9c00-ff0ff2a88349 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:41.323359 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff4858-e6be-4391-922f-b5a69cb01553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:41.324015 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff4858-e6be-4391-922f-b5a69cb01553 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:41.324300 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff4858-e6be-4391-922f-b5a69cb01553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:41.324577 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff4858-e6be-4391-922f-b5a69cb01553 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:41.332431 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff4858-e6be-4391-922f-b5a69cb01553 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:41.383937 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8bff4858-e6be-4391-922f-b5a69cb01553 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 15 15:57:41.384270 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff4858-e6be-4391-922f-b5a69cb01553 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:41.393403 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:57:41 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 15:57:41.400133 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4b23d-02ca-4d1e-aac3-67ee7a6b22c3 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:41.415623 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4b23d-02ca-4d1e-aac3-67ee7a6b22c3 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:41.419995 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22d41a-d4f6-412c-bf2b-990850bb9119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:41.421102 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22d41a-d4f6-412c-bf2b-990850bb9119 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:41.421410 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22d41a-d4f6-412c-bf2b-990850bb9119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:41.421690 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22d41a-d4f6-412c-bf2b-990850bb9119 admin admin] PATH_INFO: `/v3/projects/d7bb9a879a6841dda52e30764e5ba9c7` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:41.423236 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22d41a-d4f6-412c-bf2b-990850bb9119 admin admin] RBAC: Authorizing `identity:get_project(project_id=d7bb9a879a6841dda52e30764e5ba9c7)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:41.476951 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5b22d41a-d4f6-412c-bf2b-990850bb9119 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 15 15:57:41.477292 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22d41a-d4f6-412c-bf2b-990850bb9119 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:41.481960 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:57:41 2021] GET /identity/v3/projects/d7bb9a879a6841dda52e30764e5ba9c7 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:57:43.802903 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0394357-7cbd-4b46-95f2-f903f8fff509 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:43.803450 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0394357-7cbd-4b46-95f2-f903f8fff509 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:43.803592 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0394357-7cbd-4b46-95f2-f903f8fff509 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:43.808032 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:57:43 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:57:43.814244 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8533ae-4551-4e2f-bf53-4607fe136b91 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:43.814606 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8533ae-4551-4e2f-bf53-4607fe136b91 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:43.814811 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8533ae-4551-4e2f-bf53-4607fe136b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:43.834970 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-6b8533ae-4551-4e2f-bf53-4607fe136b91 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:57:43.836671 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-6b8533ae-4551-4e2f-bf53-4607fe136b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:57:43.844448 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:57:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:57:43.868210 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0394357-7cbd-4b46-95f2-f903f8fff509 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:43.880057 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0394357-7cbd-4b46-95f2-f903f8fff509 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:43.884746 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713db266-c68c-4c8e-8bb2-8d8008c90eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:43.885364 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713db266-c68c-4c8e-8bb2-8d8008c90eac admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:43.885676 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713db266-c68c-4c8e-8bb2-8d8008c90eac admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:43.885952 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713db266-c68c-4c8e-8bb2-8d8008c90eac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:43.893502 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713db266-c68c-4c8e-8bb2-8d8008c90eac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:43.895276 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713db266-c68c-4c8e-8bb2-8d8008c90eac admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:43.904346 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:57:43 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:57:43.910206 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8533ae-4551-4e2f-bf53-4607fe136b91 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:43.919326 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8533ae-4551-4e2f-bf53-4607fe136b91 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:43.923712 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbe992-f8d0-440a-be31-417826c09cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:43.924560 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbe992-f8d0-440a-be31-417826c09cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:43.924843 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbe992-f8d0-440a-be31-417826c09cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:43.925118 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbe992-f8d0-440a-be31-417826c09cf5 admin admin] PATH_INFO: `/v3/users/33aa1fa71819442bb0ab5bc31d11564d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:43.926846 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbe992-f8d0-440a-be31-417826c09cf5 admin admin] RBAC: Authorizing `identity:get_user(user_id=33aa1fa71819442bb0ab5bc31d11564d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:43.929332 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbe992-f8d0-440a-be31-417826c09cf5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:43.930901 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:57:43 2021] GET /identity/v3/users/33aa1fa71819442bb0ab5bc31d11564d => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:57:46.373029 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af8276-1756-4048-9637-d16b9a8ea81e None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:46.373576 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af8276-1756-4048-9637-d16b9a8ea81e None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:46.373659 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af8276-1756-4048-9637-d16b9a8ea81e None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:46.375342 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:57:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:57:46.380317 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ffd9a-7825-4c87-9fe1-9af20a0ffd2a None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:46.380746 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ffd9a-7825-4c87-9fe1-9af20a0ffd2a None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:46.380855 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ffd9a-7825-4c87-9fe1-9af20a0ffd2a None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:46.381198 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358e5b7-37a9-4bb8-87b6-fc63351d0ead None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:46.382033 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358e5b7-37a9-4bb8-87b6-fc63351d0ead None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:46.382310 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358e5b7-37a9-4bb8-87b6-fc63351d0ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:46.383414 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 6/11] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:57:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:57:46.388724 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c5dba-040d-4f25-b387-4bc5b8d430be None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:46.389008 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c5dba-040d-4f25-b387-4bc5b8d430be None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:46.389284 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c5dba-040d-4f25-b387-4bc5b8d430be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:46.406341 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-d62c5dba-040d-4f25-b387-4bc5b8d430be None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:57:46.407572 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-d62c5dba-040d-4f25-b387-4bc5b8d430be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:57:46.415513 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 7/12] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:57:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:57:46.422907 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG passlib.handlers.bcrypt [None req-3358e5b7-37a9-4bb8-87b6-fc63351d0ead None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79289) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 15 15:57:46.423334 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG passlib.handlers.bcrypt [None req-3358e5b7-37a9-4bb8-87b6-fc63351d0ead None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79289) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 15 15:57:46.439418 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c5dba-040d-4f25-b387-4bc5b8d430be None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:46.448632 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c5dba-040d-4f25-b387-4bc5b8d430be None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:46.452975 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70c255-8877-4e8d-a65c-ae2e70a6d9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:46.453766 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70c255-8877-4e8d-a65c-ae2e70a6d9fd admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:46.454048 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70c255-8877-4e8d-a65c-ae2e70a6d9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:46.454318 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70c255-8877-4e8d-a65c-ae2e70a6d9fd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:46.466870 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70c255-8877-4e8d-a65c-ae2e70a6d9fd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:57:46.470232 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-3358e5b7-37a9-4bb8-87b6-fc63351d0ead None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:57:46.471865 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-3358e5b7-37a9-4bb8-87b6-fc63351d0ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:57:46.473609 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-be70c255-8877-4e8d-a65c-ae2e70a6d9fd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 15:57:46.474786 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 8/13] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:57:46 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:57:46.480586 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70c255-8877-4e8d-a65c-ae2e70a6d9fd admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:46.489918 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70c255-8877-4e8d-a65c-ae2e70a6d9fd admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:46.494442 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 6/14] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:57:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:57:46.494790 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84492c36-476b-4676-b4d1-3af88636389a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:46.495427 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84492c36-476b-4676-b4d1-3af88636389a admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:46.495680 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84492c36-476b-4676-b4d1-3af88636389a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:46.495953 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84492c36-476b-4676-b4d1-3af88636389a admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:46.496708 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84492c36-476b-4676-b4d1-3af88636389a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:57:46.497012 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84492c36-476b-4676-b4d1-3af88636389a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:46.498783 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING py.warnings [None req-84492c36-476b-4676-b4d1-3af88636389a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:57:46.498783 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: warnings.warn(msg) Dec 15 15:57:46.498783 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: Dec 15 15:57:46.499678 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84492c36-476b-4676-b4d1-3af88636389a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:46.513888 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 9/15] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:57:46 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:57:46.517753 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358e5b7-37a9-4bb8-87b6-fc63351d0ead None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:46.519620 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84492c36-476b-4676-b4d1-3af88636389a admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:46.526975 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358e5b7-37a9-4bb8-87b6-fc63351d0ead None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:46.529144 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84492c36-476b-4676-b4d1-3af88636389a admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:46.531475 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669b229-5264-4def-88d9-2da7595830df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:46.532428 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669b229-5264-4def-88d9-2da7595830df admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:46.532713 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669b229-5264-4def-88d9-2da7595830df admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:46.532988 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669b229-5264-4def-88d9-2da7595830df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:46.533633 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddabb77-228d-45be-93fa-b1dda199a4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:46.534465 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddabb77-228d-45be-93fa-b1dda199a4aa admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:46.534746 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddabb77-228d-45be-93fa-b1dda199a4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:46.535018 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddabb77-228d-45be-93fa-b1dda199a4aa admin admin] PATH_INFO: `/v3/users/33aa1fa71819442bb0ab5bc31d11564d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:46.536506 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddabb77-228d-45be-93fa-b1dda199a4aa admin admin] RBAC: Authorizing `identity:get_user(user_id=33aa1fa71819442bb0ab5bc31d11564d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:46.539044 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddabb77-228d-45be-93fa-b1dda199a4aa admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:46.540612 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 10/16] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:57:46 2021] GET /identity/v3/users/33aa1fa71819442bb0ab5bc31d11564d => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:57:46.542055 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669b229-5264-4def-88d9-2da7595830df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:46.543877 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669b229-5264-4def-88d9-2da7595830df admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:46.546310 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddabb77-228d-45be-93fa-b1dda199a4aa admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:46.552504 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 7/17] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:57:46 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:57:46.556162 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddabb77-228d-45be-93fa-b1dda199a4aa admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:46.558761 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669b229-5264-4def-88d9-2da7595830df admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:46.560761 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75d11c-f8ea-4fa2-8b1f-ac39ec8d9b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:46.561539 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75d11c-f8ea-4fa2-8b1f-ac39ec8d9b6c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:46.561829 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75d11c-f8ea-4fa2-8b1f-ac39ec8d9b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:46.562107 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75d11c-f8ea-4fa2-8b1f-ac39ec8d9b6c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:46.563287 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75d11c-f8ea-4fa2-8b1f-ac39ec8d9b6c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:46.564998 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75d11c-f8ea-4fa2-8b1f-ac39ec8d9b6c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:46.566565 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 11/18] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:57:46 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:57:46.567034 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669b229-5264-4def-88d9-2da7595830df admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:46.571465 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164b9fd-c088-430b-9702-5445c40cd429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:46.572211 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164b9fd-c088-430b-9702-5445c40cd429 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:46.572402 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75d11c-f8ea-4fa2-8b1f-ac39ec8d9b6c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:46.572510 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164b9fd-c088-430b-9702-5445c40cd429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:46.572752 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164b9fd-c088-430b-9702-5445c40cd429 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:46.574128 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164b9fd-c088-430b-9702-5445c40cd429 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:46.575807 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164b9fd-c088-430b-9702-5445c40cd429 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:46.577500 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 8/19] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:57:46 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:57:46.581831 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75d11c-f8ea-4fa2-8b1f-ac39ec8d9b6c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:46.586690 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ce806-a240-42ea-bf30-c4b3599815f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:46.587361 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ce806-a240-42ea-bf30-c4b3599815f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:46.587646 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ce806-a240-42ea-bf30-c4b3599815f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:46.587926 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ce806-a240-42ea-bf30-c4b3599815f1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:46.588789 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ce806-a240-42ea-bf30-c4b3599815f1 admin admin] RBAC: Adding query filter params (role.id=bc362f875c6d4cee83ba65b8d134462d, scope.domain.id=default, user.id=33aa1fa71819442bb0ab5bc31d11564d) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:57:46.589102 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ce806-a240-42ea-bf30-c4b3599815f1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:46.590188 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING py.warnings [None req-7c7ce806-a240-42ea-bf30-c4b3599815f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:57:46.590188 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: warnings.warn(msg) Dec 15 15:57:46.590188 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: Dec 15 15:57:46.591384 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ce806-a240-42ea-bf30-c4b3599815f1 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:46.599031 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 12/20] 10.222.0.36 () {56 vars in 1343 bytes} [Wed Dec 15 15:57:46 2021] GET /identity/v3/role_assignments?user.id=33aa1fa71819442bb0ab5bc31d11564d&scope.domain.id=default&role.id=bc362f875c6d4cee83ba65b8d134462d => generated 233 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:57:49.649308 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc0d46-6e35-476a-af7e-2dc00006f0c5 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:49.649868 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc0d46-6e35-476a-af7e-2dc00006f0c5 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:49.649868 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc0d46-6e35-476a-af7e-2dc00006f0c5 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:49.651895 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 9/21] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:57:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:57:49.659243 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bb892-236e-45fb-870a-4dd554e310d5 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:49.659243 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bb892-236e-45fb-870a-4dd554e310d5 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:49.659243 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bb892-236e-45fb-870a-4dd554e310d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:49.661714 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe30c3-f8ca-4177-b66b-1530a6bbad46 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:49.662206 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe30c3-f8ca-4177-b66b-1530a6bbad46 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:49.663238 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe30c3-f8ca-4177-b66b-1530a6bbad46 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:49.665725 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 10/22] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:57:49 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:57:49.675385 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4542e-9019-46e6-be82-bc7d4ad6400b None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:49.675976 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4542e-9019-46e6-be82-bc7d4ad6400b None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:49.676452 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4542e-9019-46e6-be82-bc7d4ad6400b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:49.711431 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-34b4542e-9019-46e6-be82-bc7d4ad6400b None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:57:49.713045 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-34b4542e-9019-46e6-be82-bc7d4ad6400b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:57:49.721032 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 11/23] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:57:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:57:49.729862 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744c96e-a2e4-4aae-abc7-87a9849b49ea None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:49.730482 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744c96e-a2e4-4aae-abc7-87a9849b49ea None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:49.730984 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744c96e-a2e4-4aae-abc7-87a9849b49ea None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:49.733359 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 12/24] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:57:49 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:57:49.751932 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a589ccf-53fd-476a-9016-4e2cd3d30c5c None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:49.752592 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a589ccf-53fd-476a-9016-4e2cd3d30c5c None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:49.753065 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a589ccf-53fd-476a-9016-4e2cd3d30c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:49.789639 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-3a589ccf-53fd-476a-9016-4e2cd3d30c5c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:57:49.791222 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-3a589ccf-53fd-476a-9016-4e2cd3d30c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:57:49.799514 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 13/25] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:57:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:57:49.800714 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a589ccf-53fd-476a-9016-4e2cd3d30c5c None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:49.814415 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-1b9bb892-236e-45fb-870a-4dd554e310d5 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:57:49.815625 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-1b9bb892-236e-45fb-870a-4dd554e310d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:57:49.818179 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a589ccf-53fd-476a-9016-4e2cd3d30c5c None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:49.823257 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8173c6-8b1d-46ad-92ed-6ecc2071e704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:49.824381 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8173c6-8b1d-46ad-92ed-6ecc2071e704 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:49.824883 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8173c6-8b1d-46ad-92ed-6ecc2071e704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:49.825356 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8173c6-8b1d-46ad-92ed-6ecc2071e704 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:49.846213 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8173c6-8b1d-46ad-92ed-6ecc2071e704 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:57:49.847136 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 13/26] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:57:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:57:49.857857 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-3e8173c6-8b1d-46ad-92ed-6ecc2071e704 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 15:57:49.859627 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 14/27] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:57:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:57:49.865562 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9bb892-236e-45fb-870a-4dd554e310d5 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:49.869419 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8173c6-8b1d-46ad-92ed-6ecc2071e704 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:49.879314 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8173c6-8b1d-46ad-92ed-6ecc2071e704 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:49.884417 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9bb892-236e-45fb-870a-4dd554e310d5 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:49.892362 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d73732-52f5-4557-ad08-59b2b58ded03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:49.893270 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d73732-52f5-4557-ad08-59b2b58ded03 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:49.893577 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d73732-52f5-4557-ad08-59b2b58ded03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:49.893932 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d73732-52f5-4557-ad08-59b2b58ded03 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:49.906120 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23909e-d59c-464b-9327-065bb417a65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:49.907165 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23909e-d59c-464b-9327-065bb417a65a admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:49.907657 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23909e-d59c-464b-9327-065bb417a65a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:49.908136 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23909e-d59c-464b-9327-065bb417a65a admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:49.909144 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23909e-d59c-464b-9327-065bb417a65a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:57:49.909682 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23909e-d59c-464b-9327-065bb417a65a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:49.911790 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23909e-d59c-464b-9327-065bb417a65a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:49.916872 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d73732-52f5-4557-ad08-59b2b58ded03 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:49.918787 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d73732-52f5-4557-ad08-59b2b58ded03 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:49.925484 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 14/28] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:57:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:57:49.926570 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23909e-d59c-464b-9327-065bb417a65a admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:49.936201 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-35d73732-52f5-4557-ad08-59b2b58ded03 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:57:49.937928 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 15/29] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:57:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:57:49.938841 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d73732-52f5-4557-ad08-59b2b58ded03 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:49.939588 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23909e-d59c-464b-9327-065bb417a65a admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:49.957407 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67715b6-be31-4022-be2f-b7c929cb2330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:49.957407 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67715b6-be31-4022-be2f-b7c929cb2330 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:49.957407 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67715b6-be31-4022-be2f-b7c929cb2330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:49.957689 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d73732-52f5-4557-ad08-59b2b58ded03 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:49.957760 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67715b6-be31-4022-be2f-b7c929cb2330 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:49.957760 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67715b6-be31-4022-be2f-b7c929cb2330 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:49.957760 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING py.warnings [None req-f67715b6-be31-4022-be2f-b7c929cb2330 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:57:49.957760 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: warnings.warn(msg) Dec 15 15:57:49.957760 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: Dec 15 15:57:49.957760 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67715b6-be31-4022-be2f-b7c929cb2330 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:49.964312 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71f877-c792-45ad-a41f-dc50b59b4978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:49.965198 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71f877-c792-45ad-a41f-dc50b59b4978 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:49.965519 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71f877-c792-45ad-a41f-dc50b59b4978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:49.965842 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71f877-c792-45ad-a41f-dc50b59b4978 admin admin] PATH_INFO: `/v3/users/33aa1fa71819442bb0ab5bc31d11564d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:49.968353 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71f877-c792-45ad-a41f-dc50b59b4978 admin admin] RBAC: Authorizing `identity:get_user(user_id=33aa1fa71819442bb0ab5bc31d11564d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:49.971292 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71f877-c792-45ad-a41f-dc50b59b4978 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:49.974248 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 16/30] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:57:49 2021] GET /identity/v3/users/33aa1fa71819442bb0ab5bc31d11564d => generated 247 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:57:49.976025 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71f877-c792-45ad-a41f-dc50b59b4978 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:49.987961 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71f877-c792-45ad-a41f-dc50b59b4978 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:50.000368 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3813e-2878-471f-a552-0f4ab5a1e616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:50.001246 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3813e-2878-471f-a552-0f4ab5a1e616 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:50.001704 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3813e-2878-471f-a552-0f4ab5a1e616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:50.002140 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3813e-2878-471f-a552-0f4ab5a1e616 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:50.003022 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3813e-2878-471f-a552-0f4ab5a1e616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:57:50.003467 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3813e-2878-471f-a552-0f4ab5a1e616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:50.005464 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING py.warnings [None req-47e3813e-2878-471f-a552-0f4ab5a1e616 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:57:50.005464 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: warnings.warn(msg) Dec 15 15:57:50.005464 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: Dec 15 15:57:50.008034 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3813e-2878-471f-a552-0f4ab5a1e616 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:50.026811 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 17/31] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:57:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:57:50.032576 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3813e-2878-471f-a552-0f4ab5a1e616 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:50.043120 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3813e-2878-471f-a552-0f4ab5a1e616 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:50.048388 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820e185-2d85-416c-ab31-b9da31bb6eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:50.049317 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820e185-2d85-416c-ab31-b9da31bb6eaf admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:50.049758 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820e185-2d85-416c-ab31-b9da31bb6eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:50.050190 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820e185-2d85-416c-ab31-b9da31bb6eaf admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:50.051515 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820e185-2d85-416c-ab31-b9da31bb6eaf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:50.053557 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820e185-2d85-416c-ab31-b9da31bb6eaf admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:50.055576 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 18/32] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:57:50 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:57:50.057121 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745faac3-0e2e-4f26-82c3-75fc9676139f None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:50.057651 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745faac3-0e2e-4f26-82c3-75fc9676139f None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:50.058129 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745faac3-0e2e-4f26-82c3-75fc9676139f None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:50.064446 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 19/33] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:57:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:57:50.065372 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745faac3-0e2e-4f26-82c3-75fc9676139f None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:50.079047 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745faac3-0e2e-4f26-82c3-75fc9676139f None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:50.083995 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9aab00-1df3-4ec5-a9d4-6ea34295d0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:50.085464 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9aab00-1df3-4ec5-a9d4-6ea34295d0b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:50.086028 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9aab00-1df3-4ec5-a9d4-6ea34295d0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:50.086505 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9aab00-1df3-4ec5-a9d4-6ea34295d0b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:50.087462 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9aab00-1df3-4ec5-a9d4-6ea34295d0b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:50.088665 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING py.warnings [None req-fb9aab00-1df3-4ec5-a9d4-6ea34295d0b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:57:50.088665 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: warnings.warn(msg) Dec 15 15:57:50.088665 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: Dec 15 15:57:50.090491 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9aab00-1df3-4ec5-a9d4-6ea34295d0b3 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:50.102629 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 15/34] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 15:57:49 2021] POST /identity/v3/roles => generated 219 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:57:50.102629 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67715b6-be31-4022-be2f-b7c929cb2330 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:50.119259 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67715b6-be31-4022-be2f-b7c929cb2330 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:50.127904 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a11b99-ae65-4ca3-9fac-34eade76842d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:50.128810 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a11b99-ae65-4ca3-9fac-34eade76842d admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:50.129105 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a11b99-ae65-4ca3-9fac-34eade76842d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:50.129404 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a11b99-ae65-4ca3-9fac-34eade76842d admin admin] PATH_INFO: `/v3/domains/default/users/33aa1fa71819442bb0ab5bc31d11564d/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:50.131982 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a11b99-ae65-4ca3-9fac-34eade76842d admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=33aa1fa71819442bb0ab5bc31d11564d, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:50.138220 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING py.warnings [None req-82a11b99-ae65-4ca3-9fac-34eade76842d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:57:50.138220 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: warnings.warn(msg) Dec 15 15:57:50.138220 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: Dec 15 15:57:50.140247 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a11b99-ae65-4ca3-9fac-34eade76842d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:50.179111 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 16/35] 10.222.0.36 () {58 vars in 1382 bytes} [Wed Dec 15 15:57:50 2021] PUT /identity/v3/domains/default/users/33aa1fa71819442bb0ab5bc31d11564d/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 15:57:50.180520 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15b50a-9ab4-4fe0-89e0-200234cf8a82 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:50.180816 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15b50a-9ab4-4fe0-89e0-200234cf8a82 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:50.181095 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15b50a-9ab4-4fe0-89e0-200234cf8a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:50.223581 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-7c15b50a-9ab4-4fe0-89e0-200234cf8a82 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:57:50.225178 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-7c15b50a-9ab4-4fe0-89e0-200234cf8a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:57:50.362265 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 17/36] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:57:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:57:50.397972 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15b50a-9ab4-4fe0-89e0-200234cf8a82 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:50.412029 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15b50a-9ab4-4fe0-89e0-200234cf8a82 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:50.423632 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddd8a4-e439-44ab-ab80-4309750d2d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:50.424329 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddd8a4-e439-44ab-ab80-4309750d2d11 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:50.424622 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddd8a4-e439-44ab-ab80-4309750d2d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:50.424903 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddd8a4-e439-44ab-ab80-4309750d2d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:50.425725 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddd8a4-e439-44ab-ab80-4309750d2d11 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:50.427398 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddd8a4-e439-44ab-ab80-4309750d2d11 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:50.431154 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 20/37] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Dec 15 15:57:50 2021] POST /identity/v3/projects => generated 301 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:57:50.445694 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 18/38] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 15:57:50 2021] POST /identity/v3/roles => generated 225 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 15:57:51.104300 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3ac07-775d-4672-9b37-862b6081f93f None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:51.104796 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3ac07-775d-4672-9b37-862b6081f93f None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:51.104866 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3ac07-775d-4672-9b37-862b6081f93f None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:51.106674 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 21/39] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:57:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:57:51.112389 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dd0ef-1ac4-469c-9d8a-0802f377b194 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:51.112772 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dd0ef-1ac4-469c-9d8a-0802f377b194 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:51.112974 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dd0ef-1ac4-469c-9d8a-0802f377b194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:51.131107 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-bf1dd0ef-1ac4-469c-9d8a-0802f377b194 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:57:51.132356 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-bf1dd0ef-1ac4-469c-9d8a-0802f377b194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:57:51.160594 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861afa8-098a-47aa-a2a8-ed46bc44988f None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:51.160893 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861afa8-098a-47aa-a2a8-ed46bc44988f None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:51.161481 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861afa8-098a-47aa-a2a8-ed46bc44988f None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:51.163920 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 22/40] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:57:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:57:51.169410 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110de23-1e15-4bcc-abf7-67a0373e5308 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:51.169809 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110de23-1e15-4bcc-abf7-67a0373e5308 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:51.170157 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110de23-1e15-4bcc-abf7-67a0373e5308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:51.190271 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 19/41] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:57:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:57:51.190874 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-f110de23-1e15-4bcc-abf7-67a0373e5308 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:57:51.192467 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f110de23-1e15-4bcc-abf7-67a0373e5308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:57:51.200808 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 23/42] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:57:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:57:51.213815 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1dd0ef-1ac4-469c-9d8a-0802f377b194 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:51.222808 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1dd0ef-1ac4-469c-9d8a-0802f377b194 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:51.224337 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110de23-1e15-4bcc-abf7-67a0373e5308 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:51.228067 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a804c9-fe91-4b1c-95df-2c2d805223ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:51.228741 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a804c9-fe91-4b1c-95df-2c2d805223ca admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:51.229033 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a804c9-fe91-4b1c-95df-2c2d805223ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:51.229318 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a804c9-fe91-4b1c-95df-2c2d805223ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:51.230132 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a804c9-fe91-4b1c-95df-2c2d805223ca admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:51.231792 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a804c9-fe91-4b1c-95df-2c2d805223ca admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:51.234266 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110de23-1e15-4bcc-abf7-67a0373e5308 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:51.239301 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cce82-54db-4091-95a4-6b4dd647183b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:51.240131 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cce82-54db-4091-95a4-6b4dd647183b admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:51.240422 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cce82-54db-4091-95a4-6b4dd647183b admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:51.240707 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cce82-54db-4091-95a4-6b4dd647183b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:51.242893 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970cce82-54db-4091-95a4-6b4dd647183b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:51.244781 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970cce82-54db-4091-95a4-6b4dd647183b admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:51.246574 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 24/43] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:57:51 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:57:51.247520 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 20/44] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 15:57:51 2021] POST /identity/v3/roles => generated 223 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 15:57:51.252638 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cce82-54db-4091-95a4-6b4dd647183b admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:51.263491 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cce82-54db-4091-95a4-6b4dd647183b admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:51.268864 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981bd825-a63d-43c2-97ca-c42ef81f1c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:51.269668 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bd825-a63d-43c2-97ca-c42ef81f1c67 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:51.269965 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bd825-a63d-43c2-97ca-c42ef81f1c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:51.270247 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bd825-a63d-43c2-97ca-c42ef81f1c67 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:51.271095 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981bd825-a63d-43c2-97ca-c42ef81f1c67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:51.273846 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981bd825-a63d-43c2-97ca-c42ef81f1c67 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:51.309832 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 25/45] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Dec 15 15:57:51 2021] POST /identity/v3/projects => generated 312 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 15:57:52.843070 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a143df7-87c7-441d-a60c-afb55165a8a5 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:52.843585 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a143df7-87c7-441d-a60c-afb55165a8a5 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:52.843703 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a143df7-87c7-441d-a60c-afb55165a8a5 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:52.845406 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 21/46] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:57:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:57:52.851803 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ed437-0048-43cb-850e-d0d4c869175e None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:52.852185 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ed437-0048-43cb-850e-d0d4c869175e None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:52.852368 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ed437-0048-43cb-850e-d0d4c869175e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:52.870277 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-073ed437-0048-43cb-850e-d0d4c869175e None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:57:52.871481 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-073ed437-0048-43cb-850e-d0d4c869175e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:57:52.937863 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 26/47] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:57:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:57:52.962460 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a143df7-87c7-441d-a60c-afb55165a8a5 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:52.974413 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a143df7-87c7-441d-a60c-afb55165a8a5 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:52.978835 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6b335-b620-47d2-a844-d2eb7f358019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:52.979604 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6b335-b620-47d2-a844-d2eb7f358019 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:52.979888 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6b335-b620-47d2-a844-d2eb7f358019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:52.980184 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6b335-b620-47d2-a844-d2eb7f358019 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:52.990107 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6b335-b620-47d2-a844-d2eb7f358019 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:57:52.997358 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-42c6b335-b620-47d2-a844-d2eb7f358019 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 15:57:52.998519 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 22/48] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:57:52 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:57:53.004448 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ed437-0048-43cb-850e-d0d4c869175e None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:53.013955 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ed437-0048-43cb-850e-d0d4c869175e None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:53.018401 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa08f1b-ab5b-4185-a92a-f998768bd5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:53.019057 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa08f1b-ab5b-4185-a92a-f998768bd5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:53.019343 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa08f1b-ab5b-4185-a92a-f998768bd5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:53.019623 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa08f1b-ab5b-4185-a92a-f998768bd5d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:53.020392 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa08f1b-ab5b-4185-a92a-f998768bd5d0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:57:53.020701 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa08f1b-ab5b-4185-a92a-f998768bd5d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:53.021740 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING py.warnings [None req-faa08f1b-ab5b-4185-a92a-f998768bd5d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:57:53.021740 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: warnings.warn(msg) Dec 15 15:57:53.021740 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: Dec 15 15:57:53.023058 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa08f1b-ab5b-4185-a92a-f998768bd5d0 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:53.035839 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 27/49] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:57:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:57:53.042003 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6b335-b620-47d2-a844-d2eb7f358019 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:53.052181 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6b335-b620-47d2-a844-d2eb7f358019 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:53.057354 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30888e4-ab72-4747-b02b-4d5ac8311467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:53.058248 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30888e4-ab72-4747-b02b-4d5ac8311467 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:53.058536 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30888e4-ab72-4747-b02b-4d5ac8311467 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:53.058814 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30888e4-ab72-4747-b02b-4d5ac8311467 admin admin] PATH_INFO: `/v3/users/33aa1fa71819442bb0ab5bc31d11564d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:53.060029 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30888e4-ab72-4747-b02b-4d5ac8311467 admin admin] RBAC: Authorizing `identity:get_user(user_id=33aa1fa71819442bb0ab5bc31d11564d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:53.061922 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30888e4-ab72-4747-b02b-4d5ac8311467 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:53.063515 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 23/50] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:57:53 2021] GET /identity/v3/users/33aa1fa71819442bb0ab5bc31d11564d => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:57:53.069986 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa08f1b-ab5b-4185-a92a-f998768bd5d0 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:53.079731 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa08f1b-ab5b-4185-a92a-f998768bd5d0 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:53.084194 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07f0c4-fde3-4a33-ad76-f954639bf1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:53.084994 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07f0c4-fde3-4a33-ad76-f954639bf1fa admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:53.085280 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07f0c4-fde3-4a33-ad76-f954639bf1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:53.085582 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07f0c4-fde3-4a33-ad76-f954639bf1fa admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:53.086782 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07f0c4-fde3-4a33-ad76-f954639bf1fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:53.088505 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07f0c4-fde3-4a33-ad76-f954639bf1fa admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:53.090109 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 28/51] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:57:53 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:57:53.096358 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30888e4-ab72-4747-b02b-4d5ac8311467 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:53.106028 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30888e4-ab72-4747-b02b-4d5ac8311467 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:53.110399 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce964963-3e5a-4ecc-99ca-b90a5981868d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:53.111034 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce964963-3e5a-4ecc-99ca-b90a5981868d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:53.111322 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce964963-3e5a-4ecc-99ca-b90a5981868d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:53.111602 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce964963-3e5a-4ecc-99ca-b90a5981868d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:53.112438 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce964963-3e5a-4ecc-99ca-b90a5981868d admin admin] RBAC: Adding query filter params (role.id=bc362f875c6d4cee83ba65b8d134462d, scope.domain.id=default, user.id=33aa1fa71819442bb0ab5bc31d11564d) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:57:53.112749 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce964963-3e5a-4ecc-99ca-b90a5981868d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:53.114649 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce964963-3e5a-4ecc-99ca-b90a5981868d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:53.121057 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 24/52] 10.222.0.36 () {56 vars in 1343 bytes} [Wed Dec 15 15:57:53 2021] GET /identity/v3/role_assignments?user.id=33aa1fa71819442bb0ab5bc31d11564d&scope.domain.id=default&role.id=bc362f875c6d4cee83ba65b8d134462d => generated 530 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:57:53.694578 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a18a8-8e4a-4a6c-8561-2d5036cba5b5 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:53.694874 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a18a8-8e4a-4a6c-8561-2d5036cba5b5 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:53.695153 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a18a8-8e4a-4a6c-8561-2d5036cba5b5 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:53.697577 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 29/53] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:57:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:57:53.703193 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb86ae5-c974-46d5-b64d-f6e8aa95e2bc None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:53.703485 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb86ae5-c974-46d5-b64d-f6e8aa95e2bc None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:53.703763 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb86ae5-c974-46d5-b64d-f6e8aa95e2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:53.721594 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-6eb86ae5-c974-46d5-b64d-f6e8aa95e2bc None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:57:53.722776 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-6eb86ae5-c974-46d5-b64d-f6e8aa95e2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:57:53.730879 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 25/54] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:57:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:57:53.759083 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a18a8-8e4a-4a6c-8561-2d5036cba5b5 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:53.773221 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a18a8-8e4a-4a6c-8561-2d5036cba5b5 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:53.777419 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b8f1b-01bf-47c6-8e06-6d9d29f9a657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:53.778195 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b8f1b-01bf-47c6-8e06-6d9d29f9a657 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:53.778480 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b8f1b-01bf-47c6-8e06-6d9d29f9a657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:53.778759 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b8f1b-01bf-47c6-8e06-6d9d29f9a657 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:53.779936 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b8f1b-01bf-47c6-8e06-6d9d29f9a657 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:53.781653 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b8f1b-01bf-47c6-8e06-6d9d29f9a657 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:53.783234 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 30/55] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:57:53 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:57:53.789536 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb86ae5-c974-46d5-b64d-f6e8aa95e2bc None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:53.798397 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb86ae5-c974-46d5-b64d-f6e8aa95e2bc None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:53.802694 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a484e1-e468-4d7b-b0b2-4de1ef63abdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:53.803326 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a484e1-e468-4d7b-b0b2-4de1ef63abdd admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:53.804221 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a484e1-e468-4d7b-b0b2-4de1ef63abdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:53.804498 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a484e1-e468-4d7b-b0b2-4de1ef63abdd admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:53.805217 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a484e1-e468-4d7b-b0b2-4de1ef63abdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:53.806273 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING py.warnings [None req-f1a484e1-e468-4d7b-b0b2-4de1ef63abdd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:57:53.806273 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: warnings.warn(msg) Dec 15 15:57:53.806273 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: Dec 15 15:57:53.807466 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a484e1-e468-4d7b-b0b2-4de1ef63abdd admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:53.833164 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 26/56] 10.222.0.36 () {60 vars in 1161 bytes} [Wed Dec 15 15:57:53 2021] POST /identity/v3/projects => generated 298 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:57:56.193645 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b1d6e-cfc5-4411-a711-f1f5f7666bad None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:56.194151 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b1d6e-cfc5-4411-a711-f1f5f7666bad None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:56.194286 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b1d6e-cfc5-4411-a711-f1f5f7666bad None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:56.196255 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 31/57] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:57:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:57:56.201989 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78521d-0a6d-46a1-8463-a2f4a167d84b None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:56.202355 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78521d-0a6d-46a1-8463-a2f4a167d84b None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:56.202538 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78521d-0a6d-46a1-8463-a2f4a167d84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:56.220250 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-eb78521d-0a6d-46a1-8463-a2f4a167d84b None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:57:56.221447 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-eb78521d-0a6d-46a1-8463-a2f4a167d84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:57:56.275673 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 27/58] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:57:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:57:56.302084 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b1d6e-cfc5-4411-a711-f1f5f7666bad None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:56.313897 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b1d6e-cfc5-4411-a711-f1f5f7666bad None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:56.318071 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1dcf6-9733-490a-9406-3e48efc9f8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:56.318835 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1dcf6-9733-490a-9406-3e48efc9f8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:56.319118 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1dcf6-9733-490a-9406-3e48efc9f8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:56.319902 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1dcf6-9733-490a-9406-3e48efc9f8f4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:56.321085 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1dcf6-9733-490a-9406-3e48efc9f8f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:56.322814 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1dcf6-9733-490a-9406-3e48efc9f8f4 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:56.324339 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 32/59] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:57:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:57:56.329745 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78521d-0a6d-46a1-8463-a2f4a167d84b None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:57:56.339210 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78521d-0a6d-46a1-8463-a2f4a167d84b None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:57:56.343555 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88b456-63e1-412b-a578-410aeae99419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:57:56.344196 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88b456-63e1-412b-a578-410aeae99419 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:56.344479 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88b456-63e1-412b-a578-410aeae99419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:56.344757 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88b456-63e1-412b-a578-410aeae99419 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:56.345503 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88b456-63e1-412b-a578-410aeae99419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:57:56.346517 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING py.warnings [None req-9d88b456-63e1-412b-a578-410aeae99419 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:57:56.346517 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: warnings.warn(msg) Dec 15 15:57:56.346517 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: Dec 15 15:57:56.347733 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88b456-63e1-412b-a578-410aeae99419 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:57:56.372133 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 28/60] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Dec 15 15:57:56 2021] POST /identity/v3/users => generated 275 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:57:59.985088 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edfbff-d9ca-40c0-882d-7b8bcee21824 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:59.986247 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edfbff-d9ca-40c0-882d-7b8bcee21824 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:59.986750 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edfbff-d9ca-40c0-882d-7b8bcee21824 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:57:59.988978 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 33/61] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:57:59 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:57:59.995908 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fba8b-c6b1-4f63-9d79-8fd1d5402fab None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:57:59.996776 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fba8b-c6b1-4f63-9d79-8fd1d5402fab None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:57:59.997269 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fba8b-c6b1-4f63-9d79-8fd1d5402fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.022386 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-187fba8b-c6b1-4f63-9d79-8fd1d5402fab None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:00.024359 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-187fba8b-c6b1-4f63-9d79-8fd1d5402fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:00.042061 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 29/62] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:57:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:58:00.099092 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edfbff-d9ca-40c0-882d-7b8bcee21824 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.116747 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edfbff-d9ca-40c0-882d-7b8bcee21824 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.127423 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996eeb9-a66e-4b79-91a5-2e96a6d42af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.128508 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996eeb9-a66e-4b79-91a5-2e96a6d42af3 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.129021 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996eeb9-a66e-4b79-91a5-2e96a6d42af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.129540 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996eeb9-a66e-4b79-91a5-2e96a6d42af3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.149566 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4b7fd-bdaa-4f00-a9ac-70f98eebfd45 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.150221 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4b7fd-bdaa-4f00-a9ac-70f98eebfd45 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.150718 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4b7fd-bdaa-4f00-a9ac-70f98eebfd45 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.152879 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 30/63] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:58:00.154247 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996eeb9-a66e-4b79-91a5-2e96a6d42af3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:00.158958 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59d1be-8df9-49bc-a603-c1f0e0fe014a None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.159541 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59d1be-8df9-49bc-a603-c1f0e0fe014a None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.160033 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59d1be-8df9-49bc-a603-c1f0e0fe014a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.166896 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-0996eeb9-a66e-4b79-91a5-2e96a6d42af3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 15:58:00.168503 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 34/64] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:00.174936 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996eeb9-a66e-4b79-91a5-2e96a6d42af3 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.186636 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996eeb9-a66e-4b79-91a5-2e96a6d42af3 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.191355 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-eb59d1be-8df9-49bc-a603-c1f0e0fe014a None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:00.193264 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-eb59d1be-8df9-49bc-a603-c1f0e0fe014a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:00.198592 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63c6a2-87a2-4fea-a102-534486887b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.199507 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63c6a2-87a2-4fea-a102-534486887b4d admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.199981 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63c6a2-87a2-4fea-a102-534486887b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.200444 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63c6a2-87a2-4fea-a102-534486887b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.201433 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63c6a2-87a2-4fea-a102-534486887b4d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:00.201935 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63c6a2-87a2-4fea-a102-534486887b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:00.203753 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63c6a2-87a2-4fea-a102-534486887b4d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:00.217972 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 31/65] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:00.220390 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 35/66] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:00 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:00.227270 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59d1be-8df9-49bc-a603-c1f0e0fe014a None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.238408 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59d1be-8df9-49bc-a603-c1f0e0fe014a None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.242857 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63c6a2-87a2-4fea-a102-534486887b4d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.253737 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63c6a2-87a2-4fea-a102-534486887b4d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.256007 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fd027-2266-42a4-8256-5bfd76a4a223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.257230 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fd027-2266-42a4-8256-5bfd76a4a223 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.258059 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fd027-2266-42a4-8256-5bfd76a4a223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.258909 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fd027-2266-42a4-8256-5bfd76a4a223 admin admin] PATH_INFO: `/v3/users/439edf79c9164d63962b865118f619fb` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.264932 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114733e9-1768-40ff-8bc6-57f6d34cb888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.265954 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114733e9-1768-40ff-8bc6-57f6d34cb888 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.270683 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114733e9-1768-40ff-8bc6-57f6d34cb888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.271165 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114733e9-1768-40ff-8bc6-57f6d34cb888 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.287400 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fd027-2266-42a4-8256-5bfd76a4a223 admin admin] RBAC: Authorizing `identity:get_user(user_id=439edf79c9164d63962b865118f619fb)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:00.290220 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114733e9-1768-40ff-8bc6-57f6d34cb888 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:00.290927 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fd027-2266-42a4-8256-5bfd76a4a223 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:00.292993 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 32/67] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:00 2021] GET /identity/v3/users/439edf79c9164d63962b865118f619fb => generated 275 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:00.294363 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffac66-ec06-4b77-9eb4-65e26dc41063 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.294651 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffac66-ec06-4b77-9eb4-65e26dc41063 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.294929 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffac66-ec06-4b77-9eb4-65e26dc41063 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.296774 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 33/68] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:00.299113 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-114733e9-1768-40ff-8bc6-57f6d34cb888 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 15:58:00.300534 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 36/69] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:58:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:00.301728 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffac66-ec06-4b77-9eb4-65e26dc41063 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.303701 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820feadf-03e8-4662-a931-759e793069cb None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.304649 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820feadf-03e8-4662-a931-759e793069cb None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.304946 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820feadf-03e8-4662-a931-759e793069cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.315864 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffac66-ec06-4b77-9eb4-65e26dc41063 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.320222 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485014f-f76f-40e2-b096-c6f4a85b5234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.320855 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485014f-f76f-40e2-b096-c6f4a85b5234 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.321139 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485014f-f76f-40e2-b096-c6f4a85b5234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.321631 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485014f-f76f-40e2-b096-c6f4a85b5234 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.324840 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-820feadf-03e8-4662-a931-759e793069cb None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:00.326051 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-820feadf-03e8-4662-a931-759e793069cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:00.329762 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485014f-f76f-40e2-b096-c6f4a85b5234 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:00.331741 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485014f-f76f-40e2-b096-c6f4a85b5234 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:00.333766 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 37/70] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:58:00.337172 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f4a5d-53c0-4fa8-a6f5-798f00f61110 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.337709 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f4a5d-53c0-4fa8-a6f5-798f00f61110 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.338442 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f4a5d-53c0-4fa8-a6f5-798f00f61110 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.340332 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 38/71] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:00 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:00.341250 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f4a5d-53c0-4fa8-a6f5-798f00f61110 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.345523 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 34/72] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:00 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:00.346927 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cc298-90e0-44d2-a258-339c903d8219 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.347361 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cc298-90e0-44d2-a258-339c903d8219 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.347774 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cc298-90e0-44d2-a258-339c903d8219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.358972 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f4a5d-53c0-4fa8-a6f5-798f00f61110 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.363642 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a2c99-881c-4a95-a9d0-a40903c5587e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.364290 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a2c99-881c-4a95-a9d0-a40903c5587e admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.364577 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a2c99-881c-4a95-a9d0-a40903c5587e admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.364856 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a2c99-881c-4a95-a9d0-a40903c5587e admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.365645 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a2c99-881c-4a95-a9d0-a40903c5587e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:00.365960 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a2c99-881c-4a95-a9d0-a40903c5587e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:00.368231 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-bc7cc298-90e0-44d2-a258-339c903d8219 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:00.368362 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a2c99-881c-4a95-a9d0-a40903c5587e admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:00.369413 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-bc7cc298-90e0-44d2-a258-339c903d8219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:00.377059 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 35/74] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:00.377219 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 39/74] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:00.377999 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a2c99-881c-4a95-a9d0-a40903c5587e admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.378455 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cc298-90e0-44d2-a258-339c903d8219 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.387838 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cc298-90e0-44d2-a258-339c903d8219 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.392689 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f30f3-bff1-402d-bcd4-4b393926e88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.393742 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f30f3-bff1-402d-bcd4-4b393926e88e admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.394239 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f30f3-bff1-402d-bcd4-4b393926e88e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.394725 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f30f3-bff1-402d-bcd4-4b393926e88e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.399655 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a2c99-881c-4a95-a9d0-a40903c5587e admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.404156 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a48c9c-5d3b-43df-a504-0e0045353fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.404991 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a48c9c-5d3b-43df-a504-0e0045353fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.405272 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a48c9c-5d3b-43df-a504-0e0045353fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.405600 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a48c9c-5d3b-43df-a504-0e0045353fd9 admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.406797 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a48c9c-5d3b-43df-a504-0e0045353fd9 admin admin] RBAC: Authorizing `identity:get_project(project_id=f6644073b15349a5b18a70868298c841)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:00.407230 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f30f3-bff1-402d-bcd4-4b393926e88e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:00.408862 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a48c9c-5d3b-43df-a504-0e0045353fd9 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:00.411069 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 40/75] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:00 2021] GET /identity/v3/projects/f6644073b15349a5b18a70868298c841 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:00.412220 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a48c9c-5d3b-43df-a504-0e0045353fd9 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.415205 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-3f6f30f3-bff1-402d-bcd4-4b393926e88e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 15:58:00.416610 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 36/76] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:00.417790 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f30f3-bff1-402d-bcd4-4b393926e88e admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.424383 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a48c9c-5d3b-43df-a504-0e0045353fd9 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.429525 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475569a-662f-47d5-a35b-b10c9a65e139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.430399 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475569a-662f-47d5-a35b-b10c9a65e139 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.430687 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475569a-662f-47d5-a35b-b10c9a65e139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.430966 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475569a-662f-47d5-a35b-b10c9a65e139 admin admin] PATH_INFO: `/v3/users/33aa1fa71819442bb0ab5bc31d11564d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.432158 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f30f3-bff1-402d-bcd4-4b393926e88e admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.432279 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475569a-662f-47d5-a35b-b10c9a65e139 admin admin] RBAC: Authorizing `identity:get_user(user_id=33aa1fa71819442bb0ab5bc31d11564d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:00.434012 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475569a-662f-47d5-a35b-b10c9a65e139 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:00.435876 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 41/77] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:00 2021] GET /identity/v3/users/33aa1fa71819442bb0ab5bc31d11564d => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:00.436696 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475569a-662f-47d5-a35b-b10c9a65e139 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.441416 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0daa6-0607-4589-a428-8a3a24c680d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.442371 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0daa6-0607-4589-a428-8a3a24c680d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.442658 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0daa6-0607-4589-a428-8a3a24c680d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.442939 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0daa6-0607-4589-a428-8a3a24c680d1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.446302 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475569a-662f-47d5-a35b-b10c9a65e139 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.450709 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80d4fa-13df-430d-a231-191e5eabf5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.451320 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80d4fa-13df-430d-a231-191e5eabf5ce admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.451605 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80d4fa-13df-430d-a231-191e5eabf5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.451882 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80d4fa-13df-430d-a231-191e5eabf5ce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.452708 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80d4fa-13df-430d-a231-191e5eabf5ce admin admin] RBAC: Adding query filter params (role.id=530f09f883ac47cba230257bcf458141, scope.project.id=f6644073b15349a5b18a70868298c841, user.id=439edf79c9164d63962b865118f619fb) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:00.453017 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80d4fa-13df-430d-a231-191e5eabf5ce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:00.453107 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0daa6-0607-4589-a428-8a3a24c680d1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:00.454032 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING py.warnings [None req-7f80d4fa-13df-430d-a231-191e5eabf5ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:58:00.454032 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: warnings.warn(msg) Dec 15 15:58:00.454032 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: Dec 15 15:58:00.455179 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80d4fa-13df-430d-a231-191e5eabf5ce admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:00.460797 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-26b0daa6-0607-4589-a428-8a3a24c680d1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 15:58:00.467071 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 37/78] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Dec 15 15:58:00 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:00.467071 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0daa6-0607-4589-a428-8a3a24c680d1 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.469583 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 42/79] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:00 2021] GET /identity/v3/role_assignments?user.id=439edf79c9164d63962b865118f619fb&scope.project.id=f6644073b15349a5b18a70868298c841&role.id=530f09f883ac47cba230257bcf458141 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:00.470821 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80d4fa-13df-430d-a231-191e5eabf5ce admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.478736 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0daa6-0607-4589-a428-8a3a24c680d1 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.483802 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4a57e-e851-4ce6-9343-3c2966ac739c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.484109 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80d4fa-13df-430d-a231-191e5eabf5ce admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.484933 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4a57e-e851-4ce6-9343-3c2966ac739c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.485445 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4a57e-e851-4ce6-9343-3c2966ac739c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.486061 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4a57e-e851-4ce6-9343-3c2966ac739c admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.487045 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4a57e-e851-4ce6-9343-3c2966ac739c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:00.487606 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4a57e-e851-4ce6-9343-3c2966ac739c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:00.489336 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e78a6-3190-4bfb-a409-22518ca7aadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.489871 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4a57e-e851-4ce6-9343-3c2966ac739c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:00.489981 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e78a6-3190-4bfb-a409-22518ca7aadd admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.490236 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e78a6-3190-4bfb-a409-22518ca7aadd admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.490513 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e78a6-3190-4bfb-a409-22518ca7aadd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.501306 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 38/80] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:00 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:00.502618 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4a57e-e851-4ce6-9343-3c2966ac739c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.505728 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e78a6-3190-4bfb-a409-22518ca7aadd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:00.508259 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e78a6-3190-4bfb-a409-22518ca7aadd admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:00.518492 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 43/81] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:00 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:00.519350 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e78a6-3190-4bfb-a409-22518ca7aadd admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.520709 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4a57e-e851-4ce6-9343-3c2966ac739c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.527986 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f960647-bf1e-459f-97b5-9c48359e6de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.529061 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f960647-bf1e-459f-97b5-9c48359e6de2 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.529609 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f960647-bf1e-459f-97b5-9c48359e6de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.529715 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e78a6-3190-4bfb-a409-22518ca7aadd admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.530718 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f960647-bf1e-459f-97b5-9c48359e6de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.531977 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f960647-bf1e-459f-97b5-9c48359e6de2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:00.532556 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f960647-bf1e-459f-97b5-9c48359e6de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:00.534832 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc03f5d-1558-470c-8968-263bdd7f5a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.535082 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f960647-bf1e-459f-97b5-9c48359e6de2 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:00.535936 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc03f5d-1558-470c-8968-263bdd7f5a1e admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.536318 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc03f5d-1558-470c-8968-263bdd7f5a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.536738 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc03f5d-1558-470c-8968-263bdd7f5a1e admin admin] PATH_INFO: `/v3/users/439edf79c9164d63962b865118f619fb` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.539079 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc03f5d-1558-470c-8968-263bdd7f5a1e admin admin] RBAC: Authorizing `identity:get_user(user_id=439edf79c9164d63962b865118f619fb)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:00.541412 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc03f5d-1558-470c-8968-263bdd7f5a1e admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:00.543254 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 44/82] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:00 2021] GET /identity/v3/users/439edf79c9164d63962b865118f619fb => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:00.544251 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc03f5d-1558-470c-8968-263bdd7f5a1e admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.551737 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 39/83] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:00 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:00.552875 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f960647-bf1e-459f-97b5-9c48359e6de2 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.565635 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc03f5d-1558-470c-8968-263bdd7f5a1e admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.567322 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f960647-bf1e-459f-97b5-9c48359e6de2 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.571899 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd402414-a8ed-4695-b53f-281a2bf0e6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.572434 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f04c4-59e7-44d5-8486-cf9a465e90be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.573177 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f04c4-59e7-44d5-8486-cf9a465e90be admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.573716 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f04c4-59e7-44d5-8486-cf9a465e90be admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.574204 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f04c4-59e7-44d5-8486-cf9a465e90be admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.574513 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd402414-a8ed-4695-b53f-281a2bf0e6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.574787 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd402414-a8ed-4695-b53f-281a2bf0e6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.575066 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd402414-a8ed-4695-b53f-281a2bf0e6a7 admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.576490 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd402414-a8ed-4695-b53f-281a2bf0e6a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=f6644073b15349a5b18a70868298c841)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:00.578646 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd402414-a8ed-4695-b53f-281a2bf0e6a7 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:00.580913 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 45/84] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:00 2021] GET /identity/v3/projects/f6644073b15349a5b18a70868298c841 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:00.581840 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd402414-a8ed-4695-b53f-281a2bf0e6a7 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.584958 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f04c4-59e7-44d5-8486-cf9a465e90be admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:00.587898 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f04c4-59e7-44d5-8486-cf9a465e90be admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:00.595010 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd402414-a8ed-4695-b53f-281a2bf0e6a7 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.598413 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 40/85] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:00 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:00.599522 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f04c4-59e7-44d5-8486-cf9a465e90be admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.607217 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cfdf4-b695-4278-a26f-4bd957dc1ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.608120 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cfdf4-b695-4278-a26f-4bd957dc1ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.608412 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cfdf4-b695-4278-a26f-4bd957dc1ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.608695 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cfdf4-b695-4278-a26f-4bd957dc1ad8 admin admin] PATH_INFO: `/v3/users/439edf79c9164d63962b865118f619fb` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.610356 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254cfdf4-b695-4278-a26f-4bd957dc1ad8 admin admin] RBAC: Authorizing `identity:get_user(user_id=439edf79c9164d63962b865118f619fb)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:00.613627 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254cfdf4-b695-4278-a26f-4bd957dc1ad8 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:00.615314 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f04c4-59e7-44d5-8486-cf9a465e90be admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.615440 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 46/86] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:00 2021] GET /identity/v3/users/439edf79c9164d63962b865118f619fb => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:00.617014 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cfdf4-b695-4278-a26f-4bd957dc1ad8 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.620816 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af70a09-e03c-4309-9f82-1a67db334165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.621500 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af70a09-e03c-4309-9f82-1a67db334165 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.621786 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af70a09-e03c-4309-9f82-1a67db334165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.622060 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af70a09-e03c-4309-9f82-1a67db334165 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.623010 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af70a09-e03c-4309-9f82-1a67db334165 admin admin] RBAC: Adding query filter params (role.id=bc362f875c6d4cee83ba65b8d134462d, scope.project.id=f6644073b15349a5b18a70868298c841, user.id=33aa1fa71819442bb0ab5bc31d11564d) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:00.623328 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af70a09-e03c-4309-9f82-1a67db334165 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:00.625238 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af70a09-e03c-4309-9f82-1a67db334165 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:00.627865 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cfdf4-b695-4278-a26f-4bd957dc1ad8 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.631524 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 41/87] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:00 2021] GET /identity/v3/role_assignments?user.id=33aa1fa71819442bb0ab5bc31d11564d&scope.project.id=f6644073b15349a5b18a70868298c841&role.id=bc362f875c6d4cee83ba65b8d134462d => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:00.636136 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ff1a1-0e03-47fd-9caf-717c4dbd2c21 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.636136 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ff1a1-0e03-47fd-9caf-717c4dbd2c21 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.636421 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e21981-6d68-4283-9e14-167474f272a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.636524 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ff1a1-0e03-47fd-9caf-717c4dbd2c21 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.636605 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e21981-6d68-4283-9e14-167474f272a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.636605 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e21981-6d68-4283-9e14-167474f272a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.636605 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e21981-6d68-4283-9e14-167474f272a2 admin admin] PATH_INFO: `/v3/projects/b237a0f886034cc8859e87cf27895c70` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.636821 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 42/88] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:00.637001 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ff1a1-0e03-47fd-9caf-717c4dbd2c21 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.638048 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e21981-6d68-4283-9e14-167474f272a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=b237a0f886034cc8859e87cf27895c70)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:00.640518 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e21981-6d68-4283-9e14-167474f272a2 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:00.642856 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 47/89] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:00 2021] GET /identity/v3/projects/b237a0f886034cc8859e87cf27895c70 => generated 312 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:00.644512 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1837618-ca55-4fbc-ac89-b830f088a157 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.644809 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1837618-ca55-4fbc-ac89-b830f088a157 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.645083 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1837618-ca55-4fbc-ac89-b830f088a157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.661270 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ff1a1-0e03-47fd-9caf-717c4dbd2c21 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.667524 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d55ae0-6297-468e-87de-609854b66f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.668925 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d55ae0-6297-468e-87de-609854b66f60 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.669498 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d55ae0-6297-468e-87de-609854b66f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.669994 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d55ae0-6297-468e-87de-609854b66f60 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.673081 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-f1837618-ca55-4fbc-ac89-b830f088a157 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:00.674497 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f1837618-ca55-4fbc-ac89-b830f088a157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:00.681841 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d55ae0-6297-468e-87de-609854b66f60 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:00.684404 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d55ae0-6297-468e-87de-609854b66f60 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:00.690937 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 48/90] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:00.690937 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1837618-ca55-4fbc-ac89-b830f088a157 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.698096 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1837618-ca55-4fbc-ac89-b830f088a157 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.707792 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 43/91] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:00 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:00.709118 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a8dae-ec99-40db-88a4-32598e7b40d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.709118 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a8dae-ec99-40db-88a4-32598e7b40d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.709323 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a8dae-ec99-40db-88a4-32598e7b40d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.709567 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a8dae-ec99-40db-88a4-32598e7b40d1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.710507 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a8dae-ec99-40db-88a4-32598e7b40d1 admin admin] RBAC: Adding query filter params (role.id=530f09f883ac47cba230257bcf458141, scope.project.id=b237a0f886034cc8859e87cf27895c70, user.id=439edf79c9164d63962b865118f619fb) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:00.711040 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a8dae-ec99-40db-88a4-32598e7b40d1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:00.713448 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a8dae-ec99-40db-88a4-32598e7b40d1 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:00.715769 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d55ae0-6297-468e-87de-609854b66f60 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.723166 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 49/92] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:00 2021] GET /identity/v3/role_assignments?user.id=439edf79c9164d63962b865118f619fb&scope.project.id=b237a0f886034cc8859e87cf27895c70&role.id=530f09f883ac47cba230257bcf458141 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:00.728285 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d55ae0-6297-468e-87de-609854b66f60 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.733364 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb105f04-ee14-4428-ad1c-1f4247f1f826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.734404 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb105f04-ee14-4428-ad1c-1f4247f1f826 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.735473 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a8dae-ec99-40db-88a4-32598e7b40d1 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.737962 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb105f04-ee14-4428-ad1c-1f4247f1f826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.738582 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb105f04-ee14-4428-ad1c-1f4247f1f826 admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.740393 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb105f04-ee14-4428-ad1c-1f4247f1f826 admin admin] RBAC: Authorizing `identity:get_project(project_id=f6644073b15349a5b18a70868298c841)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:00.744851 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb105f04-ee14-4428-ad1c-1f4247f1f826 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:00.752884 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a8dae-ec99-40db-88a4-32598e7b40d1 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.753125 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 44/93] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:00 2021] GET /identity/v3/projects/f6644073b15349a5b18a70868298c841 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:00.755057 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb105f04-ee14-4428-ad1c-1f4247f1f826 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.771659 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb105f04-ee14-4428-ad1c-1f4247f1f826 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.774516 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c07a4-decc-4c68-b738-611e35abbf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.775332 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c07a4-decc-4c68-b738-611e35abbf62 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.775620 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c07a4-decc-4c68-b738-611e35abbf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.775896 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c07a4-decc-4c68-b738-611e35abbf62 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.777425 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c07a4-decc-4c68-b738-611e35abbf62 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:00.778844 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472dd60f-dcce-420e-b928-5779daa63d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.779199 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c07a4-decc-4c68-b738-611e35abbf62 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:00.780085 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472dd60f-dcce-420e-b928-5779daa63d5b admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.780574 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472dd60f-dcce-420e-b928-5779daa63d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.785510 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 50/94] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:00 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:00.786362 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472dd60f-dcce-420e-b928-5779daa63d5b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.787925 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472dd60f-dcce-420e-b928-5779daa63d5b admin admin] RBAC: Adding query filter params (role.id=d042901298ef4d56b504a30c45128dca, scope.project.id=f6644073b15349a5b18a70868298c841, user.id=439edf79c9164d63962b865118f619fb) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:00.789463 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472dd60f-dcce-420e-b928-5779daa63d5b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:00.791787 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472dd60f-dcce-420e-b928-5779daa63d5b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:00.799883 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 45/95] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:00 2021] GET /identity/v3/role_assignments?user.id=439edf79c9164d63962b865118f619fb&scope.project.id=f6644073b15349a5b18a70868298c841&role.id=d042901298ef4d56b504a30c45128dca => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:00.801726 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c07a4-decc-4c68-b738-611e35abbf62 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:00.813726 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c07a4-decc-4c68-b738-611e35abbf62 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:00.819223 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f297bd-142c-4268-b732-d876b2b6ba1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:00.820357 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f297bd-142c-4268-b732-d876b2b6ba1f admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:00.821044 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f297bd-142c-4268-b732-d876b2b6ba1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:00.821635 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f297bd-142c-4268-b732-d876b2b6ba1f admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:00.822743 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f297bd-142c-4268-b732-d876b2b6ba1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:00.824144 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING py.warnings [None req-52f297bd-142c-4268-b732-d876b2b6ba1f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:58:00.824144 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: warnings.warn(msg) Dec 15 15:58:00.824144 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: Dec 15 15:58:00.825953 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f297bd-142c-4268-b732-d876b2b6ba1f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:00.858417 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 51/96] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Dec 15 15:58:00 2021] POST /identity/v3/users => generated 289 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 15:58:03.463294 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d520f-e9f6-495b-87ed-4a71946db4d8 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:03.464391 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d520f-e9f6-495b-87ed-4a71946db4d8 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:03.464912 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d520f-e9f6-495b-87ed-4a71946db4d8 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:03.467467 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 46/97] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:03.491912 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d7173-b909-47df-89f9-25e2e085b93a None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:03.492863 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d7173-b909-47df-89f9-25e2e085b93a None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:03.493346 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d7173-b909-47df-89f9-25e2e085b93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:03.518513 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-882d7173-b909-47df-89f9-25e2e085b93a None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:03.520170 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-882d7173-b909-47df-89f9-25e2e085b93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:03.535205 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 52/98] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:03.571209 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e61e7-4cf4-4795-a5ca-031fe8ad3e67 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:03.571835 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e61e7-4cf4-4795-a5ca-031fe8ad3e67 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:03.572312 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e61e7-4cf4-4795-a5ca-031fe8ad3e67 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:03.574621 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 47/99] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:03.582110 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265fb37-0e66-4eee-a2f2-f2766bafe65e None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:03.582692 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265fb37-0e66-4eee-a2f2-f2766bafe65e None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:03.583175 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265fb37-0e66-4eee-a2f2-f2766bafe65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:03.590038 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e61e7-4cf4-4795-a5ca-031fe8ad3e67 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:03.608373 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e61e7-4cf4-4795-a5ca-031fe8ad3e67 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:03.622723 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dcfa02-5fdc-455b-a783-d20a342495e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:03.623903 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcfa02-5fdc-455b-a783-d20a342495e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:03.624431 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcfa02-5fdc-455b-a783-d20a342495e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:03.624914 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcfa02-5fdc-455b-a783-d20a342495e0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:03.635188 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-7265fb37-0e66-4eee-a2f2-f2766bafe65e None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:03.636760 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-7265fb37-0e66-4eee-a2f2-f2766bafe65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:03.646860 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dcfa02-5fdc-455b-a783-d20a342495e0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:03.657947 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 53/100] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:03.660321 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-c3dcfa02-5fdc-455b-a783-d20a342495e0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 15:58:03.661800 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 48/101] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:03.669178 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265fb37-0e66-4eee-a2f2-f2766bafe65e None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:03.679451 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265fb37-0e66-4eee-a2f2-f2766bafe65e None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:03.688417 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564ae42-e388-4a48-9f1e-8d8076eacc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:03.689415 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564ae42-e388-4a48-9f1e-8d8076eacc69 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:03.689926 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564ae42-e388-4a48-9f1e-8d8076eacc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:03.690411 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564ae42-e388-4a48-9f1e-8d8076eacc69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:03.691441 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564ae42-e388-4a48-9f1e-8d8076eacc69 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:03.691963 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564ae42-e388-4a48-9f1e-8d8076eacc69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:03.693829 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564ae42-e388-4a48-9f1e-8d8076eacc69 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:03.695307 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dcfa02-5fdc-455b-a783-d20a342495e0 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:03.705774 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dcfa02-5fdc-455b-a783-d20a342495e0 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:03.719250 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 54/102] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:03.725578 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1dfb5-c833-432e-a507-b4f1859a8327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:03.727383 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1dfb5-c833-432e-a507-b4f1859a8327 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:03.727884 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1dfb5-c833-432e-a507-b4f1859a8327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:03.728365 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1dfb5-c833-432e-a507-b4f1859a8327 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:03.739708 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1dfb5-c833-432e-a507-b4f1859a8327 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:03.742868 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564ae42-e388-4a48-9f1e-8d8076eacc69 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:03.753128 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564ae42-e388-4a48-9f1e-8d8076eacc69 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:03.759337 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-07d1dfb5-c833-432e-a507-b4f1859a8327 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 15:58:03.763061 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 49/103] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:03.770378 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb29d20-8548-4d62-bd16-d8c0074b4183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:03.771513 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb29d20-8548-4d62-bd16-d8c0074b4183 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:03.772022 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb29d20-8548-4d62-bd16-d8c0074b4183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:03.772500 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb29d20-8548-4d62-bd16-d8c0074b4183 admin admin] PATH_INFO: `/v3/users/439edf79c9164d63962b865118f619fb` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:03.774548 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1dfb5-c833-432e-a507-b4f1859a8327 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:03.775409 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb29d20-8548-4d62-bd16-d8c0074b4183 admin admin] RBAC: Authorizing `identity:get_user(user_id=439edf79c9164d63962b865118f619fb)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:03.778185 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb29d20-8548-4d62-bd16-d8c0074b4183 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:03.789410 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 55/104] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:03 2021] GET /identity/v3/users/439edf79c9164d63962b865118f619fb => generated 275 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:03.795420 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1dfb5-c833-432e-a507-b4f1859a8327 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:03.803518 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb29d20-8548-4d62-bd16-d8c0074b4183 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:03.819264 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb29d20-8548-4d62-bd16-d8c0074b4183 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:03.826151 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449d09c-1422-4f2f-9158-bef26bc611a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:03.826847 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449d09c-1422-4f2f-9158-bef26bc611a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:03.827138 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449d09c-1422-4f2f-9158-bef26bc611a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:03.827420 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449d09c-1422-4f2f-9158-bef26bc611a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:03.828196 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449d09c-1422-4f2f-9158-bef26bc611a8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:03.828514 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449d09c-1422-4f2f-9158-bef26bc611a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:03.830196 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449d09c-1422-4f2f-9158-bef26bc611a8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:03.830933 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e748c7-2458-4a39-b9fc-32843ada7d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:03.831786 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e748c7-2458-4a39-b9fc-32843ada7d0a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:03.832073 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e748c7-2458-4a39-b9fc-32843ada7d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:03.832351 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e748c7-2458-4a39-b9fc-32843ada7d0a admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:03.833573 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e748c7-2458-4a39-b9fc-32843ada7d0a admin admin] RBAC: Authorizing `identity:get_project(project_id=f6644073b15349a5b18a70868298c841)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:03.835794 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e748c7-2458-4a39-b9fc-32843ada7d0a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:03.837493 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 56/105] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:03 2021] GET /identity/v3/projects/f6644073b15349a5b18a70868298c841 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:03.844376 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e748c7-2458-4a39-b9fc-32843ada7d0a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:03.846276 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 50/106] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:03.853062 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449d09c-1422-4f2f-9158-bef26bc611a8 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:03.858466 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e748c7-2458-4a39-b9fc-32843ada7d0a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:03.867550 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb291d2-1952-41c1-8981-c706fd3d1415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:03.868502 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb291d2-1952-41c1-8981-c706fd3d1415 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:03.868925 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb291d2-1952-41c1-8981-c706fd3d1415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:03.869164 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb291d2-1952-41c1-8981-c706fd3d1415 admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841/users/439edf79c9164d63962b865118f619fb/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:03.871185 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb291d2-1952-41c1-8981-c706fd3d1415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6644073b15349a5b18a70868298c841, user_id=439edf79c9164d63962b865118f619fb, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:03.871769 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449d09c-1422-4f2f-9158-bef26bc611a8 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:03.872208 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING py.warnings [None req-1fb291d2-1952-41c1-8981-c706fd3d1415 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:58:03.872208 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: warnings.warn(msg) Dec 15 15:58:03.872208 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: Dec 15 15:58:03.874509 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb291d2-1952-41c1-8981-c706fd3d1415 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:03.899075 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ae03c-626f-44c1-a1cc-6fee20e0c94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:03.900036 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ae03c-626f-44c1-a1cc-6fee20e0c94d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:03.900327 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ae03c-626f-44c1-a1cc-6fee20e0c94d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:03.900613 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ae03c-626f-44c1-a1cc-6fee20e0c94d admin admin] PATH_INFO: `/v3/users/439edf79c9164d63962b865118f619fb` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:03.906157 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ae03c-626f-44c1-a1cc-6fee20e0c94d admin admin] RBAC: Authorizing `identity:get_user(user_id=439edf79c9164d63962b865118f619fb)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:03.908373 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ae03c-626f-44c1-a1cc-6fee20e0c94d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:03.910298 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 51/107] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:03 2021] GET /identity/v3/users/439edf79c9164d63962b865118f619fb => generated 275 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:03.912688 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 57/108] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Dec 15 15:58:03 2021] PUT /identity/v3/projects/f6644073b15349a5b18a70868298c841/users/439edf79c9164d63962b865118f619fb/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 15:58:03.916972 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ae03c-626f-44c1-a1cc-6fee20e0c94d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:03.935265 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ae03c-626f-44c1-a1cc-6fee20e0c94d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:04.014251 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58571e-62c2-4a75-a540-7a362c530fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:04.015026 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58571e-62c2-4a75-a540-7a362c530fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:04.015310 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58571e-62c2-4a75-a540-7a362c530fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:04.015582 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58571e-62c2-4a75-a540-7a362c530fb8 admin admin] PATH_INFO: `/v3/projects/b237a0f886034cc8859e87cf27895c70` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:04.016845 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58571e-62c2-4a75-a540-7a362c530fb8 admin admin] RBAC: Authorizing `identity:get_project(project_id=b237a0f886034cc8859e87cf27895c70)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:04.018993 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58571e-62c2-4a75-a540-7a362c530fb8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:04.020888 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 52/109] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:03 2021] GET /identity/v3/projects/b237a0f886034cc8859e87cf27895c70 => generated 312 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:04.027998 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb291d2-1952-41c1-8981-c706fd3d1415 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:04.046585 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb291d2-1952-41c1-8981-c706fd3d1415 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:04.052619 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7700b1-4ef5-45b7-a725-e77d53ec4416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:04.052619 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7700b1-4ef5-45b7-a725-e77d53ec4416 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:04.052619 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7700b1-4ef5-45b7-a725-e77d53ec4416 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:04.052619 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7700b1-4ef5-45b7-a725-e77d53ec4416 admin admin] PATH_INFO: `/v3/projects/b237a0f886034cc8859e87cf27895c70/users/439edf79c9164d63962b865118f619fb/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:04.058099 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7700b1-4ef5-45b7-a725-e77d53ec4416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b237a0f886034cc8859e87cf27895c70, user_id=439edf79c9164d63962b865118f619fb, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:04.060848 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7700b1-4ef5-45b7-a725-e77d53ec4416 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:04.077950 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 58/110] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Dec 15 15:58:04 2021] PUT /identity/v3/projects/b237a0f886034cc8859e87cf27895c70/users/439edf79c9164d63962b865118f619fb/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 15:58:04.157046 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b04e7a-8429-4d64-8728-edc6fa65ea78 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:04.157425 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b04e7a-8429-4d64-8728-edc6fa65ea78 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:04.157649 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b04e7a-8429-4d64-8728-edc6fa65ea78 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:04.159678 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 53/111] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:04.161272 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f03c9d-3b85-4fd5-b72d-efd106a065ad None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:04.161589 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f03c9d-3b85-4fd5-b72d-efd106a065ad None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:04.161866 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f03c9d-3b85-4fd5-b72d-efd106a065ad None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:04.164449 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 59/112] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:04.170799 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48317dca-7e0f-4458-b79d-bf3e52c97053 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:04.171093 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48317dca-7e0f-4458-b79d-bf3e52c97053 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:04.171353 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48317dca-7e0f-4458-b79d-bf3e52c97053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:04.177362 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a953e-b2f7-4db6-8d2c-0c57975d786f None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:04.177694 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a953e-b2f7-4db6-8d2c-0c57975d786f None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:04.177945 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a953e-b2f7-4db6-8d2c-0c57975d786f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:04.194996 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-48317dca-7e0f-4458-b79d-bf3e52c97053 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:04.196625 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-48317dca-7e0f-4458-b79d-bf3e52c97053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:04.204951 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-518a953e-b2f7-4db6-8d2c-0c57975d786f None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:04.206224 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-518a953e-b2f7-4db6-8d2c-0c57975d786f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:04.308249 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 60/113] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:04.333906 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 54/114] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:58:04.345450 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a953e-b2f7-4db6-8d2c-0c57975d786f None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:04.357664 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a953e-b2f7-4db6-8d2c-0c57975d786f None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:04.366936 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48317dca-7e0f-4458-b79d-bf3e52c97053 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:04.370055 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197bfa2-2f14-4548-af72-048e1f2bf77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:04.370938 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197bfa2-2f14-4548-af72-048e1f2bf77c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:04.371221 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197bfa2-2f14-4548-af72-048e1f2bf77c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:04.371495 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197bfa2-2f14-4548-af72-048e1f2bf77c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:04.378124 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48317dca-7e0f-4458-b79d-bf3e52c97053 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:04.383798 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197bfa2-2f14-4548-af72-048e1f2bf77c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:04.388058 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3106c-5dc7-45bd-af06-b46215588db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:04.389098 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3106c-5dc7-45bd-af06-b46215588db4 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:04.389703 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3106c-5dc7-45bd-af06-b46215588db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:04.390177 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3106c-5dc7-45bd-af06-b46215588db4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:04.391812 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-c197bfa2-2f14-4548-af72-048e1f2bf77c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 15:58:04.393030 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 61/115] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Dec 15 15:58:04 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:04.399735 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197bfa2-2f14-4548-af72-048e1f2bf77c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:04.403718 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3106c-5dc7-45bd-af06-b46215588db4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:04.410075 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197bfa2-2f14-4548-af72-048e1f2bf77c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:04.411243 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-9de3106c-5dc7-45bd-af06-b46215588db4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 15:58:04.412923 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 55/116] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:58:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:04.420130 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3106c-5dc7-45bd-af06-b46215588db4 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:04.424224 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d63bdd-3cad-4bcd-8188-f107ae10ca7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:04.426027 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d63bdd-3cad-4bcd-8188-f107ae10ca7c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:04.426931 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d63bdd-3cad-4bcd-8188-f107ae10ca7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:04.427358 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d63bdd-3cad-4bcd-8188-f107ae10ca7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:04.430574 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d63bdd-3cad-4bcd-8188-f107ae10ca7c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:04.431087 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d63bdd-3cad-4bcd-8188-f107ae10ca7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:04.433843 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d63bdd-3cad-4bcd-8188-f107ae10ca7c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:04.443037 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3106c-5dc7-45bd-af06-b46215588db4 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:04.451419 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164a85b-a295-4e33-9633-084a754ec5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:04.453945 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 62/117] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:04 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:04.454894 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164a85b-a295-4e33-9633-084a754ec5cd admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:04.455448 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164a85b-a295-4e33-9633-084a754ec5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:04.455867 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164a85b-a295-4e33-9633-084a754ec5cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:04.456846 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164a85b-a295-4e33-9633-084a754ec5cd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:04.457298 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164a85b-a295-4e33-9633-084a754ec5cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:04.459152 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164a85b-a295-4e33-9633-084a754ec5cd admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:04.460409 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d63bdd-3cad-4bcd-8188-f107ae10ca7c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:04.475702 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d63bdd-3cad-4bcd-8188-f107ae10ca7c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:04.476990 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 56/118] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:04.482406 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164a85b-a295-4e33-9633-084a754ec5cd admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:04.484558 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d75288-d8c6-4efe-8614-93f93ec23412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:04.485779 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d75288-d8c6-4efe-8614-93f93ec23412 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:04.486281 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d75288-d8c6-4efe-8614-93f93ec23412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:04.486772 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d75288-d8c6-4efe-8614-93f93ec23412 admin admin] PATH_INFO: `/v3/users/439edf79c9164d63962b865118f619fb` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:04.488545 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d75288-d8c6-4efe-8614-93f93ec23412 admin admin] RBAC: Authorizing `identity:get_user(user_id=439edf79c9164d63962b865118f619fb)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:04.491047 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d75288-d8c6-4efe-8614-93f93ec23412 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:04.498999 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 63/119] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:04 2021] GET /identity/v3/users/439edf79c9164d63962b865118f619fb => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:04.500266 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d75288-d8c6-4efe-8614-93f93ec23412 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:04.502769 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164a85b-a295-4e33-9633-084a754ec5cd admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:04.507540 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645ce75-f6df-424f-9cc1-d9c4c104cc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:04.509235 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645ce75-f6df-424f-9cc1-d9c4c104cc7c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:04.509772 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645ce75-f6df-424f-9cc1-d9c4c104cc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:04.510244 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645ce75-f6df-424f-9cc1-d9c4c104cc7c admin admin] PATH_INFO: `/v3/users/33aa1fa71819442bb0ab5bc31d11564d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:04.511700 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645ce75-f6df-424f-9cc1-d9c4c104cc7c admin admin] RBAC: Authorizing `identity:get_user(user_id=33aa1fa71819442bb0ab5bc31d11564d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:04.513834 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645ce75-f6df-424f-9cc1-d9c4c104cc7c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:04.515738 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 57/120] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:04 2021] GET /identity/v3/users/33aa1fa71819442bb0ab5bc31d11564d => generated 247 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:04.520306 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d75288-d8c6-4efe-8614-93f93ec23412 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:04.522330 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645ce75-f6df-424f-9cc1-d9c4c104cc7c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:04.533789 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645ce75-f6df-424f-9cc1-d9c4c104cc7c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:04.538215 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41c114-3008-4a54-84a5-9e23a39c2cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:04.539634 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41c114-3008-4a54-84a5-9e23a39c2cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:04.539921 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41c114-3008-4a54-84a5-9e23a39c2cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:04.540227 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41c114-3008-4a54-84a5-9e23a39c2cb6 admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:04.540781 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5fe7f-56cc-4f93-9f24-cd065f898372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:04.541992 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5fe7f-56cc-4f93-9f24-cd065f898372 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:04.542490 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5fe7f-56cc-4f93-9f24-cd065f898372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:04.542971 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5fe7f-56cc-4f93-9f24-cd065f898372 admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:04.544529 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5fe7f-56cc-4f93-9f24-cd065f898372 admin admin] RBAC: Authorizing `identity:get_project(project_id=f6644073b15349a5b18a70868298c841)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:04.546301 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41c114-3008-4a54-84a5-9e23a39c2cb6 admin admin] RBAC: Authorizing `identity:get_project(project_id=f6644073b15349a5b18a70868298c841)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:04.547170 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5fe7f-56cc-4f93-9f24-cd065f898372 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:04.548406 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41c114-3008-4a54-84a5-9e23a39c2cb6 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:04.551299 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 64/121] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:04 2021] GET /identity/v3/projects/f6644073b15349a5b18a70868298c841 => generated 298 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:04.551783 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 58/122] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:04 2021] GET /identity/v3/projects/f6644073b15349a5b18a70868298c841 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:04.557303 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41c114-3008-4a54-84a5-9e23a39c2cb6 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:04.558688 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5fe7f-56cc-4f93-9f24-cd065f898372 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:04.577243 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5fe7f-56cc-4f93-9f24-cd065f898372 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:04.579688 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41c114-3008-4a54-84a5-9e23a39c2cb6 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:04.589240 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d3454-1e51-43a3-a115-0e3b5bf62729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:04.590108 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff87a29-ef8e-41f3-ba42-9a57da5981b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:04.591482 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff87a29-ef8e-41f3-ba42-9a57da5981b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:04.592450 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d3454-1e51-43a3-a115-0e3b5bf62729 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:04.592932 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff87a29-ef8e-41f3-ba42-9a57da5981b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:04.593761 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff87a29-ef8e-41f3-ba42-9a57da5981b0 admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841/users/33aa1fa71819442bb0ab5bc31d11564d/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:04.594003 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d3454-1e51-43a3-a115-0e3b5bf62729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:04.594501 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d3454-1e51-43a3-a115-0e3b5bf62729 admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841/users/439edf79c9164d63962b865118f619fb/roles/d042901298ef4d56b504a30c45128dca` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:04.599623 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d3454-1e51-43a3-a115-0e3b5bf62729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6644073b15349a5b18a70868298c841, user_id=439edf79c9164d63962b865118f619fb, role_id=d042901298ef4d56b504a30c45128dca)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:04.599977 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff87a29-ef8e-41f3-ba42-9a57da5981b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6644073b15349a5b18a70868298c841, user_id=33aa1fa71819442bb0ab5bc31d11564d, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:04.606367 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d3454-1e51-43a3-a115-0e3b5bf62729 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:04.606942 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff87a29-ef8e-41f3-ba42-9a57da5981b0 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:04.630750 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 65/123] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Dec 15 15:58:04 2021] PUT /identity/v3/projects/f6644073b15349a5b18a70868298c841/users/33aa1fa71819442bb0ab5bc31d11564d/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 15:58:04.632327 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 59/124] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Dec 15 15:58:04 2021] PUT /identity/v3/projects/f6644073b15349a5b18a70868298c841/users/439edf79c9164d63962b865118f619fb/roles/d042901298ef4d56b504a30c45128dca => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 15:58:05.202375 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701e857-dfb2-4ca4-89f6-687148662021 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:05.203083 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701e857-dfb2-4ca4-89f6-687148662021 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:05.203588 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701e857-dfb2-4ca4-89f6-687148662021 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:05.205880 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 66/125] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:05.211912 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc100ea-2716-4db7-ac8a-ebb04c7cdf20 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:05.212438 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc100ea-2716-4db7-ac8a-ebb04c7cdf20 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:05.212935 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc100ea-2716-4db7-ac8a-ebb04c7cdf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:05.234225 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-1bc100ea-2716-4db7-ac8a-ebb04c7cdf20 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:05.235746 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-1bc100ea-2716-4db7-ac8a-ebb04c7cdf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:05.282842 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45a499-5a6c-4962-b759-2845cc0e6735 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:05.283467 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45a499-5a6c-4962-b759-2845cc0e6735 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:05.283968 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45a499-5a6c-4962-b759-2845cc0e6735 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:05.285967 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 67/126] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:58:05.299039 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c89128-421c-4549-a862-de043a781ea2 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:05.299632 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c89128-421c-4549-a862-de043a781ea2 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:05.300111 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c89128-421c-4549-a862-de043a781ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:05.326039 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-75c89128-421c-4549-a862-de043a781ea2 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:05.328650 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-75c89128-421c-4549-a862-de043a781ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:05.349170 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 60/127] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:05.394913 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc100ea-2716-4db7-ac8a-ebb04c7cdf20 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:05.405913 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc100ea-2716-4db7-ac8a-ebb04c7cdf20 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:05.416152 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955b38a-c18e-4306-8924-43bcddd9f1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:05.420497 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 68/128] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:05.421381 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955b38a-c18e-4306-8924-43bcddd9f1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:05.421891 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955b38a-c18e-4306-8924-43bcddd9f1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:05.422370 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955b38a-c18e-4306-8924-43bcddd9f1c9 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:05.443642 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955b38a-c18e-4306-8924-43bcddd9f1c9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:05.449351 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c89128-421c-4549-a862-de043a781ea2 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:05.451948 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-e955b38a-c18e-4306-8924-43bcddd9f1c9 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 15:58:05.453358 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 61/129] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:05 2021] GET /identity/v3/roles/reader => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:05.459825 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955b38a-c18e-4306-8924-43bcddd9f1c9 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:05.463872 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c89128-421c-4549-a862-de043a781ea2 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:05.471756 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955b38a-c18e-4306-8924-43bcddd9f1c9 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:05.474657 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25a56d-8946-47ce-899a-ed352f581fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:05.475559 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25a56d-8946-47ce-899a-ed352f581fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:05.475851 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25a56d-8946-47ce-899a-ed352f581fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:05.476120 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25a56d-8946-47ce-899a-ed352f581fa8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:05.482092 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d08de4-1d39-4916-a38d-d5a57b790159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:05.482543 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25a56d-8946-47ce-899a-ed352f581fa8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:05.483471 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d08de4-1d39-4916-a38d-d5a57b790159 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:05.483925 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25a56d-8946-47ce-899a-ed352f581fa8 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:05.484233 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d08de4-1d39-4916-a38d-d5a57b790159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:05.484707 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d08de4-1d39-4916-a38d-d5a57b790159 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:05.485560 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 69/130] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:05 2021] GET /identity/v3/domains/default => generated 199 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:05.486011 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d08de4-1d39-4916-a38d-d5a57b790159 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:05.486576 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d08de4-1d39-4916-a38d-d5a57b790159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:05.488456 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d08de4-1d39-4916-a38d-d5a57b790159 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:05.493509 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25a56d-8946-47ce-899a-ed352f581fa8 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:05.505034 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 62/131] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:05 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:05.508127 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25a56d-8946-47ce-899a-ed352f581fa8 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:05.511634 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d08de4-1d39-4916-a38d-d5a57b790159 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:05.521452 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa3c92-6154-4c8a-807e-802d88545411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:05.521452 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa3c92-6154-4c8a-807e-802d88545411 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:05.521452 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa3c92-6154-4c8a-807e-802d88545411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:05.521452 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa3c92-6154-4c8a-807e-802d88545411 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:05.521778 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa3c92-6154-4c8a-807e-802d88545411 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:05.521854 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa3c92-6154-4c8a-807e-802d88545411 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:05.528278 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d08de4-1d39-4916-a38d-d5a57b790159 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:05.538211 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a151a8f-ba00-4717-9036-96d758c431bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:05.540278 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a151a8f-ba00-4717-9036-96d758c431bc admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:05.540771 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a151a8f-ba00-4717-9036-96d758c431bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:05.541272 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a151a8f-ba00-4717-9036-96d758c431bc admin admin] PATH_INFO: `/v3/users/2e943bda6d2347d49eee1e245fea9ec6` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:05.562588 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a151a8f-ba00-4717-9036-96d758c431bc admin admin] RBAC: Authorizing `identity:get_user(user_id=2e943bda6d2347d49eee1e245fea9ec6)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:05.565428 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a151a8f-ba00-4717-9036-96d758c431bc admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:05.567465 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 63/132] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:05 2021] GET /identity/v3/users/2e943bda6d2347d49eee1e245fea9ec6 => generated 289 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:05.574186 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a151a8f-ba00-4717-9036-96d758c431bc admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:05.577142 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 70/133] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Dec 15 15:58:05 2021] POST /identity/v3/projects => generated 302 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 15:58:05.592972 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a151a8f-ba00-4717-9036-96d758c431bc admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:05.669593 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f03dce-81b5-4544-ae3f-a7fe3c18228a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:05.670610 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f03dce-81b5-4544-ae3f-a7fe3c18228a admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:05.671121 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f03dce-81b5-4544-ae3f-a7fe3c18228a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:05.671619 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f03dce-81b5-4544-ae3f-a7fe3c18228a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:05.685475 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f03dce-81b5-4544-ae3f-a7fe3c18228a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:05.687745 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f03dce-81b5-4544-ae3f-a7fe3c18228a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:05.703796 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 64/134] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:05 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 15:58:05.710125 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa3c92-6154-4c8a-807e-802d88545411 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:05.736098 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa3c92-6154-4c8a-807e-802d88545411 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:05.750203 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c9387-bd86-4d8e-a62b-8cf2f88019ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:05.751124 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c9387-bd86-4d8e-a62b-8cf2f88019ee admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:05.751411 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c9387-bd86-4d8e-a62b-8cf2f88019ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:05.751691 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c9387-bd86-4d8e-a62b-8cf2f88019ee admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:05.753062 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c9387-bd86-4d8e-a62b-8cf2f88019ee admin admin] RBAC: Authorizing `identity:get_project(project_id=f6644073b15349a5b18a70868298c841)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:05.755225 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c9387-bd86-4d8e-a62b-8cf2f88019ee admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:05.756982 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 71/135] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:05 2021] GET /identity/v3/projects/f6644073b15349a5b18a70868298c841 => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:05.764242 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f03dce-81b5-4544-ae3f-a7fe3c18228a admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:05.778466 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f03dce-81b5-4544-ae3f-a7fe3c18228a admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:05.785590 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f596ba7-0507-44b9-a6b4-c1d6cb9b2bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:05.786540 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f596ba7-0507-44b9-a6b4-c1d6cb9b2bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:05.787026 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f596ba7-0507-44b9-a6b4-c1d6cb9b2bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:05.787794 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f596ba7-0507-44b9-a6b4-c1d6cb9b2bc2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:05.788957 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f596ba7-0507-44b9-a6b4-c1d6cb9b2bc2 admin admin] RBAC: Adding query filter params (role.id=e50f3b500f664b279fa7bd9f661f9dfb, scope.project.id=f6644073b15349a5b18a70868298c841, user.id=2e943bda6d2347d49eee1e245fea9ec6) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:05.789516 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f596ba7-0507-44b9-a6b4-c1d6cb9b2bc2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:05.791768 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f596ba7-0507-44b9-a6b4-c1d6cb9b2bc2 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:05.802821 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 65/136] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:05 2021] GET /identity/v3/role_assignments?user.id=2e943bda6d2347d49eee1e245fea9ec6&scope.project.id=f6644073b15349a5b18a70868298c841&role.id=e50f3b500f664b279fa7bd9f661f9dfb => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:07.588657 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45509ca4-98dc-4b51-97d8-b718254f10b3 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:07.589164 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45509ca4-98dc-4b51-97d8-b718254f10b3 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:07.589239 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45509ca4-98dc-4b51-97d8-b718254f10b3 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:07.590995 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 72/137] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:07.597095 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645b14e-cae4-4ca0-9a27-2823a989b937 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:07.598040 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645b14e-cae4-4ca0-9a27-2823a989b937 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:07.598516 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645b14e-cae4-4ca0-9a27-2823a989b937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:07.625506 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-3645b14e-cae4-4ca0-9a27-2823a989b937 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:07.627026 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-3645b14e-cae4-4ca0-9a27-2823a989b937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:07.642759 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 66/138] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:07.686534 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45509ca4-98dc-4b51-97d8-b718254f10b3 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:07.699852 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45509ca4-98dc-4b51-97d8-b718254f10b3 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:07.704879 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3707d93-8468-4b59-a86f-f7c1170dfce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:07.710526 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3707d93-8468-4b59-a86f-f7c1170dfce9 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:07.711233 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3707d93-8468-4b59-a86f-f7c1170dfce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:07.711906 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3707d93-8468-4b59-a86f-f7c1170dfce9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:07.727627 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3707d93-8468-4b59-a86f-f7c1170dfce9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:07.731654 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194ed52-8557-4809-aeb6-04b60ba28700 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:07.731949 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194ed52-8557-4809-aeb6-04b60ba28700 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:07.732237 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194ed52-8557-4809-aeb6-04b60ba28700 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:07.734038 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 67/139] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:07.736157 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-b3707d93-8468-4b59-a86f-f7c1170dfce9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 15:58:07.737601 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 73/140] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:07 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:07.741476 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f5b36-2e59-4286-a786-b697476bb4ae None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:07.741476 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f5b36-2e59-4286-a786-b697476bb4ae None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:07.741476 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f5b36-2e59-4286-a786-b697476bb4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:07.749339 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3707d93-8468-4b59-a86f-f7c1170dfce9 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:07.760154 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3707d93-8468-4b59-a86f-f7c1170dfce9 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:07.765073 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc515aab-ff18-4cc1-8afa-4a019416b56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:07.770191 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc515aab-ff18-4cc1-8afa-4a019416b56f admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:07.770697 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc515aab-ff18-4cc1-8afa-4a019416b56f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:07.771179 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc515aab-ff18-4cc1-8afa-4a019416b56f admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:07.772184 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc515aab-ff18-4cc1-8afa-4a019416b56f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:07.772692 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc515aab-ff18-4cc1-8afa-4a019416b56f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:07.774494 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-585f5b36-2e59-4286-a786-b697476bb4ae None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:07.775154 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc515aab-ff18-4cc1-8afa-4a019416b56f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:07.775696 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-585f5b36-2e59-4286-a786-b697476bb4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:07.785424 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 74/141] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:07 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:07.792683 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc515aab-ff18-4cc1-8afa-4a019416b56f admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:07.799666 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 68/142] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:07.808844 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc515aab-ff18-4cc1-8afa-4a019416b56f admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:07.813428 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5960a6-89ba-437a-bb1f-e339c07adc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:07.814469 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5960a6-89ba-437a-bb1f-e339c07adc19 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:07.814860 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5960a6-89ba-437a-bb1f-e339c07adc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:07.815238 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5960a6-89ba-437a-bb1f-e339c07adc19 admin admin] PATH_INFO: `/v3/users/439edf79c9164d63962b865118f619fb` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:07.816566 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5960a6-89ba-437a-bb1f-e339c07adc19 admin admin] RBAC: Authorizing `identity:get_user(user_id=439edf79c9164d63962b865118f619fb)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:07.818910 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5960a6-89ba-437a-bb1f-e339c07adc19 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:07.821133 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 75/143] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:07 2021] GET /identity/v3/users/439edf79c9164d63962b865118f619fb => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:07.827224 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f5b36-2e59-4286-a786-b697476bb4ae None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:07.847381 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5960a6-89ba-437a-bb1f-e339c07adc19 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:07.847874 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f5b36-2e59-4286-a786-b697476bb4ae None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:07.858241 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5960a6-89ba-437a-bb1f-e339c07adc19 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:07.862916 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43f54c-be6c-4b66-ad26-2ecf785f680c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:07.863053 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862ac24-e58f-43aa-89f1-cb1b90449170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:07.863625 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862ac24-e58f-43aa-89f1-cb1b90449170 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:07.863915 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862ac24-e58f-43aa-89f1-cb1b90449170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:07.864193 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862ac24-e58f-43aa-89f1-cb1b90449170 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:07.864295 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43f54c-be6c-4b66-ad26-2ecf785f680c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:07.864667 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43f54c-be6c-4b66-ad26-2ecf785f680c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:07.865107 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43f54c-be6c-4b66-ad26-2ecf785f680c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:07.877406 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43f54c-be6c-4b66-ad26-2ecf785f680c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:07.881150 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862ac24-e58f-43aa-89f1-cb1b90449170 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:07.883559 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862ac24-e58f-43aa-89f1-cb1b90449170 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:07.886562 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-cb43f54c-be6c-4b66-ad26-2ecf785f680c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 15:58:07.886562 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 76/144] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:07 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:07.895668 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 69/145] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:07 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:07.896743 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43f54c-be6c-4b66-ad26-2ecf785f680c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:07.903986 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862ac24-e58f-43aa-89f1-cb1b90449170 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:07.915022 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43f54c-be6c-4b66-ad26-2ecf785f680c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:07.918187 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b0152-f4ea-41be-9acc-36d563bc642e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:07.918857 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b0152-f4ea-41be-9acc-36d563bc642e admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:07.919143 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b0152-f4ea-41be-9acc-36d563bc642e admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:07.919423 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b0152-f4ea-41be-9acc-36d563bc642e admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:07.919830 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862ac24-e58f-43aa-89f1-cb1b90449170 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:07.920192 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b0152-f4ea-41be-9acc-36d563bc642e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:07.920503 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b0152-f4ea-41be-9acc-36d563bc642e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:07.925410 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b0152-f4ea-41be-9acc-36d563bc642e admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:07.930871 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3fd63-06c1-4a79-8676-c4d795db19c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:07.931921 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3fd63-06c1-4a79-8676-c4d795db19c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:07.932357 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3fd63-06c1-4a79-8676-c4d795db19c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:07.932564 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 77/146] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:07 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:07.932919 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3fd63-06c1-4a79-8676-c4d795db19c5 admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:07.938208 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3fd63-06c1-4a79-8676-c4d795db19c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=f6644073b15349a5b18a70868298c841)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:07.940471 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3fd63-06c1-4a79-8676-c4d795db19c5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:07.942644 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 70/147] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:07 2021] GET /identity/v3/projects/f6644073b15349a5b18a70868298c841 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:07.944966 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b0152-f4ea-41be-9acc-36d563bc642e admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:07.949378 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3fd63-06c1-4a79-8676-c4d795db19c5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:07.964761 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3fd63-06c1-4a79-8676-c4d795db19c5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:07.967901 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b0152-f4ea-41be-9acc-36d563bc642e admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:07.974798 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f90c2-6af1-4c2e-b519-c443cfae70bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:07.976106 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f90c2-6af1-4c2e-b519-c443cfae70bd admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:07.976978 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61105a87-a33f-41d9-94db-557e8c1b036d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:07.977645 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f90c2-6af1-4c2e-b519-c443cfae70bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:07.978671 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61105a87-a33f-41d9-94db-557e8c1b036d admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:07.979101 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f90c2-6af1-4c2e-b519-c443cfae70bd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:07.980102 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f90c2-6af1-4c2e-b519-c443cfae70bd admin admin] RBAC: Adding query filter params (role.id=530f09f883ac47cba230257bcf458141, scope.project.id=f6644073b15349a5b18a70868298c841, user.id=439edf79c9164d63962b865118f619fb) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:07.980549 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61105a87-a33f-41d9-94db-557e8c1b036d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:07.980978 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61105a87-a33f-41d9-94db-557e8c1b036d admin admin] PATH_INFO: `/v3/users/439edf79c9164d63962b865118f619fb` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:07.981459 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f90c2-6af1-4c2e-b519-c443cfae70bd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:07.984108 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f90c2-6af1-4c2e-b519-c443cfae70bd admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:07.985234 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61105a87-a33f-41d9-94db-557e8c1b036d admin admin] RBAC: Authorizing `identity:get_user(user_id=439edf79c9164d63962b865118f619fb)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:07.989715 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61105a87-a33f-41d9-94db-557e8c1b036d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:07.991535 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 78/148] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:07 2021] GET /identity/v3/users/439edf79c9164d63962b865118f619fb => generated 275 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:08.001537 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 71/149] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:07 2021] GET /identity/v3/role_assignments?user.id=439edf79c9164d63962b865118f619fb&scope.project.id=f6644073b15349a5b18a70868298c841&role.id=530f09f883ac47cba230257bcf458141 => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:08.003745 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61105a87-a33f-41d9-94db-557e8c1b036d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:08.018890 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61105a87-a33f-41d9-94db-557e8c1b036d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:08.027545 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e647579-ea14-4286-b6aa-bbdff389f57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:08.028489 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e647579-ea14-4286-b6aa-bbdff389f57a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:08.028922 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e647579-ea14-4286-b6aa-bbdff389f57a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:08.029347 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e647579-ea14-4286-b6aa-bbdff389f57a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:08.044342 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e647579-ea14-4286-b6aa-bbdff389f57a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:08.046392 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e647579-ea14-4286-b6aa-bbdff389f57a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:08.060234 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 79/150] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:08 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 15:58:08.066782 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f90c2-6af1-4c2e-b519-c443cfae70bd admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:08.084392 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f90c2-6af1-4c2e-b519-c443cfae70bd admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:08.089906 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b2912-ccb5-4d32-bacc-0ed592be6c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:08.091011 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b2912-ccb5-4d32-bacc-0ed592be6c2b admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:08.091448 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b2912-ccb5-4d32-bacc-0ed592be6c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:08.091873 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b2912-ccb5-4d32-bacc-0ed592be6c2b admin admin] PATH_INFO: `/v3/projects/b237a0f886034cc8859e87cf27895c70` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:08.098283 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b2912-ccb5-4d32-bacc-0ed592be6c2b admin admin] RBAC: Authorizing `identity:get_project(project_id=b237a0f886034cc8859e87cf27895c70)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:08.100622 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b2912-ccb5-4d32-bacc-0ed592be6c2b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:08.103082 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 72/151] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:08 2021] GET /identity/v3/projects/b237a0f886034cc8859e87cf27895c70 => generated 312 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:08.109715 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e647579-ea14-4286-b6aa-bbdff389f57a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:08.125069 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e647579-ea14-4286-b6aa-bbdff389f57a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:08.135080 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b8eb4-fa32-47ec-a607-ff25f86cd9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:08.136118 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b8eb4-fa32-47ec-a607-ff25f86cd9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:08.136556 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b8eb4-fa32-47ec-a607-ff25f86cd9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:08.136997 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b8eb4-fa32-47ec-a607-ff25f86cd9c1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:08.138079 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b8eb4-fa32-47ec-a607-ff25f86cd9c1 admin admin] RBAC: Adding query filter params (role.id=530f09f883ac47cba230257bcf458141, scope.project.id=b237a0f886034cc8859e87cf27895c70, user.id=439edf79c9164d63962b865118f619fb) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:08.138556 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b8eb4-fa32-47ec-a607-ff25f86cd9c1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:08.140685 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b8eb4-fa32-47ec-a607-ff25f86cd9c1 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:08.149603 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 80/152] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:08 2021] GET /identity/v3/role_assignments?user.id=439edf79c9164d63962b865118f619fb&scope.project.id=b237a0f886034cc8859e87cf27895c70&role.id=530f09f883ac47cba230257bcf458141 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:08.235312 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095012f6-1bc4-4e09-ae85-db88b6932983 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:08.235840 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095012f6-1bc4-4e09-ae85-db88b6932983 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:08.236271 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095012f6-1bc4-4e09-ae85-db88b6932983 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:08.238382 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 73/153] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:08.245783 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dba315-f1e3-4849-a872-18a6336d861f None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:08.246450 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dba315-f1e3-4849-a872-18a6336d861f None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:08.246945 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dba315-f1e3-4849-a872-18a6336d861f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:08.275538 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-94dba315-f1e3-4849-a872-18a6336d861f None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:08.277218 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-94dba315-f1e3-4849-a872-18a6336d861f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:08.285939 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 81/154] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:08.311388 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095012f6-1bc4-4e09-ae85-db88b6932983 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:08.331325 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095012f6-1bc4-4e09-ae85-db88b6932983 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:08.336731 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10907f30-ca57-424d-b796-bc31cacb46df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:08.337953 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10907f30-ca57-424d-b796-bc31cacb46df admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:08.338480 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10907f30-ca57-424d-b796-bc31cacb46df admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:08.338976 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10907f30-ca57-424d-b796-bc31cacb46df admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:08.359612 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10907f30-ca57-424d-b796-bc31cacb46df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:08.371205 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-10907f30-ca57-424d-b796-bc31cacb46df admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 15:58:08.372953 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 74/155] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:58:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:08.379489 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dba315-f1e3-4849-a872-18a6336d861f None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:08.392699 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dba315-f1e3-4849-a872-18a6336d861f None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:08.402222 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a417d-d611-416a-84d0-61148fb38f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:08.403285 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a417d-d611-416a-84d0-61148fb38f42 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:08.403805 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a417d-d611-416a-84d0-61148fb38f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:08.404298 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a417d-d611-416a-84d0-61148fb38f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:08.405330 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a417d-d611-416a-84d0-61148fb38f42 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:08.405938 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a417d-d611-416a-84d0-61148fb38f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:08.407815 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a417d-d611-416a-84d0-61148fb38f42 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:08.422337 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 82/156] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:08.428626 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10907f30-ca57-424d-b796-bc31cacb46df admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:08.440272 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10907f30-ca57-424d-b796-bc31cacb46df admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:08.450324 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bf363-7e51-420e-8de7-977ab411e59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:08.451599 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bf363-7e51-420e-8de7-977ab411e59c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:08.452212 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bf363-7e51-420e-8de7-977ab411e59c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:08.452705 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bf363-7e51-420e-8de7-977ab411e59c admin admin] PATH_INFO: `/v3/users/33aa1fa71819442bb0ab5bc31d11564d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:08.458388 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3bf363-7e51-420e-8de7-977ab411e59c admin admin] RBAC: Authorizing `identity:get_user(user_id=33aa1fa71819442bb0ab5bc31d11564d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:08.460666 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3bf363-7e51-420e-8de7-977ab411e59c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:08.463181 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 75/157] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:08 2021] GET /identity/v3/users/33aa1fa71819442bb0ab5bc31d11564d => generated 247 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:08.470268 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a417d-d611-416a-84d0-61148fb38f42 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:08.486898 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a417d-d611-416a-84d0-61148fb38f42 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:08.492606 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26756f-b26c-440d-91fd-3f99f3702ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:08.493746 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26756f-b26c-440d-91fd-3f99f3702ddd admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:08.494252 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26756f-b26c-440d-91fd-3f99f3702ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:08.494763 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26756f-b26c-440d-91fd-3f99f3702ddd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:08.504982 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef26756f-b26c-440d-91fd-3f99f3702ddd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:08.507150 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef26756f-b26c-440d-91fd-3f99f3702ddd admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:08.521205 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 83/158] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:08 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:08.527706 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bf363-7e51-420e-8de7-977ab411e59c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:08.538732 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3bf363-7e51-420e-8de7-977ab411e59c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:08.548915 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85435c94-4f7d-41d0-84ba-66f871a5f454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:08.550114 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85435c94-4f7d-41d0-84ba-66f871a5f454 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:08.550615 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85435c94-4f7d-41d0-84ba-66f871a5f454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:08.551100 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85435c94-4f7d-41d0-84ba-66f871a5f454 admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:08.553821 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85435c94-4f7d-41d0-84ba-66f871a5f454 admin admin] RBAC: Authorizing `identity:get_project(project_id=f6644073b15349a5b18a70868298c841)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:08.556659 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85435c94-4f7d-41d0-84ba-66f871a5f454 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:08.558632 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 76/159] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:08 2021] GET /identity/v3/projects/f6644073b15349a5b18a70868298c841 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:08.565190 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26756f-b26c-440d-91fd-3f99f3702ddd admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:08.575522 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26756f-b26c-440d-91fd-3f99f3702ddd admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:08.581915 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c6fc4-99aa-4b4d-a60f-b9cf72f7b47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:08.582870 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c6fc4-99aa-4b4d-a60f-b9cf72f7b47a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:08.583362 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c6fc4-99aa-4b4d-a60f-b9cf72f7b47a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:08.583845 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c6fc4-99aa-4b4d-a60f-b9cf72f7b47a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:08.584912 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c6fc4-99aa-4b4d-a60f-b9cf72f7b47a admin admin] RBAC: Adding query filter params (role.id=bc362f875c6d4cee83ba65b8d134462d, scope.project.id=f6644073b15349a5b18a70868298c841, user.id=33aa1fa71819442bb0ab5bc31d11564d) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:08.585492 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c6fc4-99aa-4b4d-a60f-b9cf72f7b47a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:08.588694 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c6fc4-99aa-4b4d-a60f-b9cf72f7b47a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:08.600400 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 84/160] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:08 2021] GET /identity/v3/role_assignments?user.id=33aa1fa71819442bb0ab5bc31d11564d&scope.project.id=f6644073b15349a5b18a70868298c841&role.id=bc362f875c6d4cee83ba65b8d134462d => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:08.738616 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8723b3-ba1b-4c96-b851-925e87db7a35 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:08.739591 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8723b3-ba1b-4c96-b851-925e87db7a35 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:08.740090 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8723b3-ba1b-4c96-b851-925e87db7a35 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:08.742817 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 77/161] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:08.749326 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52e3d4-3837-40d1-9470-65cdeebb499a None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:08.749651 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52e3d4-3837-40d1-9470-65cdeebb499a None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:08.749929 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52e3d4-3837-40d1-9470-65cdeebb499a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:08.770352 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-4c52e3d4-3837-40d1-9470-65cdeebb499a None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:08.771938 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-4c52e3d4-3837-40d1-9470-65cdeebb499a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:08.781637 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 85/162] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:58:08.809690 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8723b3-ba1b-4c96-b851-925e87db7a35 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:08.824924 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8723b3-ba1b-4c96-b851-925e87db7a35 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:08.830024 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b43ab5-f766-429c-b52e-8564e712bda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:08.831207 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b43ab5-f766-429c-b52e-8564e712bda2 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:08.831707 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b43ab5-f766-429c-b52e-8564e712bda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:08.832188 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b43ab5-f766-429c-b52e-8564e712bda2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:08.845501 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b43ab5-f766-429c-b52e-8564e712bda2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:08.854092 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-b2b43ab5-f766-429c-b52e-8564e712bda2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 15:58:08.855646 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 78/163] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Dec 15 15:58:08 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:08.862058 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52e3d4-3837-40d1-9470-65cdeebb499a None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:08.873979 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52e3d4-3837-40d1-9470-65cdeebb499a None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:08.881207 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5aab2-6f81-4e0e-b0aa-e73d07a4b0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:08.882180 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5aab2-6f81-4e0e-b0aa-e73d07a4b0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:08.882730 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5aab2-6f81-4e0e-b0aa-e73d07a4b0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:08.884016 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5aab2-6f81-4e0e-b0aa-e73d07a4b0d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:08.885022 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5aab2-6f81-4e0e-b0aa-e73d07a4b0d6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:08.885600 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5aab2-6f81-4e0e-b0aa-e73d07a4b0d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:08.887448 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5aab2-6f81-4e0e-b0aa-e73d07a4b0d6 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:08.899845 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 86/164] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:08 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:08.905741 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b43ab5-f766-429c-b52e-8564e712bda2 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:08.915975 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b43ab5-f766-429c-b52e-8564e712bda2 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:08.922017 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1f4ee-66d2-4951-948d-7e2d15839abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:08.923221 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1f4ee-66d2-4951-948d-7e2d15839abc admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:08.923573 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1f4ee-66d2-4951-948d-7e2d15839abc admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:08.923913 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1f4ee-66d2-4951-948d-7e2d15839abc admin admin] PATH_INFO: `/v3/users/439edf79c9164d63962b865118f619fb` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:08.925408 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1f4ee-66d2-4951-948d-7e2d15839abc admin admin] RBAC: Authorizing `identity:get_user(user_id=439edf79c9164d63962b865118f619fb)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:08.927767 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1f4ee-66d2-4951-948d-7e2d15839abc admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:08.930621 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 79/165] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:08 2021] GET /identity/v3/users/439edf79c9164d63962b865118f619fb => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:08.936704 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5aab2-6f81-4e0e-b0aa-e73d07a4b0d6 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:08.948570 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5aab2-6f81-4e0e-b0aa-e73d07a4b0d6 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:08.955867 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645469ba-ce4e-4b9b-9ca3-c187d88551c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:08.956546 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645469ba-ce4e-4b9b-9ca3-c187d88551c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:08.956817 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645469ba-ce4e-4b9b-9ca3-c187d88551c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:08.957095 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645469ba-ce4e-4b9b-9ca3-c187d88551c5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:08.969721 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645469ba-ce4e-4b9b-9ca3-c187d88551c5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:08.971652 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645469ba-ce4e-4b9b-9ca3-c187d88551c5 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:08.981183 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 87/166] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:08 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:08.987245 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1f4ee-66d2-4951-948d-7e2d15839abc admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:08.999580 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1f4ee-66d2-4951-948d-7e2d15839abc admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:09.003849 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5fc3b-8dda-404a-a536-51fc5cd73d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:09.004687 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5fc3b-8dda-404a-a536-51fc5cd73d0e admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:09.004966 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5fc3b-8dda-404a-a536-51fc5cd73d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:09.005259 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5fc3b-8dda-404a-a536-51fc5cd73d0e admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:09.006435 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5fc3b-8dda-404a-a536-51fc5cd73d0e admin admin] RBAC: Authorizing `identity:get_project(project_id=f6644073b15349a5b18a70868298c841)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:09.009126 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5fc3b-8dda-404a-a536-51fc5cd73d0e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:09.010935 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 80/167] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:08 2021] GET /identity/v3/projects/f6644073b15349a5b18a70868298c841 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:09.016903 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645469ba-ce4e-4b9b-9ca3-c187d88551c5 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:09.025968 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645469ba-ce4e-4b9b-9ca3-c187d88551c5 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:09.030406 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb029f02-ef3b-48f4-acfc-9a5fbf074208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:09.031047 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb029f02-ef3b-48f4-acfc-9a5fbf074208 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:09.031327 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb029f02-ef3b-48f4-acfc-9a5fbf074208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:09.031601 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb029f02-ef3b-48f4-acfc-9a5fbf074208 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:09.032441 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb029f02-ef3b-48f4-acfc-9a5fbf074208 admin admin] RBAC: Adding query filter params (role.id=d042901298ef4d56b504a30c45128dca, scope.project.id=f6644073b15349a5b18a70868298c841, user.id=439edf79c9164d63962b865118f619fb) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:09.032754 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb029f02-ef3b-48f4-acfc-9a5fbf074208 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:09.034662 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb029f02-ef3b-48f4-acfc-9a5fbf074208 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:09.044808 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 88/168] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:09 2021] GET /identity/v3/role_assignments?user.id=439edf79c9164d63962b865118f619fb&scope.project.id=f6644073b15349a5b18a70868298c841&role.id=d042901298ef4d56b504a30c45128dca => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:09.348417 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9ca64-1864-41a5-8529-ad2586a33ffe None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:09.348824 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9ca64-1864-41a5-8529-ad2586a33ffe None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:09.349100 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9ca64-1864-41a5-8529-ad2586a33ffe None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:09.350891 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 81/169] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:58:09.356899 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2b09f-350f-47b5-af40-1a22abca42bf None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:09.357192 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2b09f-350f-47b5-af40-1a22abca42bf None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:09.357508 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2b09f-350f-47b5-af40-1a22abca42bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:09.375062 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-f2a2b09f-350f-47b5-af40-1a22abca42bf None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:09.376237 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f2a2b09f-350f-47b5-af40-1a22abca42bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:09.384176 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 89/170] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:09.409603 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9ca64-1864-41a5-8529-ad2586a33ffe None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:09.421669 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9ca64-1864-41a5-8529-ad2586a33ffe None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:09.425836 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47202a24-e3b0-436c-ac63-575ac08da70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:09.426599 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47202a24-e3b0-436c-ac63-575ac08da70d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:09.426876 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47202a24-e3b0-436c-ac63-575ac08da70d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:09.427141 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47202a24-e3b0-436c-ac63-575ac08da70d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:09.428295 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47202a24-e3b0-436c-ac63-575ac08da70d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:09.430643 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47202a24-e3b0-436c-ac63-575ac08da70d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:09.432197 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 82/171] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:09 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:09.438000 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2b09f-350f-47b5-af40-1a22abca42bf None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:09.447465 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2b09f-350f-47b5-af40-1a22abca42bf None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:09.451757 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9abc51-7e29-4d1d-8242-66028ec06523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:09.452406 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9abc51-7e29-4d1d-8242-66028ec06523 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:09.452688 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9abc51-7e29-4d1d-8242-66028ec06523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:09.452964 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9abc51-7e29-4d1d-8242-66028ec06523 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:09.453714 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9abc51-7e29-4d1d-8242-66028ec06523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:09.455641 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9abc51-7e29-4d1d-8242-66028ec06523 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:09.476512 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 90/172] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Dec 15 15:58:09 2021] POST /identity/v3/users => generated 283 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:58:09.684354 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1090bf-64c5-4f66-b29c-a255492f65ea None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:09.684663 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1090bf-64c5-4f66-b29c-a255492f65ea None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:09.684947 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1090bf-64c5-4f66-b29c-a255492f65ea None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:09.686763 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 83/173] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:09.692652 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc098898-e9c3-4075-87cf-2f5615eba1d1 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:09.693097 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc098898-e9c3-4075-87cf-2f5615eba1d1 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:09.693202 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc098898-e9c3-4075-87cf-2f5615eba1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:09.712469 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-fc098898-e9c3-4075-87cf-2f5615eba1d1 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:09.713725 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-fc098898-e9c3-4075-87cf-2f5615eba1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:09.721241 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 91/174] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:58:09.744660 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1090bf-64c5-4f66-b29c-a255492f65ea None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:09.758820 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1090bf-64c5-4f66-b29c-a255492f65ea None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:09.763100 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab3fcf-119b-4d26-9851-0b5aa19a62e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:09.763885 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab3fcf-119b-4d26-9851-0b5aa19a62e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:09.764399 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab3fcf-119b-4d26-9851-0b5aa19a62e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:09.764877 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab3fcf-119b-4d26-9851-0b5aa19a62e2 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:09.776437 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab3fcf-119b-4d26-9851-0b5aa19a62e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:09.783496 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-61ab3fcf-119b-4d26-9851-0b5aa19a62e2 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 15:58:09.785468 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 84/175] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:09 2021] GET /identity/v3/roles/reader => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:09.792225 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc098898-e9c3-4075-87cf-2f5615eba1d1 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:09.801610 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc098898-e9c3-4075-87cf-2f5615eba1d1 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:09.809561 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d13bd5-4fbc-4c84-8cc8-7ca3fde8a47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:09.810228 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d13bd5-4fbc-4c84-8cc8-7ca3fde8a47c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:09.810506 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d13bd5-4fbc-4c84-8cc8-7ca3fde8a47c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:09.810780 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d13bd5-4fbc-4c84-8cc8-7ca3fde8a47c admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:09.811546 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d13bd5-4fbc-4c84-8cc8-7ca3fde8a47c admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:09.811846 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d13bd5-4fbc-4c84-8cc8-7ca3fde8a47c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:09.814406 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d13bd5-4fbc-4c84-8cc8-7ca3fde8a47c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:09.823718 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 92/176] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:09 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:09.829762 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab3fcf-119b-4d26-9851-0b5aa19a62e2 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:09.839735 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab3fcf-119b-4d26-9851-0b5aa19a62e2 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:09.844153 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6d969-b028-4599-a96c-709f4c85635c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:09.845009 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6d969-b028-4599-a96c-709f4c85635c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:09.845287 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6d969-b028-4599-a96c-709f4c85635c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:09.845587 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6d969-b028-4599-a96c-709f4c85635c admin admin] PATH_INFO: `/v3/users/2e943bda6d2347d49eee1e245fea9ec6` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:09.846782 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6d969-b028-4599-a96c-709f4c85635c admin admin] RBAC: Authorizing `identity:get_user(user_id=2e943bda6d2347d49eee1e245fea9ec6)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:09.848927 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6d969-b028-4599-a96c-709f4c85635c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:09.850698 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 85/177] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:09 2021] GET /identity/v3/users/2e943bda6d2347d49eee1e245fea9ec6 => generated 289 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:09.856987 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d13bd5-4fbc-4c84-8cc8-7ca3fde8a47c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:09.867056 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d13bd5-4fbc-4c84-8cc8-7ca3fde8a47c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:09.872092 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560b47f-7289-49be-9f49-f4ec42f1d438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:09.872970 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560b47f-7289-49be-9f49-f4ec42f1d438 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:09.873253 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560b47f-7289-49be-9f49-f4ec42f1d438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:09.873634 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560b47f-7289-49be-9f49-f4ec42f1d438 admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:09.874824 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560b47f-7289-49be-9f49-f4ec42f1d438 admin admin] RBAC: Authorizing `identity:get_project(project_id=f6644073b15349a5b18a70868298c841)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:09.876881 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560b47f-7289-49be-9f49-f4ec42f1d438 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:09.878569 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 93/178] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:09 2021] GET /identity/v3/projects/f6644073b15349a5b18a70868298c841 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:09.884759 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6d969-b028-4599-a96c-709f4c85635c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:09.895520 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6d969-b028-4599-a96c-709f4c85635c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:09.901492 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db4153-930b-422f-8f35-74443fcd24fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:09.902375 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db4153-930b-422f-8f35-74443fcd24fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:09.902658 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db4153-930b-422f-8f35-74443fcd24fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:09.902931 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db4153-930b-422f-8f35-74443fcd24fb admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841/users/2e943bda6d2347d49eee1e245fea9ec6/roles/e50f3b500f664b279fa7bd9f661f9dfb` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:09.904907 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db4153-930b-422f-8f35-74443fcd24fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6644073b15349a5b18a70868298c841, user_id=2e943bda6d2347d49eee1e245fea9ec6, role_id=e50f3b500f664b279fa7bd9f661f9dfb)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:09.907743 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db4153-930b-422f-8f35-74443fcd24fb admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:09.922821 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 86/179] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Dec 15 15:58:09 2021] PUT /identity/v3/projects/f6644073b15349a5b18a70868298c841/users/2e943bda6d2347d49eee1e245fea9ec6/roles/e50f3b500f664b279fa7bd9f661f9dfb => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 15:58:11.983932 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab07b28-c823-4c8e-9f14-43d6eb7be1d1 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:11.984451 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab07b28-c823-4c8e-9f14-43d6eb7be1d1 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:11.984451 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab07b28-c823-4c8e-9f14-43d6eb7be1d1 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:11.986299 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 94/180] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:11.992963 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf2ba0-aeea-4bf1-9ce2-5965b4cbc77f None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:11.993441 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf2ba0-aeea-4bf1-9ce2-5965b4cbc77f None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:11.993518 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf2ba0-aeea-4bf1-9ce2-5965b4cbc77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.011710 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-f4bf2ba0-aeea-4bf1-9ce2-5965b4cbc77f None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:12.012891 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-f4bf2ba0-aeea-4bf1-9ce2-5965b4cbc77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:12.073365 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 87/181] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:58:12.097520 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab07b28-c823-4c8e-9f14-43d6eb7be1d1 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:12.109719 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab07b28-c823-4c8e-9f14-43d6eb7be1d1 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:12.114042 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185d354-7a30-40e2-b5aa-5f47a784a91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:12.114812 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185d354-7a30-40e2-b5aa-5f47a784a91c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.115095 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185d354-7a30-40e2-b5aa-5f47a784a91c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.115356 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185d354-7a30-40e2-b5aa-5f47a784a91c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.125662 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185d354-7a30-40e2-b5aa-5f47a784a91c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:12.132400 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-6185d354-7a30-40e2-b5aa-5f47a784a91c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 15:58:12.134185 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 95/182] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:58:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:12.143559 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf2ba0-aeea-4bf1-9ce2-5965b4cbc77f None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:12.155499 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf2ba0-aeea-4bf1-9ce2-5965b4cbc77f None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:12.160001 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde3cdc-3ca9-4b38-a3d7-36473bd121e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:12.160665 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde3cdc-3ca9-4b38-a3d7-36473bd121e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.160944 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde3cdc-3ca9-4b38-a3d7-36473bd121e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.161216 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde3cdc-3ca9-4b38-a3d7-36473bd121e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.162013 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde3cdc-3ca9-4b38-a3d7-36473bd121e3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:12.162316 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde3cdc-3ca9-4b38-a3d7-36473bd121e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:12.164912 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde3cdc-3ca9-4b38-a3d7-36473bd121e3 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:12.173852 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 88/183] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:12.179842 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185d354-7a30-40e2-b5aa-5f47a784a91c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:12.190703 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185d354-7a30-40e2-b5aa-5f47a784a91c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:12.195105 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fde954-71ad-4d7b-9698-bcf6fc818005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:12.196199 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fde954-71ad-4d7b-9698-bcf6fc818005 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.196481 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fde954-71ad-4d7b-9698-bcf6fc818005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.196757 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fde954-71ad-4d7b-9698-bcf6fc818005 admin admin] PATH_INFO: `/v3/users/46e5cb6237434ea09e85ec2653f4684b` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.204075 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c6ebc-660c-4ed9-be45-3ef59613e4e1 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.204368 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c6ebc-660c-4ed9-be45-3ef59613e4e1 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.204650 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c6ebc-660c-4ed9-be45-3ef59613e4e1 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.206454 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 89/184] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:58:12.212013 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea38b10-6f59-43b7-84b7-425cb0523659 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.212262 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea38b10-6f59-43b7-84b7-425cb0523659 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.212539 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea38b10-6f59-43b7-84b7-425cb0523659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.213313 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fde954-71ad-4d7b-9698-bcf6fc818005 admin admin] RBAC: Authorizing `identity:get_user(user_id=46e5cb6237434ea09e85ec2653f4684b)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:12.215818 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fde954-71ad-4d7b-9698-bcf6fc818005 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:12.217983 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 96/185] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:12 2021] GET /identity/v3/users/46e5cb6237434ea09e85ec2653f4684b => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:12.223791 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fde954-71ad-4d7b-9698-bcf6fc818005 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:12.235486 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fde954-71ad-4d7b-9698-bcf6fc818005 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:12.235742 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-bea38b10-6f59-43b7-84b7-425cb0523659 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:12.236916 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-bea38b10-6f59-43b7-84b7-425cb0523659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:12.240604 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc389713-5605-4633-8c70-1ba9956ae8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:12.241578 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc389713-5605-4633-8c70-1ba9956ae8ee admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.242074 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc389713-5605-4633-8c70-1ba9956ae8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.242826 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc389713-5605-4633-8c70-1ba9956ae8ee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.244959 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 90/186] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:58:12.248888 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c2912-68cb-4855-b460-3f7eb2a7ac30 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.249180 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c2912-68cb-4855-b460-3f7eb2a7ac30 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.249489 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c2912-68cb-4855-b460-3f7eb2a7ac30 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.251187 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 91/187] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:58:12.252950 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc389713-5605-4633-8c70-1ba9956ae8ee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:12.254948 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc389713-5605-4633-8c70-1ba9956ae8ee admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:12.256462 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28449362-f0e6-4bf1-b5c5-398adfd9b3e6 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.256749 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28449362-f0e6-4bf1-b5c5-398adfd9b3e6 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.257029 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28449362-f0e6-4bf1-b5c5-398adfd9b3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.267023 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 97/188] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:12 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 15:58:12.270186 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc389713-5605-4633-8c70-1ba9956ae8ee admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:12.276013 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-28449362-f0e6-4bf1-b5c5-398adfd9b3e6 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:12.277299 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-28449362-f0e6-4bf1-b5c5-398adfd9b3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:12.280792 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc389713-5605-4633-8c70-1ba9956ae8ee admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:12.284859 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 92/189] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:58:12.285047 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d372dc9-50d7-414f-8e75-1373e74c0f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:12.285913 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d372dc9-50d7-414f-8e75-1373e74c0f60 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.286200 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d372dc9-50d7-414f-8e75-1373e74c0f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.286474 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d372dc9-50d7-414f-8e75-1373e74c0f60 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.286863 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28449362-f0e6-4bf1-b5c5-398adfd9b3e6 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:12.298200 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28449362-f0e6-4bf1-b5c5-398adfd9b3e6 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:12.298334 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d372dc9-50d7-414f-8e75-1373e74c0f60 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:12.302859 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea94aa-b7dd-49bd-b730-7648880dce6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:12.303936 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea94aa-b7dd-49bd-b730-7648880dce6c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.304414 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea94aa-b7dd-49bd-b730-7648880dce6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.304920 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea94aa-b7dd-49bd-b730-7648880dce6c admin admin] PATH_INFO: `/v3/projects/2a96cf65568148549e7ca922f4c5215f` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.305548 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-6d372dc9-50d7-414f-8e75-1373e74c0f60 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 15:58:12.306585 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea94aa-b7dd-49bd-b730-7648880dce6c admin admin] RBAC: Authorizing `identity:get_project(project_id=2a96cf65568148549e7ca922f4c5215f)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:12.306760 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 98/190] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Dec 15 15:58:12 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:12.309003 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea94aa-b7dd-49bd-b730-7648880dce6c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:12.310900 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 93/191] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:12 2021] GET /identity/v3/projects/2a96cf65568148549e7ca922f4c5215f => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:12.314268 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d372dc9-50d7-414f-8e75-1373e74c0f60 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:12.314377 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea94aa-b7dd-49bd-b730-7648880dce6c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:12.324711 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea94aa-b7dd-49bd-b730-7648880dce6c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:12.324880 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d372dc9-50d7-414f-8e75-1373e74c0f60 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:12.329036 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536cf03-1e02-4a88-a1a6-1a2d1449e727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:12.329718 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536cf03-1e02-4a88-a1a6-1a2d1449e727 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.329999 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536cf03-1e02-4a88-a1a6-1a2d1449e727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.330275 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536cf03-1e02-4a88-a1a6-1a2d1449e727 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.330430 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56305c-fab9-41df-bcfa-33201e0d44ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:12.331023 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536cf03-1e02-4a88-a1a6-1a2d1449e727 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:12.331328 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536cf03-1e02-4a88-a1a6-1a2d1449e727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:12.331625 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56305c-fab9-41df-bcfa-33201e0d44ed admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.332033 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56305c-fab9-41df-bcfa-33201e0d44ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.332435 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56305c-fab9-41df-bcfa-33201e0d44ed admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.332926 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536cf03-1e02-4a88-a1a6-1a2d1449e727 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:12.333890 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56305c-fab9-41df-bcfa-33201e0d44ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:12.335703 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56305c-fab9-41df-bcfa-33201e0d44ed admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:12.338134 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 99/192] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:12 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:12.338999 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56305c-fab9-41df-bcfa-33201e0d44ed admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:12.343466 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 94/193] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:12 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:12.346272 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536cf03-1e02-4a88-a1a6-1a2d1449e727 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:12.350669 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56305c-fab9-41df-bcfa-33201e0d44ed admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:12.355268 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80295d0c-e2d3-4dd5-a02e-5623aa9c0257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:12.355999 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536cf03-1e02-4a88-a1a6-1a2d1449e727 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:12.356278 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80295d0c-e2d3-4dd5-a02e-5623aa9c0257 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.356724 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80295d0c-e2d3-4dd5-a02e-5623aa9c0257 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.357247 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80295d0c-e2d3-4dd5-a02e-5623aa9c0257 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.358266 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80295d0c-e2d3-4dd5-a02e-5623aa9c0257 admin admin] RBAC: Adding query filter params (role.id=bc362f875c6d4cee83ba65b8d134462d, scope.project.id=2a96cf65568148549e7ca922f4c5215f, user.id=46e5cb6237434ea09e85ec2653f4684b) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:12.358747 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80295d0c-e2d3-4dd5-a02e-5623aa9c0257 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:12.360266 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bb25a-0919-47c2-a9cc-cac0ad122548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:12.360929 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bb25a-0919-47c2-a9cc-cac0ad122548 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.361146 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80295d0c-e2d3-4dd5-a02e-5623aa9c0257 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:12.361240 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bb25a-0919-47c2-a9cc-cac0ad122548 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.361500 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bb25a-0919-47c2-a9cc-cac0ad122548 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.362221 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56bb25a-0919-47c2-a9cc-cac0ad122548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:12.364149 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56bb25a-0919-47c2-a9cc-cac0ad122548 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:12.367643 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 100/194] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:12 2021] GET /identity/v3/role_assignments?user.id=46e5cb6237434ea09e85ec2653f4684b&scope.project.id=2a96cf65568148549e7ca922f4c5215f&role.id=bc362f875c6d4cee83ba65b8d134462d => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:12.368573 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80295d0c-e2d3-4dd5-a02e-5623aa9c0257 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:12.382861 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80295d0c-e2d3-4dd5-a02e-5623aa9c0257 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:12.388652 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f5ecd-7ff2-414f-af62-ab4c590f7ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:12.389910 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f5ecd-7ff2-414f-af62-ab4c590f7ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.390402 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f5ecd-7ff2-414f-af62-ab4c590f7ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.390850 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f5ecd-7ff2-414f-af62-ab4c590f7ca1 admin admin] PATH_INFO: `/v3/users/46e5cb6237434ea09e85ec2653f4684b` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.392480 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f5ecd-7ff2-414f-af62-ab4c590f7ca1 admin admin] RBAC: Authorizing `identity:get_user(user_id=46e5cb6237434ea09e85ec2653f4684b)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:12.394060 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 95/195] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Dec 15 15:58:12 2021] POST /identity/v3/users => generated 297 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:58:12.395381 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f5ecd-7ff2-414f-af62-ab4c590f7ca1 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:12.397646 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 101/196] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:12 2021] GET /identity/v3/users/46e5cb6237434ea09e85ec2653f4684b => generated 283 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:12.405078 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bb25a-0919-47c2-a9cc-cac0ad122548 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:12.407281 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347951c-ae33-43fc-b910-387f961dca4a None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.407575 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347951c-ae33-43fc-b910-387f961dca4a None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.407880 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347951c-ae33-43fc-b910-387f961dca4a None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.409875 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 102/197] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:58:12.417148 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72d6f6-c26b-4c88-9fd6-f88546d389ae None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.417473 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72d6f6-c26b-4c88-9fd6-f88546d389ae None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.417760 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72d6f6-c26b-4c88-9fd6-f88546d389ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.419030 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bb25a-0919-47c2-a9cc-cac0ad122548 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:12.424225 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405af18-6381-4ec5-9ce2-bd40aa9bfb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:12.425058 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405af18-6381-4ec5-9ce2-bd40aa9bfb3d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.425434 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405af18-6381-4ec5-9ce2-bd40aa9bfb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.425760 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405af18-6381-4ec5-9ce2-bd40aa9bfb3d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.436777 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405af18-6381-4ec5-9ce2-bd40aa9bfb3d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:12.438719 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405af18-6381-4ec5-9ce2-bd40aa9bfb3d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:12.441930 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-5f72d6f6-c26b-4c88-9fd6-f88546d389ae None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:12.443796 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-5f72d6f6-c26b-4c88-9fd6-f88546d389ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:12.449620 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 96/198] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:12 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 15:58:12.460245 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405af18-6381-4ec5-9ce2-bd40aa9bfb3d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:12.460910 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 103/199] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:58:12.467248 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405af18-6381-4ec5-9ce2-bd40aa9bfb3d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:12.472439 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e821a1f-5d56-401c-888f-8884f1a5d0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:12.473331 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e821a1f-5d56-401c-888f-8884f1a5d0eb admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.473668 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e821a1f-5d56-401c-888f-8884f1a5d0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.473945 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e821a1f-5d56-401c-888f-8884f1a5d0eb admin admin] PATH_INFO: `/v3/projects/2a96cf65568148549e7ca922f4c5215f` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.475308 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e821a1f-5d56-401c-888f-8884f1a5d0eb admin admin] RBAC: Authorizing `identity:get_project(project_id=2a96cf65568148549e7ca922f4c5215f)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:12.477738 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e821a1f-5d56-401c-888f-8884f1a5d0eb admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:12.480039 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 97/200] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:12 2021] GET /identity/v3/projects/2a96cf65568148549e7ca922f4c5215f => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:12.486062 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72d6f6-c26b-4c88-9fd6-f88546d389ae None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:12.486461 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e821a1f-5d56-401c-888f-8884f1a5d0eb admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:12.497827 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72d6f6-c26b-4c88-9fd6-f88546d389ae None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:12.498365 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e821a1f-5d56-401c-888f-8884f1a5d0eb admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:12.503570 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848e844-99cb-4f9e-b105-83c50ae654d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:12.504132 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c55b1-5dcf-4d7b-b499-3d135480e647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:12.504268 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848e844-99cb-4f9e-b105-83c50ae654d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.504512 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848e844-99cb-4f9e-b105-83c50ae654d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.504790 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848e844-99cb-4f9e-b105-83c50ae654d0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.505700 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848e844-99cb-4f9e-b105-83c50ae654d0 admin admin] RBAC: Adding query filter params (role.id=d042901298ef4d56b504a30c45128dca, scope.project.id=2a96cf65568148549e7ca922f4c5215f, user.id=46e5cb6237434ea09e85ec2653f4684b) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:12.505962 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c55b1-5dcf-4d7b-b499-3d135480e647 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.506061 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848e844-99cb-4f9e-b105-83c50ae654d0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:12.506615 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c55b1-5dcf-4d7b-b499-3d135480e647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.507135 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c55b1-5dcf-4d7b-b499-3d135480e647 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.507909 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848e844-99cb-4f9e-b105-83c50ae654d0 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:12.514393 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 98/201] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:12 2021] GET /identity/v3/role_assignments?user.id=46e5cb6237434ea09e85ec2653f4684b&scope.project.id=2a96cf65568148549e7ca922f4c5215f&role.id=d042901298ef4d56b504a30c45128dca => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:12.521781 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c55b1-5dcf-4d7b-b499-3d135480e647 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:12.530369 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-f89c55b1-5dcf-4d7b-b499-3d135480e647 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 15:58:12.532081 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 104/202] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:12 2021] GET /identity/v3/roles/reader => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:12.540572 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848e844-99cb-4f9e-b105-83c50ae654d0 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:12.551917 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848e844-99cb-4f9e-b105-83c50ae654d0 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:12.557615 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe390d-6f1c-4af7-ba5e-394a5c6976c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:12.558698 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe390d-6f1c-4af7-ba5e-394a5c6976c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.559195 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe390d-6f1c-4af7-ba5e-394a5c6976c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.559683 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe390d-6f1c-4af7-ba5e-394a5c6976c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.560760 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe390d-6f1c-4af7-ba5e-394a5c6976c6 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:12.561302 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe390d-6f1c-4af7-ba5e-394a5c6976c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:12.563290 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe390d-6f1c-4af7-ba5e-394a5c6976c6 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:12.574959 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 99/203] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:12 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:12.584194 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c55b1-5dcf-4d7b-b499-3d135480e647 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:12.596380 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c55b1-5dcf-4d7b-b499-3d135480e647 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:12.602561 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6395f-7685-431e-b6ad-67414db1e38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:12.604309 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6395f-7685-431e-b6ad-67414db1e38a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.604877 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6395f-7685-431e-b6ad-67414db1e38a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.605363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6395f-7685-431e-b6ad-67414db1e38a admin admin] PATH_INFO: `/v3/users/2e943bda6d2347d49eee1e245fea9ec6` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.607295 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6395f-7685-431e-b6ad-67414db1e38a admin admin] RBAC: Authorizing `identity:get_user(user_id=2e943bda6d2347d49eee1e245fea9ec6)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:12.610035 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6395f-7685-431e-b6ad-67414db1e38a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:12.617587 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 105/204] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:12 2021] GET /identity/v3/users/2e943bda6d2347d49eee1e245fea9ec6 => generated 289 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:12.620092 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe390d-6f1c-4af7-ba5e-394a5c6976c6 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:12.631517 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe390d-6f1c-4af7-ba5e-394a5c6976c6 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:12.637227 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532c098-d59a-43d5-b4c6-bb812d406448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:12.638299 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532c098-d59a-43d5-b4c6-bb812d406448 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.638883 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532c098-d59a-43d5-b4c6-bb812d406448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.639362 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532c098-d59a-43d5-b4c6-bb812d406448 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.650137 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532c098-d59a-43d5-b4c6-bb812d406448 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:12.652057 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532c098-d59a-43d5-b4c6-bb812d406448 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:12.662611 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 100/205] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:12 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:12.670224 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6395f-7685-431e-b6ad-67414db1e38a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:12.681902 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6395f-7685-431e-b6ad-67414db1e38a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:12.686618 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfb077-e0bc-46a6-93da-972d3fa6a2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:12.687538 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfb077-e0bc-46a6-93da-972d3fa6a2ae admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.687880 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfb077-e0bc-46a6-93da-972d3fa6a2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.688163 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfb077-e0bc-46a6-93da-972d3fa6a2ae admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.689536 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbfb077-e0bc-46a6-93da-972d3fa6a2ae admin admin] RBAC: Authorizing `identity:get_project(project_id=f6644073b15349a5b18a70868298c841)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:12.691717 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbfb077-e0bc-46a6-93da-972d3fa6a2ae admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:12.693667 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 106/206] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:12 2021] GET /identity/v3/projects/f6644073b15349a5b18a70868298c841 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:12.702116 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532c098-d59a-43d5-b4c6-bb812d406448 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:12.712568 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532c098-d59a-43d5-b4c6-bb812d406448 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:12.718236 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce1b45-8c13-4896-8a15-a835033ba3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:12.719229 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce1b45-8c13-4896-8a15-a835033ba3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:12.719654 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce1b45-8c13-4896-8a15-a835033ba3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:12.720055 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce1b45-8c13-4896-8a15-a835033ba3d2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:12.721054 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce1b45-8c13-4896-8a15-a835033ba3d2 admin admin] RBAC: Adding query filter params (role.id=e50f3b500f664b279fa7bd9f661f9dfb, scope.project.id=f6644073b15349a5b18a70868298c841, user.id=2e943bda6d2347d49eee1e245fea9ec6) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:12.721536 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce1b45-8c13-4896-8a15-a835033ba3d2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:12.723629 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce1b45-8c13-4896-8a15-a835033ba3d2 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:12.731526 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 101/207] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:12 2021] GET /identity/v3/role_assignments?user.id=2e943bda6d2347d49eee1e245fea9ec6&scope.project.id=f6644073b15349a5b18a70868298c841&role.id=e50f3b500f664b279fa7bd9f661f9dfb => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:14.809359 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ae2c8-ddb7-4b59-80e0-bc69211e574f None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:14.809904 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ae2c8-ddb7-4b59-80e0-bc69211e574f None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:14.809904 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ae2c8-ddb7-4b59-80e0-bc69211e574f None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:14.811714 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 107/208] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:14.817670 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc421e64-dd90-4413-9c10-ddb4bb61eabe None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:14.818076 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc421e64-dd90-4413-9c10-ddb4bb61eabe None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:14.818265 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc421e64-dd90-4413-9c10-ddb4bb61eabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:14.837375 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-fc421e64-dd90-4413-9c10-ddb4bb61eabe None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:14.838646 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-fc421e64-dd90-4413-9c10-ddb4bb61eabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:14.846884 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 102/209] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:58:14.871167 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ae2c8-ddb7-4b59-80e0-bc69211e574f None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:14.888365 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ae2c8-ddb7-4b59-80e0-bc69211e574f None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:14.892692 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b7dfe-1223-43e3-b340-5c4250ec995f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:14.893504 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b7dfe-1223-43e3-b340-5c4250ec995f admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:14.893789 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b7dfe-1223-43e3-b340-5c4250ec995f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:14.894067 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b7dfe-1223-43e3-b340-5c4250ec995f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:14.904950 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b7dfe-1223-43e3-b340-5c4250ec995f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:14.911829 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-f60b7dfe-1223-43e3-b340-5c4250ec995f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 15:58:14.913474 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 108/210] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:58:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:14.920064 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc421e64-dd90-4413-9c10-ddb4bb61eabe None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:14.929405 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc421e64-dd90-4413-9c10-ddb4bb61eabe None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:14.934778 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858508a-6f96-4fd3-9a3a-ebffc14e317f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:14.935442 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858508a-6f96-4fd3-9a3a-ebffc14e317f admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:14.935721 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858508a-6f96-4fd3-9a3a-ebffc14e317f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:14.935999 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858508a-6f96-4fd3-9a3a-ebffc14e317f admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:14.936762 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858508a-6f96-4fd3-9a3a-ebffc14e317f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:14.937072 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858508a-6f96-4fd3-9a3a-ebffc14e317f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:14.938779 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858508a-6f96-4fd3-9a3a-ebffc14e317f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:14.948124 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 103/211] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:14.954212 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b7dfe-1223-43e3-b340-5c4250ec995f admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:14.964913 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b7dfe-1223-43e3-b340-5c4250ec995f admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:14.966017 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866122e3-64c9-48c5-99f2-35359a07446f None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:14.966311 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866122e3-64c9-48c5-99f2-35359a07446f None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:14.966589 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866122e3-64c9-48c5-99f2-35359a07446f None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:14.968581 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 104/212] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:14.969891 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b0de9-e511-4039-80ed-047928f803e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:14.970855 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b0de9-e511-4039-80ed-047928f803e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:14.971239 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b0de9-e511-4039-80ed-047928f803e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:14.971616 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b0de9-e511-4039-80ed-047928f803e8 admin admin] PATH_INFO: `/v3/users/46e5cb6237434ea09e85ec2653f4684b` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:14.973015 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b0de9-e511-4039-80ed-047928f803e8 admin admin] RBAC: Authorizing `identity:get_user(user_id=46e5cb6237434ea09e85ec2653f4684b)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:14.973979 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f6524-295b-4db7-86a4-6330d9c6731b None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:14.974262 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f6524-295b-4db7-86a4-6330d9c6731b None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:14.974542 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f6524-295b-4db7-86a4-6330d9c6731b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:14.975641 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b0de9-e511-4039-80ed-047928f803e8 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:14.978342 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 109/213] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:14 2021] GET /identity/v3/users/46e5cb6237434ea09e85ec2653f4684b => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:14.984150 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b0de9-e511-4039-80ed-047928f803e8 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:14.994097 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-ed1f6524-295b-4db7-86a4-6330d9c6731b None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:14.994641 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b0de9-e511-4039-80ed-047928f803e8 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:14.995276 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-ed1f6524-295b-4db7-86a4-6330d9c6731b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:14.999296 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d55740-2118-49f1-b384-07d398d3d0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:15.000254 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d55740-2118-49f1-b384-07d398d3d0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:15.000644 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d55740-2118-49f1-b384-07d398d3d0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:15.001022 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d55740-2118-49f1-b384-07d398d3d0e9 admin admin] PATH_INFO: `/v3/projects/2a96cf65568148549e7ca922f4c5215f` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:15.002321 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d55740-2118-49f1-b384-07d398d3d0e9 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a96cf65568148549e7ca922f4c5215f)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:15.003258 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 105/214] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:58:15.004549 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d55740-2118-49f1-b384-07d398d3d0e9 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:15.006361 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 110/215] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:14 2021] GET /identity/v3/projects/2a96cf65568148549e7ca922f4c5215f => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:15.012651 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f6524-295b-4db7-86a4-6330d9c6731b None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:15.022069 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f6524-295b-4db7-86a4-6330d9c6731b None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:15.027792 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9622b-4dff-4b12-a5af-c43f43e39f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:15.028803 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9622b-4dff-4b12-a5af-c43f43e39f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:15.029089 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9622b-4dff-4b12-a5af-c43f43e39f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:15.029595 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9622b-4dff-4b12-a5af-c43f43e39f2a admin admin] PATH_INFO: `/v3/projects/2a96cf65568148549e7ca922f4c5215f/users/46e5cb6237434ea09e85ec2653f4684b/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:15.031824 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9622b-4dff-4b12-a5af-c43f43e39f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a96cf65568148549e7ca922f4c5215f, user_id=46e5cb6237434ea09e85ec2653f4684b, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:15.034531 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9622b-4dff-4b12-a5af-c43f43e39f2a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:15.036171 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d55740-2118-49f1-b384-07d398d3d0e9 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:15.049148 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d55740-2118-49f1-b384-07d398d3d0e9 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:15.057265 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de97a0-e802-4f2d-83ec-c9731f153574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:15.058096 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de97a0-e802-4f2d-83ec-c9731f153574 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:15.058381 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de97a0-e802-4f2d-83ec-c9731f153574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:15.058656 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de97a0-e802-4f2d-83ec-c9731f153574 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:15.061838 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 106/216] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Dec 15 15:58:15 2021] PUT /identity/v3/projects/2a96cf65568148549e7ca922f4c5215f/users/46e5cb6237434ea09e85ec2653f4684b/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 15:58:15.074468 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de97a0-e802-4f2d-83ec-c9731f153574 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:15.082658 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-96de97a0-e802-4f2d-83ec-c9731f153574 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 15:58:15.084257 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 111/217] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Dec 15 15:58:15 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:15.091909 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9622b-4dff-4b12-a5af-c43f43e39f2a admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:15.164205 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9622b-4dff-4b12-a5af-c43f43e39f2a admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:15.169427 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d72904-cac7-411b-94d4-85d877808c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:15.170435 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d72904-cac7-411b-94d4-85d877808c98 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:15.170915 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d72904-cac7-411b-94d4-85d877808c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:15.171411 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d72904-cac7-411b-94d4-85d877808c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:15.172443 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d72904-cac7-411b-94d4-85d877808c98 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:15.172995 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d72904-cac7-411b-94d4-85d877808c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:15.174989 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d72904-cac7-411b-94d4-85d877808c98 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:15.176776 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cd3e7-2160-4663-a5ad-84665ff518e3 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:15.177292 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cd3e7-2160-4663-a5ad-84665ff518e3 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:15.178018 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cd3e7-2160-4663-a5ad-84665ff518e3 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:15.180506 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 112/218] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:15.185974 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 107/219] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:15 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:15.187958 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b15a2-0381-43c6-8ab7-9c901154a708 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:15.188423 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b15a2-0381-43c6-8ab7-9c901154a708 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:15.188835 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b15a2-0381-43c6-8ab7-9c901154a708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:15.192506 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d72904-cac7-411b-94d4-85d877808c98 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:15.206744 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d72904-cac7-411b-94d4-85d877808c98 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:15.212748 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b206499-cb9c-426e-8879-bb34974fd1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:15.212945 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-cd1b15a2-0381-43c6-8ab7-9c901154a708 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:15.214114 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b206499-cb9c-426e-8879-bb34974fd1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:15.214221 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-cd1b15a2-0381-43c6-8ab7-9c901154a708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:15.214688 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b206499-cb9c-426e-8879-bb34974fd1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:15.215265 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b206499-cb9c-426e-8879-bb34974fd1b4 admin admin] PATH_INFO: `/v3/users/46e5cb6237434ea09e85ec2653f4684b` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:15.217061 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b206499-cb9c-426e-8879-bb34974fd1b4 admin admin] RBAC: Authorizing `identity:get_user(user_id=46e5cb6237434ea09e85ec2653f4684b)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:15.219834 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b206499-cb9c-426e-8879-bb34974fd1b4 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:15.222417 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 108/220] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:15 2021] GET /identity/v3/users/46e5cb6237434ea09e85ec2653f4684b => generated 283 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:15.222564 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 113/221] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:15.228916 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b15a2-0381-43c6-8ab7-9c901154a708 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:15.239365 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b15a2-0381-43c6-8ab7-9c901154a708 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:15.244318 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35912d-72ad-4ef0-8070-c4af8899dd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:15.245529 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35912d-72ad-4ef0-8070-c4af8899dd32 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:15.246015 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35912d-72ad-4ef0-8070-c4af8899dd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:15.246505 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35912d-72ad-4ef0-8070-c4af8899dd32 admin admin] PATH_INFO: `/v3/projects/2a96cf65568148549e7ca922f4c5215f` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:15.247942 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b206499-cb9c-426e-8879-bb34974fd1b4 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:15.248660 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe35912d-72ad-4ef0-8070-c4af8899dd32 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a96cf65568148549e7ca922f4c5215f)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:15.251089 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe35912d-72ad-4ef0-8070-c4af8899dd32 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:15.253074 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 114/222] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:15 2021] GET /identity/v3/projects/2a96cf65568148549e7ca922f4c5215f => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:15.259898 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b206499-cb9c-426e-8879-bb34974fd1b4 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:15.260724 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35912d-72ad-4ef0-8070-c4af8899dd32 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:15.264832 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d794838-9c34-4312-9cf9-6584468e9b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:15.265676 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d794838-9c34-4312-9cf9-6584468e9b54 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:15.265959 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d794838-9c34-4312-9cf9-6584468e9b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:15.266286 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d794838-9c34-4312-9cf9-6584468e9b54 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:15.272972 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35912d-72ad-4ef0-8070-c4af8899dd32 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:15.278438 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0cbd1-586c-42a5-ab27-2a001ae73faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:15.279325 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0cbd1-586c-42a5-ab27-2a001ae73faa admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:15.279608 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0cbd1-586c-42a5-ab27-2a001ae73faa admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:15.279724 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d794838-9c34-4312-9cf9-6584468e9b54 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:15.279878 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0cbd1-586c-42a5-ab27-2a001ae73faa admin admin] PATH_INFO: `/v3/projects/2a96cf65568148549e7ca922f4c5215f/users/46e5cb6237434ea09e85ec2653f4684b/roles/d042901298ef4d56b504a30c45128dca` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:15.282141 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0cbd1-586c-42a5-ab27-2a001ae73faa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a96cf65568148549e7ca922f4c5215f, user_id=46e5cb6237434ea09e85ec2653f4684b, role_id=d042901298ef4d56b504a30c45128dca)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:15.285018 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0cbd1-586c-42a5-ab27-2a001ae73faa admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:15.287470 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-2d794838-9c34-4312-9cf9-6584468e9b54 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 15:58:15.288961 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 109/223] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:15 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:15.290472 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839d0bb-1786-417e-8c1f-e29e61a1a190 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:15.290755 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839d0bb-1786-417e-8c1f-e29e61a1a190 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:15.291026 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839d0bb-1786-417e-8c1f-e29e61a1a190 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:15.292916 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 110/224] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:15.298072 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839d0bb-1786-417e-8c1f-e29e61a1a190 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:15.303528 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 115/225] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Dec 15 15:58:15 2021] PUT /identity/v3/projects/2a96cf65568148549e7ca922f4c5215f/users/46e5cb6237434ea09e85ec2653f4684b/roles/d042901298ef4d56b504a30c45128dca => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 15:58:15.304864 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958658d-d680-42e6-bd4c-c66404e0ac33 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:15.305183 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958658d-d680-42e6-bd4c-c66404e0ac33 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:15.305520 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958658d-d680-42e6-bd4c-c66404e0ac33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:15.326291 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-f958658d-d680-42e6-bd4c-c66404e0ac33 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:15.327347 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f958658d-d680-42e6-bd4c-c66404e0ac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:15.388792 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839d0bb-1786-417e-8c1f-e29e61a1a190 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:15.393203 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 116/226] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:15.394615 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2f250-428d-4b03-bd6a-d6a111ed03ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:15.395568 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2f250-428d-4b03-bd6a-d6a111ed03ed admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:15.396073 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2f250-428d-4b03-bd6a-d6a111ed03ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:15.396636 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2f250-428d-4b03-bd6a-d6a111ed03ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:15.397650 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2f250-428d-4b03-bd6a-d6a111ed03ed admin admin] RBAC: Adding query filter params (name=member) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:15.398162 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2f250-428d-4b03-bd6a-d6a111ed03ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:15.401143 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2f250-428d-4b03-bd6a-d6a111ed03ed admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:15.411432 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 111/227] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:15 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:15.418741 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958658d-d680-42e6-bd4c-c66404e0ac33 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:15.420790 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2f250-428d-4b03-bd6a-d6a111ed03ed admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:15.427824 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958658d-d680-42e6-bd4c-c66404e0ac33 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:15.431223 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2f250-428d-4b03-bd6a-d6a111ed03ed admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:15.433522 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1acc38-e9d2-4965-a251-e8e587a8efa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:15.434591 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1acc38-e9d2-4965-a251-e8e587a8efa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:15.434935 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1acc38-e9d2-4965-a251-e8e587a8efa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:15.435320 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1acc38-e9d2-4965-a251-e8e587a8efa6 admin admin] PATH_INFO: `/v3/users/12e24e447dce4c24badcd97414c95e1a` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:15.436281 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3d50f-f436-4a95-b78e-c0348c19d51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:15.437147 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3d50f-f436-4a95-b78e-c0348c19d51c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:15.437525 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3d50f-f436-4a95-b78e-c0348c19d51c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:15.437860 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3d50f-f436-4a95-b78e-c0348c19d51c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:15.439542 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3d50f-f436-4a95-b78e-c0348c19d51c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:15.440946 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3d50f-f436-4a95-b78e-c0348c19d51c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:15.442903 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 112/228] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:15 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:15.449265 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3d50f-f436-4a95-b78e-c0348c19d51c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:15.452690 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1acc38-e9d2-4965-a251-e8e587a8efa6 admin admin] RBAC: Authorizing `identity:get_user(user_id=12e24e447dce4c24badcd97414c95e1a)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:15.455260 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1acc38-e9d2-4965-a251-e8e587a8efa6 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:15.457669 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 117/229] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:15 2021] GET /identity/v3/users/12e24e447dce4c24badcd97414c95e1a => generated 297 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:15.462365 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3d50f-f436-4a95-b78e-c0348c19d51c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:15.465377 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1acc38-e9d2-4965-a251-e8e587a8efa6 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:15.471432 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee028e5-31e3-4b96-a075-8ee26a981836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:15.472416 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee028e5-31e3-4b96-a075-8ee26a981836 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:15.472873 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee028e5-31e3-4b96-a075-8ee26a981836 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:15.473148 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee028e5-31e3-4b96-a075-8ee26a981836 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:15.473937 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee028e5-31e3-4b96-a075-8ee26a981836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:15.475871 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee028e5-31e3-4b96-a075-8ee26a981836 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:15.477352 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1acc38-e9d2-4965-a251-e8e587a8efa6 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:15.482412 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b02bc5-6e56-45c8-a5ae-1a2b621fe6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:15.483529 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b02bc5-6e56-45c8-a5ae-1a2b621fe6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:15.484013 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b02bc5-6e56-45c8-a5ae-1a2b621fe6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:15.484480 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b02bc5-6e56-45c8-a5ae-1a2b621fe6c6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:15.495656 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b02bc5-6e56-45c8-a5ae-1a2b621fe6c6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:15.498225 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b02bc5-6e56-45c8-a5ae-1a2b621fe6c6 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:15.499909 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 113/230] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Dec 15 15:58:15 2021] POST /identity/v3/users => generated 297 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 15:58:15.511046 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 118/231] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:15 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:15.517570 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee028e5-31e3-4b96-a075-8ee26a981836 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:15.528676 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee028e5-31e3-4b96-a075-8ee26a981836 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:15.533883 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c37c3-5862-4833-9b90-ffd11670554a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:15.534857 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c37c3-5862-4833-9b90-ffd11670554a admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:15.535140 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c37c3-5862-4833-9b90-ffd11670554a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:15.535409 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c37c3-5862-4833-9b90-ffd11670554a admin admin] PATH_INFO: `/v3/projects/2a96cf65568148549e7ca922f4c5215f` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:15.536755 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c37c3-5862-4833-9b90-ffd11670554a admin admin] RBAC: Authorizing `identity:get_project(project_id=2a96cf65568148549e7ca922f4c5215f)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:15.539216 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c37c3-5862-4833-9b90-ffd11670554a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:15.541580 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 114/232] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:15 2021] GET /identity/v3/projects/2a96cf65568148549e7ca922f4c5215f => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:15.548270 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b02bc5-6e56-45c8-a5ae-1a2b621fe6c6 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:15.561760 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b02bc5-6e56-45c8-a5ae-1a2b621fe6c6 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:15.567639 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294f00c-0322-4ba1-affb-228ef46f07b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:15.568830 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294f00c-0322-4ba1-affb-228ef46f07b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:15.569422 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294f00c-0322-4ba1-affb-228ef46f07b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:15.569900 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294f00c-0322-4ba1-affb-228ef46f07b1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:15.571690 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294f00c-0322-4ba1-affb-228ef46f07b1 admin admin] RBAC: Adding query filter params (role.id=530f09f883ac47cba230257bcf458141, scope.project.id=2a96cf65568148549e7ca922f4c5215f, user.id=12e24e447dce4c24badcd97414c95e1a) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:15.572239 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294f00c-0322-4ba1-affb-228ef46f07b1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:15.574850 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294f00c-0322-4ba1-affb-228ef46f07b1 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:15.583697 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 119/233] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:15 2021] GET /identity/v3/role_assignments?user.id=12e24e447dce4c24badcd97414c95e1a&scope.project.id=2a96cf65568148549e7ca922f4c5215f&role.id=530f09f883ac47cba230257bcf458141 => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:17.916174 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ed7d8-cea9-44d2-8799-81dd0ab031db None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:17.916723 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ed7d8-cea9-44d2-8799-81dd0ab031db None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:17.916723 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ed7d8-cea9-44d2-8799-81dd0ab031db None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:17.918655 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 115/234] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:17.924692 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e59a36-fb8a-4fdf-b426-22feaed04133 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:17.925121 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e59a36-fb8a-4fdf-b426-22feaed04133 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:17.925316 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e59a36-fb8a-4fdf-b426-22feaed04133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:17.950406 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-34e59a36-fb8a-4fdf-b426-22feaed04133 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:17.951610 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-34e59a36-fb8a-4fdf-b426-22feaed04133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:17.959702 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 120/235] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:18.006856 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ed7d8-cea9-44d2-8799-81dd0ab031db None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:18.022857 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ed7d8-cea9-44d2-8799-81dd0ab031db None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:18.028323 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f0b63-df00-4c2e-a803-3351d96d0473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:18.029091 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f0b63-df00-4c2e-a803-3351d96d0473 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.029369 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f0b63-df00-4c2e-a803-3351d96d0473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.029667 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f0b63-df00-4c2e-a803-3351d96d0473 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.050118 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f0b63-df00-4c2e-a803-3351d96d0473 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:18.057209 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-f60f0b63-df00-4c2e-a803-3351d96d0473 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 15:58:18.058524 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 116/236] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:58:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:18.064976 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e59a36-fb8a-4fdf-b426-22feaed04133 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:18.078748 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e59a36-fb8a-4fdf-b426-22feaed04133 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:18.089275 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da91e6-3ea7-4a45-889d-9327f2cc8aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:18.090247 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da91e6-3ea7-4a45-889d-9327f2cc8aaa admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.090529 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da91e6-3ea7-4a45-889d-9327f2cc8aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.090799 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da91e6-3ea7-4a45-889d-9327f2cc8aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.091562 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da91e6-3ea7-4a45-889d-9327f2cc8aaa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:18.091864 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da91e6-3ea7-4a45-889d-9327f2cc8aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:18.093499 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da91e6-3ea7-4a45-889d-9327f2cc8aaa admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:18.105234 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 121/237] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:18.111456 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f0b63-df00-4c2e-a803-3351d96d0473 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:18.128725 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f0b63-df00-4c2e-a803-3351d96d0473 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:18.133243 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d469538-500d-4c29-b03f-a00254b1713a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:18.134665 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d469538-500d-4c29-b03f-a00254b1713a admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.134928 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d469538-500d-4c29-b03f-a00254b1713a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.135192 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d469538-500d-4c29-b03f-a00254b1713a admin admin] PATH_INFO: `/v3/users/46e5cb6237434ea09e85ec2653f4684b` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.138205 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d469538-500d-4c29-b03f-a00254b1713a admin admin] RBAC: Authorizing `identity:get_user(user_id=46e5cb6237434ea09e85ec2653f4684b)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:18.140379 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d469538-500d-4c29-b03f-a00254b1713a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:18.142218 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 117/238] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:18 2021] GET /identity/v3/users/46e5cb6237434ea09e85ec2653f4684b => generated 283 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:18.148424 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da91e6-3ea7-4a45-889d-9327f2cc8aaa admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:18.162327 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da91e6-3ea7-4a45-889d-9327f2cc8aaa admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:18.169329 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e7eb7-0aac-4daa-b41c-be6f3670a4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:18.169936 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e7eb7-0aac-4daa-b41c-be6f3670a4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.170214 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e7eb7-0aac-4daa-b41c-be6f3670a4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.170482 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e7eb7-0aac-4daa-b41c-be6f3670a4a2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.183918 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e7eb7-0aac-4daa-b41c-be6f3670a4a2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:18.185839 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e7eb7-0aac-4daa-b41c-be6f3670a4a2 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:18.193050 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe42e09-2c98-4f21-8baa-c825e9c906eb None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.193339 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe42e09-2c98-4f21-8baa-c825e9c906eb None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.193667 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe42e09-2c98-4f21-8baa-c825e9c906eb None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.195684 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 118/239] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:18.198407 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 122/240] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:18 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:18.204239 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef313e-3dc0-4c61-9fc2-cb7df2bc003e None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.204476 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e7eb7-0aac-4daa-b41c-be6f3670a4a2 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:18.204727 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef313e-3dc0-4c61-9fc2-cb7df2bc003e None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.205121 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef313e-3dc0-4c61-9fc2-cb7df2bc003e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.216064 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e7eb7-0aac-4daa-b41c-be6f3670a4a2 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:18.232160 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f381940-e568-4821-82b8-38c8ed274873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:18.233021 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f381940-e568-4821-82b8-38c8ed274873 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.233294 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f381940-e568-4821-82b8-38c8ed274873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.233594 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f381940-e568-4821-82b8-38c8ed274873 admin admin] PATH_INFO: `/v3/projects/2a96cf65568148549e7ca922f4c5215f` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.237927 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f381940-e568-4821-82b8-38c8ed274873 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a96cf65568148549e7ca922f4c5215f)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:18.240015 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f381940-e568-4821-82b8-38c8ed274873 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:18.241831 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 123/241] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:18 2021] GET /identity/v3/projects/2a96cf65568148549e7ca922f4c5215f => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:18.242969 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-c7ef313e-3dc0-4c61-9fc2-cb7df2bc003e None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:18.244221 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-c7ef313e-3dc0-4c61-9fc2-cb7df2bc003e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:18.254271 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f381940-e568-4821-82b8-38c8ed274873 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:18.256110 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 119/242] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:18.271050 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f381940-e568-4821-82b8-38c8ed274873 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:18.281932 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ece9b-13cd-4aa5-ae9e-49fddfc6d924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:18.282604 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ece9b-13cd-4aa5-ae9e-49fddfc6d924 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.282887 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ece9b-13cd-4aa5-ae9e-49fddfc6d924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.283161 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ece9b-13cd-4aa5-ae9e-49fddfc6d924 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.284027 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ece9b-13cd-4aa5-ae9e-49fddfc6d924 admin admin] RBAC: Adding query filter params (role.id=bc362f875c6d4cee83ba65b8d134462d, scope.project.id=2a96cf65568148549e7ca922f4c5215f, user.id=46e5cb6237434ea09e85ec2653f4684b) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:18.284338 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ece9b-13cd-4aa5-ae9e-49fddfc6d924 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:18.286266 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ece9b-13cd-4aa5-ae9e-49fddfc6d924 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:18.297362 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 124/243] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:18 2021] GET /identity/v3/role_assignments?user.id=46e5cb6237434ea09e85ec2653f4684b&scope.project.id=2a96cf65568148549e7ca922f4c5215f&role.id=bc362f875c6d4cee83ba65b8d134462d => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:18.298998 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef313e-3dc0-4c61-9fc2-cb7df2bc003e None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:18.313073 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef313e-3dc0-4c61-9fc2-cb7df2bc003e None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:18.317837 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510696c6-87be-47b4-9281-c0c4d0139bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:18.318822 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510696c6-87be-47b4-9281-c0c4d0139bca admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.319248 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510696c6-87be-47b4-9281-c0c4d0139bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.319663 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510696c6-87be-47b4-9281-c0c4d0139bca admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.346634 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510696c6-87be-47b4-9281-c0c4d0139bca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:18.355165 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-510696c6-87be-47b4-9281-c0c4d0139bca admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 15:58:18.361632 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 120/244] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Dec 15 15:58:18 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:18.362873 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ece9b-13cd-4aa5-ae9e-49fddfc6d924 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:18.389229 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ece9b-13cd-4aa5-ae9e-49fddfc6d924 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:18.407826 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7cb51-e8e6-4a70-b672-68ef1961d543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:18.408523 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7cb51-e8e6-4a70-b672-68ef1961d543 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.408805 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7cb51-e8e6-4a70-b672-68ef1961d543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.409080 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7cb51-e8e6-4a70-b672-68ef1961d543 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.409895 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7cb51-e8e6-4a70-b672-68ef1961d543 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:18.410202 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7cb51-e8e6-4a70-b672-68ef1961d543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:18.411863 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7cb51-e8e6-4a70-b672-68ef1961d543 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:18.425308 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e379f-9150-43ff-94f6-5ac77f170007 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.426099 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e379f-9150-43ff-94f6-5ac77f170007 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.426689 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e379f-9150-43ff-94f6-5ac77f170007 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.428517 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 125/245] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:18 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:18.428952 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 121/246] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:58:18.434612 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7cb51-e8e6-4a70-b672-68ef1961d543 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:18.439420 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d40cae-ba52-4535-be00-98c8f9ac864f None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.440228 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d40cae-ba52-4535-be00-98c8f9ac864f None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.440715 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d40cae-ba52-4535-be00-98c8f9ac864f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.447899 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7cb51-e8e6-4a70-b672-68ef1961d543 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:18.457939 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abbf81-69ff-4a12-a99b-619f3d417207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:18.460751 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abbf81-69ff-4a12-a99b-619f3d417207 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.461268 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abbf81-69ff-4a12-a99b-619f3d417207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.462436 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abbf81-69ff-4a12-a99b-619f3d417207 admin admin] PATH_INFO: `/v3/users/46e5cb6237434ea09e85ec2653f4684b` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.465561 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abbf81-69ff-4a12-a99b-619f3d417207 admin admin] RBAC: Authorizing `identity:get_user(user_id=46e5cb6237434ea09e85ec2653f4684b)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:18.468191 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abbf81-69ff-4a12-a99b-619f3d417207 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:18.474308 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-00d40cae-ba52-4535-be00-98c8f9ac864f None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:18.476255 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-00d40cae-ba52-4535-be00-98c8f9ac864f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:18.476492 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 126/247] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:18 2021] GET /identity/v3/users/46e5cb6237434ea09e85ec2653f4684b => generated 283 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:18.479844 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abbf81-69ff-4a12-a99b-619f3d417207 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:18.496600 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abbf81-69ff-4a12-a99b-619f3d417207 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:18.498393 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 122/248] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:58:18.509685 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7508016-e9ea-44b4-8f75-48fc89cafece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:18.510679 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7508016-e9ea-44b4-8f75-48fc89cafece admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.511166 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7508016-e9ea-44b4-8f75-48fc89cafece admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.511640 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7508016-e9ea-44b4-8f75-48fc89cafece admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.525427 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d40cae-ba52-4535-be00-98c8f9ac864f None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:18.525611 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7508016-e9ea-44b4-8f75-48fc89cafece admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:18.525611 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7508016-e9ea-44b4-8f75-48fc89cafece admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:18.531305 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d40cae-ba52-4535-be00-98c8f9ac864f None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:18.537313 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d99d9e-1a5a-42bf-a812-c6c60d429484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:18.538381 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d99d9e-1a5a-42bf-a812-c6c60d429484 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.540299 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d99d9e-1a5a-42bf-a812-c6c60d429484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.540605 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d99d9e-1a5a-42bf-a812-c6c60d429484 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.544513 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 127/249] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:18 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:18.554582 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7508016-e9ea-44b4-8f75-48fc89cafece admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:18.569464 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7508016-e9ea-44b4-8f75-48fc89cafece admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:18.571233 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d99d9e-1a5a-42bf-a812-c6c60d429484 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:18.580190 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-58d99d9e-1a5a-42bf-a812-c6c60d429484 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 15:58:18.581763 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 123/250] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:18 2021] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:18.587815 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcdbf6-04c3-42c7-8ca5-925234b9dba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:18.588682 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcdbf6-04c3-42c7-8ca5-925234b9dba9 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.588859 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d99d9e-1a5a-42bf-a812-c6c60d429484 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:18.588977 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcdbf6-04c3-42c7-8ca5-925234b9dba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.589220 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcdbf6-04c3-42c7-8ca5-925234b9dba9 admin admin] PATH_INFO: `/v3/projects/2a96cf65568148549e7ca922f4c5215f` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.590800 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcdbf6-04c3-42c7-8ca5-925234b9dba9 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a96cf65568148549e7ca922f4c5215f)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:18.592857 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcdbf6-04c3-42c7-8ca5-925234b9dba9 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:18.594620 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 128/251] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:18 2021] GET /identity/v3/projects/2a96cf65568148549e7ca922f4c5215f => generated 302 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:18.602917 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcdbf6-04c3-42c7-8ca5-925234b9dba9 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:18.607494 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d99d9e-1a5a-42bf-a812-c6c60d429484 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:18.619504 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcdbf6-04c3-42c7-8ca5-925234b9dba9 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:18.622002 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a7373-9ac2-4855-85dd-86c954d3b528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:18.622668 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a7373-9ac2-4855-85dd-86c954d3b528 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.622945 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a7373-9ac2-4855-85dd-86c954d3b528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.623216 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a7373-9ac2-4855-85dd-86c954d3b528 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.623976 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a7373-9ac2-4855-85dd-86c954d3b528 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:18.624280 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a7373-9ac2-4855-85dd-86c954d3b528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:18.625921 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a7373-9ac2-4855-85dd-86c954d3b528 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:18.628249 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fa14c-f874-4cff-b6c8-76df61486ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:18.629132 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fa14c-f874-4cff-b6c8-76df61486ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.630388 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fa14c-f874-4cff-b6c8-76df61486ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.630870 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fa14c-f874-4cff-b6c8-76df61486ae8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.631935 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fa14c-f874-4cff-b6c8-76df61486ae8 admin admin] RBAC: Adding query filter params (role.id=d042901298ef4d56b504a30c45128dca, scope.project.id=2a96cf65568148549e7ca922f4c5215f, user.id=46e5cb6237434ea09e85ec2653f4684b) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:18.632465 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fa14c-f874-4cff-b6c8-76df61486ae8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:18.635169 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fa14c-f874-4cff-b6c8-76df61486ae8 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:18.635726 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 124/252] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:18 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:18.641725 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a7373-9ac2-4855-85dd-86c954d3b528 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:18.642586 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 129/253] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:18 2021] GET /identity/v3/role_assignments?user.id=46e5cb6237434ea09e85ec2653f4684b&scope.project.id=2a96cf65568148549e7ca922f4c5215f&role.id=d042901298ef4d56b504a30c45128dca => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:18.657362 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a7373-9ac2-4855-85dd-86c954d3b528 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:18.662211 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e4fa5-e903-495c-8b44-720e1e598b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:18.663144 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e4fa5-e903-495c-8b44-720e1e598b4f admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.663424 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e4fa5-e903-495c-8b44-720e1e598b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.663959 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e4fa5-e903-495c-8b44-720e1e598b4f admin admin] PATH_INFO: `/v3/users/12e24e447dce4c24badcd97414c95e1a` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.665914 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e4fa5-e903-495c-8b44-720e1e598b4f admin admin] RBAC: Authorizing `identity:get_user(user_id=12e24e447dce4c24badcd97414c95e1a)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:18.668210 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e4fa5-e903-495c-8b44-720e1e598b4f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:18.670068 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 125/254] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:18 2021] GET /identity/v3/users/12e24e447dce4c24badcd97414c95e1a => generated 297 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:18.676482 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fa14c-f874-4cff-b6c8-76df61486ae8 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:18.684376 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a542738-569c-43fd-8cec-a45be7f2dc98 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.684668 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a542738-569c-43fd-8cec-a45be7f2dc98 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.684944 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a542738-569c-43fd-8cec-a45be7f2dc98 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.686962 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 126/255] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:58:18.689031 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fa14c-f874-4cff-b6c8-76df61486ae8 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:18.692981 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87846d1-e530-4b38-a0e8-207075a50f8c None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.693263 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87846d1-e530-4b38-a0e8-207075a50f8c None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.693576 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87846d1-e530-4b38-a0e8-207075a50f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.694705 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414970ff-3224-4413-ab8d-741cc922a516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:18.695796 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414970ff-3224-4413-ab8d-741cc922a516 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.696882 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414970ff-3224-4413-ab8d-741cc922a516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.697349 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414970ff-3224-4413-ab8d-741cc922a516 admin admin] PATH_INFO: `/v3/projects/2a96cf65568148549e7ca922f4c5215f` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.698954 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414970ff-3224-4413-ab8d-741cc922a516 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a96cf65568148549e7ca922f4c5215f)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:18.701403 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414970ff-3224-4413-ab8d-741cc922a516 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:18.703504 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 130/256] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:18 2021] GET /identity/v3/projects/2a96cf65568148549e7ca922f4c5215f => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:18.710331 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414970ff-3224-4413-ab8d-741cc922a516 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:18.722797 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-e87846d1-e530-4b38-a0e8-207075a50f8c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:18.724011 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-e87846d1-e530-4b38-a0e8-207075a50f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:18.728038 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414970ff-3224-4413-ab8d-741cc922a516 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:18.735010 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70b064-0daa-4697-8cf0-281acb6523d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:18.735929 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70b064-0daa-4697-8cf0-281acb6523d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.736209 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70b064-0daa-4697-8cf0-281acb6523d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.736484 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70b064-0daa-4697-8cf0-281acb6523d0 admin admin] PATH_INFO: `/v3/projects/2a96cf65568148549e7ca922f4c5215f/users/12e24e447dce4c24badcd97414c95e1a/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.740454 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70b064-0daa-4697-8cf0-281acb6523d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a96cf65568148549e7ca922f4c5215f, user_id=12e24e447dce4c24badcd97414c95e1a, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:18.743742 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70b064-0daa-4697-8cf0-281acb6523d0 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:18.745104 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 127/257] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:58:18.748343 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125e6b1-5186-4989-a98a-feedbb38c1eb None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.748874 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125e6b1-5186-4989-a98a-feedbb38c1eb None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.749426 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125e6b1-5186-4989-a98a-feedbb38c1eb None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.752577 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 128/258] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:18.763798 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d3fef-b26b-4a03-bb63-6100885b0fd5 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.764608 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d3fef-b26b-4a03-bb63-6100885b0fd5 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.765110 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d3fef-b26b-4a03-bb63-6100885b0fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.766591 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 131/259] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Dec 15 15:58:18 2021] PUT /identity/v3/projects/2a96cf65568148549e7ca922f4c5215f/users/12e24e447dce4c24badcd97414c95e1a/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 15:58:18.772646 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70b064-0daa-4697-8cf0-281acb6523d0 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:18.792422 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-208d3fef-b26b-4a03-bb63-6100885b0fd5 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:18.793705 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-208d3fef-b26b-4a03-bb63-6100885b0fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:18.851998 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70b064-0daa-4697-8cf0-281acb6523d0 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:18.858231 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141d41d-7d9d-40b4-9cd5-b1c4877e2812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:18.859049 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141d41d-7d9d-40b4-9cd5-b1c4877e2812 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.859329 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141d41d-7d9d-40b4-9cd5-b1c4877e2812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.859603 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141d41d-7d9d-40b4-9cd5-b1c4877e2812 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.876968 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141d41d-7d9d-40b4-9cd5-b1c4877e2812 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:18.880060 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 129/260] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:58:18.889173 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-c141d41d-7d9d-40b4-9cd5-b1c4877e2812 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 15:58:18.889173 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 132/261] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:18 2021] GET /identity/v3/roles/reader => generated 84 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:18.893356 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d3fef-b26b-4a03-bb63-6100885b0fd5 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:18.903524 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d3fef-b26b-4a03-bb63-6100885b0fd5 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:18.908334 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354b0f7-745a-4f20-ba07-36176dd1f197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:18.909083 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354b0f7-745a-4f20-ba07-36176dd1f197 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.909368 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354b0f7-745a-4f20-ba07-36176dd1f197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.909671 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354b0f7-745a-4f20-ba07-36176dd1f197 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.910523 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354b0f7-745a-4f20-ba07-36176dd1f197 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:18.910833 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354b0f7-745a-4f20-ba07-36176dd1f197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:18.912898 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354b0f7-745a-4f20-ba07-36176dd1f197 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:18.913779 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141d41d-7d9d-40b4-9cd5-b1c4877e2812 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:18.923517 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 130/262] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:18 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:18.927232 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141d41d-7d9d-40b4-9cd5-b1c4877e2812 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:18.929733 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354b0f7-745a-4f20-ba07-36176dd1f197 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:18.933743 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe59c70-ca20-40c9-ae7f-148937b3d317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:18.934677 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe59c70-ca20-40c9-ae7f-148937b3d317 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.935069 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe59c70-ca20-40c9-ae7f-148937b3d317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.935446 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe59c70-ca20-40c9-ae7f-148937b3d317 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.937481 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe59c70-ca20-40c9-ae7f-148937b3d317 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:18.939332 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe59c70-ca20-40c9-ae7f-148937b3d317 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:18.941293 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 133/263] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:18.941458 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354b0f7-745a-4f20-ba07-36176dd1f197 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:18.948050 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe59c70-ca20-40c9-ae7f-148937b3d317 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:18.956518 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413734c-12de-4e16-960a-1d500a5a3e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:18.957808 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413734c-12de-4e16-960a-1d500a5a3e3e admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.958299 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413734c-12de-4e16-960a-1d500a5a3e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.958845 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413734c-12de-4e16-960a-1d500a5a3e3e admin admin] PATH_INFO: `/v3/users/4adf8b78475e460588586180e6c2b04b` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.959922 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe59c70-ca20-40c9-ae7f-148937b3d317 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:18.965545 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f5fa7-7f19-4dd7-a9dc-1992d438452b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:18.966218 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f5fa7-7f19-4dd7-a9dc-1992d438452b admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:18.966556 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f5fa7-7f19-4dd7-a9dc-1992d438452b admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:18.966839 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f5fa7-7f19-4dd7-a9dc-1992d438452b admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:18.967590 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f5fa7-7f19-4dd7-a9dc-1992d438452b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:18.969579 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f5fa7-7f19-4dd7-a9dc-1992d438452b admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:18.979399 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413734c-12de-4e16-960a-1d500a5a3e3e admin admin] RBAC: Authorizing `identity:get_user(user_id=4adf8b78475e460588586180e6c2b04b)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:18.982615 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413734c-12de-4e16-960a-1d500a5a3e3e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:18.985055 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 131/264] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:18 2021] GET /identity/v3/users/4adf8b78475e460588586180e6c2b04b => generated 297 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:18.992504 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413734c-12de-4e16-960a-1d500a5a3e3e admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:18.996398 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 134/265] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Dec 15 15:58:18 2021] POST /identity/v3/users => generated 293 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:58:19.004452 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413734c-12de-4e16-960a-1d500a5a3e3e admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:19.010154 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca492d-5d78-48a9-991f-1b76f4b0a8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:19.010888 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca492d-5d78-48a9-991f-1b76f4b0a8fc admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:19.011233 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca492d-5d78-48a9-991f-1b76f4b0a8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:19.011508 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca492d-5d78-48a9-991f-1b76f4b0a8fc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:19.021241 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca492d-5d78-48a9-991f-1b76f4b0a8fc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:19.023290 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca492d-5d78-48a9-991f-1b76f4b0a8fc admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:19.034969 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 132/266] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:18 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:19.042265 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f5fa7-7f19-4dd7-a9dc-1992d438452b admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:19.056778 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f5fa7-7f19-4dd7-a9dc-1992d438452b admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:19.061840 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579ccd2-bfcb-4f82-b25c-bf71c1de783e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:19.062713 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579ccd2-bfcb-4f82-b25c-bf71c1de783e admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:19.062998 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579ccd2-bfcb-4f82-b25c-bf71c1de783e admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:19.063275 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579ccd2-bfcb-4f82-b25c-bf71c1de783e admin admin] PATH_INFO: `/v3/projects/2a96cf65568148549e7ca922f4c5215f` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:19.064583 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579ccd2-bfcb-4f82-b25c-bf71c1de783e admin admin] RBAC: Authorizing `identity:get_project(project_id=2a96cf65568148549e7ca922f4c5215f)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:19.066737 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579ccd2-bfcb-4f82-b25c-bf71c1de783e admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:19.068537 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 135/267] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:19 2021] GET /identity/v3/projects/2a96cf65568148549e7ca922f4c5215f => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:19.075331 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca492d-5d78-48a9-991f-1b76f4b0a8fc admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:19.085247 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca492d-5d78-48a9-991f-1b76f4b0a8fc admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:19.090004 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df58c9-19e7-4f8e-88b4-e4d4e543951f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:19.090669 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df58c9-19e7-4f8e-88b4-e4d4e543951f admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:19.090952 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df58c9-19e7-4f8e-88b4-e4d4e543951f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:19.091221 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df58c9-19e7-4f8e-88b4-e4d4e543951f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:19.092135 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df58c9-19e7-4f8e-88b4-e4d4e543951f admin admin] RBAC: Adding query filter params (role.id=e50f3b500f664b279fa7bd9f661f9dfb, scope.project.id=2a96cf65568148549e7ca922f4c5215f, user.id=4adf8b78475e460588586180e6c2b04b) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:19.092395 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df58c9-19e7-4f8e-88b4-e4d4e543951f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:19.094380 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df58c9-19e7-4f8e-88b4-e4d4e543951f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:19.102726 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 133/268] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:19 2021] GET /identity/v3/role_assignments?user.id=4adf8b78475e460588586180e6c2b04b&scope.project.id=2a96cf65568148549e7ca922f4c5215f&role.id=e50f3b500f664b279fa7bd9f661f9dfb => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:21.250662 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114273f-707e-408e-bf0d-ade67da46fc1 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:21.251174 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114273f-707e-408e-bf0d-ade67da46fc1 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:21.251174 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114273f-707e-408e-bf0d-ade67da46fc1 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:21.252952 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 136/269] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:21.259414 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0d83b-c4bb-4305-bc6f-a01e88c00ca2 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:21.259874 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0d83b-c4bb-4305-bc6f-a01e88c00ca2 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:21.260162 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0d83b-c4bb-4305-bc6f-a01e88c00ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:21.279233 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-dbe0d83b-c4bb-4305-bc6f-a01e88c00ca2 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:21.280427 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-dbe0d83b-c4bb-4305-bc6f-a01e88c00ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:21.288436 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 134/270] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:58:21.313305 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114273f-707e-408e-bf0d-ade67da46fc1 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:21.325832 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114273f-707e-408e-bf0d-ade67da46fc1 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:21.330122 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b159a4-1fbb-4e63-ba8f-4d8b01a4e00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:21.330892 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b159a4-1fbb-4e63-ba8f-4d8b01a4e00d admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:21.331170 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b159a4-1fbb-4e63-ba8f-4d8b01a4e00d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:21.331437 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b159a4-1fbb-4e63-ba8f-4d8b01a4e00d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:21.342000 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b159a4-1fbb-4e63-ba8f-4d8b01a4e00d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:21.348854 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-28b159a4-1fbb-4e63-ba8f-4d8b01a4e00d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 15:58:21.350243 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 137/271] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:21 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:21.357077 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0d83b-c4bb-4305-bc6f-a01e88c00ca2 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:21.366249 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0d83b-c4bb-4305-bc6f-a01e88c00ca2 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:21.371308 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d429ef-b921-49db-afad-da07aa9ac4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:21.371960 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d429ef-b921-49db-afad-da07aa9ac4fd admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:21.372243 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d429ef-b921-49db-afad-da07aa9ac4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:21.372516 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d429ef-b921-49db-afad-da07aa9ac4fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:21.373271 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d429ef-b921-49db-afad-da07aa9ac4fd admin admin] RBAC: Adding query filter params (name=member) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:21.373611 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d429ef-b921-49db-afad-da07aa9ac4fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:21.375212 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d429ef-b921-49db-afad-da07aa9ac4fd admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:21.388113 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 135/272] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:21 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:21.394045 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b159a4-1fbb-4e63-ba8f-4d8b01a4e00d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:21.404463 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b159a4-1fbb-4e63-ba8f-4d8b01a4e00d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:21.408886 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a6b8a-abe6-4e1e-ab81-02ffb9e2d0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:21.409763 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a6b8a-abe6-4e1e-ab81-02ffb9e2d0fb admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:21.410046 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a6b8a-abe6-4e1e-ab81-02ffb9e2d0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:21.410325 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a6b8a-abe6-4e1e-ab81-02ffb9e2d0fb admin admin] PATH_INFO: `/v3/users/12e24e447dce4c24badcd97414c95e1a` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:21.411535 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a6b8a-abe6-4e1e-ab81-02ffb9e2d0fb admin admin] RBAC: Authorizing `identity:get_user(user_id=12e24e447dce4c24badcd97414c95e1a)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:21.415962 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a6b8a-abe6-4e1e-ab81-02ffb9e2d0fb admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:21.417607 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 138/273] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:21 2021] GET /identity/v3/users/12e24e447dce4c24badcd97414c95e1a => generated 297 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:21.423813 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d429ef-b921-49db-afad-da07aa9ac4fd admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:21.434146 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d429ef-b921-49db-afad-da07aa9ac4fd admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:21.438569 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da150c-56a6-4ac8-b0ab-dc77e6aed019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:21.439210 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da150c-56a6-4ac8-b0ab-dc77e6aed019 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:21.439494 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da150c-56a6-4ac8-b0ab-dc77e6aed019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:21.439773 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da150c-56a6-4ac8-b0ab-dc77e6aed019 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:21.448332 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da150c-56a6-4ac8-b0ab-dc77e6aed019 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:21.450143 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da150c-56a6-4ac8-b0ab-dc77e6aed019 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:21.459850 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 136/274] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:21 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:21.466363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a6b8a-abe6-4e1e-ab81-02ffb9e2d0fb admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:21.476597 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a6b8a-abe6-4e1e-ab81-02ffb9e2d0fb admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:21.481789 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef4747-4be0-48cb-8461-074bc78c32f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:21.482625 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef4747-4be0-48cb-8461-074bc78c32f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:21.482911 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef4747-4be0-48cb-8461-074bc78c32f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:21.483190 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef4747-4be0-48cb-8461-074bc78c32f0 admin admin] PATH_INFO: `/v3/projects/2a96cf65568148549e7ca922f4c5215f` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:21.484386 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef4747-4be0-48cb-8461-074bc78c32f0 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a96cf65568148549e7ca922f4c5215f)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:21.486492 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef4747-4be0-48cb-8461-074bc78c32f0 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:21.488301 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 139/275] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:21 2021] GET /identity/v3/projects/2a96cf65568148549e7ca922f4c5215f => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:21.494526 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da150c-56a6-4ac8-b0ab-dc77e6aed019 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:21.503219 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5cdb3-f517-4174-86ce-a56f96c90f2b None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:21.503729 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da150c-56a6-4ac8-b0ab-dc77e6aed019 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:21.503991 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5cdb3-f517-4174-86ce-a56f96c90f2b None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:21.504462 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5cdb3-f517-4174-86ce-a56f96c90f2b None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:21.506717 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 140/276] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:21.508288 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbaafc-7489-40c4-9b8e-5bc09328671e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:21.508905 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbaafc-7489-40c4-9b8e-5bc09328671e admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:21.509177 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbaafc-7489-40c4-9b8e-5bc09328671e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:21.509593 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbaafc-7489-40c4-9b8e-5bc09328671e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:21.510442 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dbaafc-7489-40c4-9b8e-5bc09328671e admin admin] RBAC: Adding query filter params (role.id=530f09f883ac47cba230257bcf458141, scope.project.id=2a96cf65568148549e7ca922f4c5215f, user.id=12e24e447dce4c24badcd97414c95e1a) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:21.510756 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dbaafc-7489-40c4-9b8e-5bc09328671e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:21.512897 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dbaafc-7489-40c4-9b8e-5bc09328671e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:21.514158 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addff85b-87de-4743-9024-5d4eaf3b5f6c None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:21.514663 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addff85b-87de-4743-9024-5d4eaf3b5f6c None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:21.515128 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addff85b-87de-4743-9024-5d4eaf3b5f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:21.519705 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 137/277] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:21 2021] GET /identity/v3/role_assignments?user.id=12e24e447dce4c24badcd97414c95e1a&scope.project.id=2a96cf65568148549e7ca922f4c5215f&role.id=530f09f883ac47cba230257bcf458141 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:21.539122 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-addff85b-87de-4743-9024-5d4eaf3b5f6c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:21.541376 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-addff85b-87de-4743-9024-5d4eaf3b5f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:21.549536 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 141/278] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:58:21.573072 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbaafc-7489-40c4-9b8e-5bc09328671e admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:21.587658 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbaafc-7489-40c4-9b8e-5bc09328671e admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:21.592420 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb7913-7b3e-4474-b84a-d5b047ed5bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:21.593236 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb7913-7b3e-4474-b84a-d5b047ed5bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:21.593556 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb7913-7b3e-4474-b84a-d5b047ed5bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:21.593831 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb7913-7b3e-4474-b84a-d5b047ed5bd3 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:21.597505 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8653411-5ed2-4f7f-9474-6bb5b8489433 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:21.597810 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8653411-5ed2-4f7f-9474-6bb5b8489433 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:21.598066 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8653411-5ed2-4f7f-9474-6bb5b8489433 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:21.599971 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 142/279] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:58:21.601184 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be9f50-1753-4ed0-841b-da6bb162e867 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:21.601492 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be9f50-1753-4ed0-841b-da6bb162e867 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:21.601771 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be9f50-1753-4ed0-841b-da6bb162e867 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:21.604056 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 143/280] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:21.607367 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb7913-7b3e-4474-b84a-d5b047ed5bd3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:21.610632 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a328f8-c8ab-4603-ba56-426e753bafb5 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:21.610917 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a328f8-c8ab-4603-ba56-426e753bafb5 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:21.611192 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a328f8-c8ab-4603-ba56-426e753bafb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:21.614525 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-f9cb7913-7b3e-4474-b84a-d5b047ed5bd3 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 15:58:21.615774 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 138/281] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:21 2021] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:21.616989 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f284c-e43d-441e-b105-99a5e38fca08 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:21.617276 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f284c-e43d-441e-b105-99a5e38fca08 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:21.617585 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f284c-e43d-441e-b105-99a5e38fca08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:21.630152 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-a8a328f8-c8ab-4603-ba56-426e753bafb5 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:21.631368 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-a8a328f8-c8ab-4603-ba56-426e753bafb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:21.638891 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-7d9f284c-e43d-441e-b105-99a5e38fca08 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:21.640240 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-7d9f284c-e43d-441e-b105-99a5e38fca08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:21.641118 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 144/282] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:21.641655 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a328f8-c8ab-4603-ba56-426e753bafb5 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:21.650484 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 139/283] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:21.653504 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a328f8-c8ab-4603-ba56-426e753bafb5 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:21.661544 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f0bee-dcf1-480c-ad99-3556be00159a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:21.662683 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f0bee-dcf1-480c-ad99-3556be00159a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:21.663183 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f0bee-dcf1-480c-ad99-3556be00159a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:21.663647 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f0bee-dcf1-480c-ad99-3556be00159a admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:21.664948 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f0bee-dcf1-480c-ad99-3556be00159a admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:21.665543 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f0bee-dcf1-480c-ad99-3556be00159a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:21.667424 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f0bee-dcf1-480c-ad99-3556be00159a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:21.670254 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f284c-e43d-441e-b105-99a5e38fca08 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:21.678828 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 145/284] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:21 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:21.680013 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f0bee-dcf1-480c-ad99-3556be00159a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:21.681909 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f284c-e43d-441e-b105-99a5e38fca08 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:21.686483 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c054536-1303-4ea1-a91d-47e9a6bf2d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:21.687294 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c054536-1303-4ea1-a91d-47e9a6bf2d0c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:21.687582 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c054536-1303-4ea1-a91d-47e9a6bf2d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:21.687860 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c054536-1303-4ea1-a91d-47e9a6bf2d0c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:21.689066 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c054536-1303-4ea1-a91d-47e9a6bf2d0c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:21.690842 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c054536-1303-4ea1-a91d-47e9a6bf2d0c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:21.692494 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 140/285] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:21.693228 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f0bee-dcf1-480c-ad99-3556be00159a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:21.698427 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8c89e-16c3-470d-89f8-8854a6f9aea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:21.698603 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c054536-1303-4ea1-a91d-47e9a6bf2d0c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:21.699600 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8c89e-16c3-470d-89f8-8854a6f9aea9 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:21.700094 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8c89e-16c3-470d-89f8-8854a6f9aea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:21.700550 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8c89e-16c3-470d-89f8-8854a6f9aea9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:21.708448 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c054536-1303-4ea1-a91d-47e9a6bf2d0c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:21.713127 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8c89e-16c3-470d-89f8-8854a6f9aea9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:21.713530 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831b77d-707f-4699-b58c-d300e67840a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:21.714395 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831b77d-707f-4699-b58c-d300e67840a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:21.714680 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831b77d-707f-4699-b58c-d300e67840a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:21.714954 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831b77d-707f-4699-b58c-d300e67840a4 admin admin] PATH_INFO: `/v3/users/4adf8b78475e460588586180e6c2b04b` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:21.716196 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831b77d-707f-4699-b58c-d300e67840a4 admin admin] RBAC: Authorizing `identity:get_user(user_id=4adf8b78475e460588586180e6c2b04b)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:21.718419 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831b77d-707f-4699-b58c-d300e67840a4 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:21.720249 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 141/286] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:21 2021] GET /identity/v3/users/4adf8b78475e460588586180e6c2b04b => generated 297 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:21.720828 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831b77d-707f-4699-b58c-d300e67840a4 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:21.722330 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-a8e8c89e-16c3-470d-89f8-8854a6f9aea9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 15:58:21.723705 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 146/287] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:21 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:21.729181 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8c89e-16c3-470d-89f8-8854a6f9aea9 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:21.736037 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831b77d-707f-4699-b58c-d300e67840a4 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:21.739679 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8c89e-16c3-470d-89f8-8854a6f9aea9 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:21.740748 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a5386-7baa-4737-a7b5-b89e19ab450e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:21.741517 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a5386-7baa-4737-a7b5-b89e19ab450e admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:21.741854 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a5386-7baa-4737-a7b5-b89e19ab450e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:21.742126 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a5386-7baa-4737-a7b5-b89e19ab450e admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:21.742919 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a5386-7baa-4737-a7b5-b89e19ab450e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:21.744201 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc4e1e-a4c8-4ed3-8038-cf2ecc0b67c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:21.745053 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc4e1e-a4c8-4ed3-8038-cf2ecc0b67c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:21.745316 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a5386-7baa-4737-a7b5-b89e19ab450e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:21.745428 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc4e1e-a4c8-4ed3-8038-cf2ecc0b67c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:21.745644 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc4e1e-a4c8-4ed3-8038-cf2ecc0b67c4 admin admin] PATH_INFO: `/v3/projects/2a96cf65568148549e7ca922f4c5215f` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:21.746865 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc4e1e-a4c8-4ed3-8038-cf2ecc0b67c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a96cf65568148549e7ca922f4c5215f)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:21.748927 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc4e1e-a4c8-4ed3-8038-cf2ecc0b67c4 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:21.750809 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 147/288] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:21 2021] GET /identity/v3/projects/2a96cf65568148549e7ca922f4c5215f => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:21.752832 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc4e1e-a4c8-4ed3-8038-cf2ecc0b67c4 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:21.764007 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc4e1e-a4c8-4ed3-8038-cf2ecc0b67c4 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:21.769533 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 142/289] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Dec 15 15:58:21 2021] POST /identity/v3/users => generated 293 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:58:21.769774 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529cca8-dd77-4e71-a57d-64e868bdebb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:21.770525 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a5386-7baa-4737-a7b5-b89e19ab450e admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:21.770766 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529cca8-dd77-4e71-a57d-64e868bdebb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:21.771186 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529cca8-dd77-4e71-a57d-64e868bdebb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:21.771599 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529cca8-dd77-4e71-a57d-64e868bdebb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:21.772502 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529cca8-dd77-4e71-a57d-64e868bdebb2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:21.772952 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529cca8-dd77-4e71-a57d-64e868bdebb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:21.775345 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529cca8-dd77-4e71-a57d-64e868bdebb2 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:21.782231 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a5386-7baa-4737-a7b5-b89e19ab450e admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:21.786245 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 148/290] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:21 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:21.787176 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6a226-87d5-46c5-82ef-1513a417acb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:21.788086 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6a226-87d5-46c5-82ef-1513a417acb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:21.788366 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6a226-87d5-46c5-82ef-1513a417acb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:21.788639 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6a226-87d5-46c5-82ef-1513a417acb0 admin admin] PATH_INFO: `/v3/projects/2a96cf65568148549e7ca922f4c5215f/users/4adf8b78475e460588586180e6c2b04b/roles/e50f3b500f664b279fa7bd9f661f9dfb` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:21.793347 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529cca8-dd77-4e71-a57d-64e868bdebb2 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:21.794181 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a6a226-87d5-46c5-82ef-1513a417acb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a96cf65568148549e7ca922f4c5215f, user_id=4adf8b78475e460588586180e6c2b04b, role_id=e50f3b500f664b279fa7bd9f661f9dfb)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:21.797066 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a6a226-87d5-46c5-82ef-1513a417acb0 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:21.804506 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529cca8-dd77-4e71-a57d-64e868bdebb2 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:21.812015 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8bb01-a678-4fe8-8d52-9bbab84a6043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:21.812223 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8bb01-a678-4fe8-8d52-9bbab84a6043 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:21.812396 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8bb01-a678-4fe8-8d52-9bbab84a6043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:21.812822 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8bb01-a678-4fe8-8d52-9bbab84a6043 admin admin] PATH_INFO: `/v3/users/b128020127ce4fcd98e4018edf405584` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:21.815541 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 143/291] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Dec 15 15:58:21 2021] PUT /identity/v3/projects/2a96cf65568148549e7ca922f4c5215f/users/4adf8b78475e460588586180e6c2b04b/roles/e50f3b500f664b279fa7bd9f661f9dfb => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 15:58:21.843018 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8bb01-a678-4fe8-8d52-9bbab84a6043 admin admin] RBAC: Authorizing `identity:get_user(user_id=b128020127ce4fcd98e4018edf405584)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:21.845267 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8bb01-a678-4fe8-8d52-9bbab84a6043 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:21.847562 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 149/292] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:21 2021] GET /identity/v3/users/b128020127ce4fcd98e4018edf405584 => generated 293 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:21.854578 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6a226-87d5-46c5-82ef-1513a417acb0 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:21.927294 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6a226-87d5-46c5-82ef-1513a417acb0 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:21.932220 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59905f7-757d-45cf-ac1d-62df0df01028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:21.932892 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59905f7-757d-45cf-ac1d-62df0df01028 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:21.933177 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59905f7-757d-45cf-ac1d-62df0df01028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:21.933480 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59905f7-757d-45cf-ac1d-62df0df01028 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:21.934346 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59905f7-757d-45cf-ac1d-62df0df01028 admin admin] RBAC: Adding query filter params (role.id=530f09f883ac47cba230257bcf458141, user.id=b128020127ce4fcd98e4018edf405584, scope.system=all) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:21.934656 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59905f7-757d-45cf-ac1d-62df0df01028 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:21.936590 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59905f7-757d-45cf-ac1d-62df0df01028 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:21.945453 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 144/293] 10.222.0.36 () {56 vars in 1329 bytes} [Wed Dec 15 15:58:21 2021] GET /identity/v3/role_assignments?user.id=b128020127ce4fcd98e4018edf405584&scope.system=all&role.id=530f09f883ac47cba230257bcf458141 => generated 226 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:24.291107 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2e357-3ccc-4251-baaa-6e4a6a1c45d3 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:24.291796 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2e357-3ccc-4251-baaa-6e4a6a1c45d3 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:24.291796 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2e357-3ccc-4251-baaa-6e4a6a1c45d3 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:24.294535 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c98d72-a477-4f84-8871-cbe517a96a70 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:24.294938 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c98d72-a477-4f84-8871-cbe517a96a70 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:24.295013 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c98d72-a477-4f84-8871-cbe517a96a70 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:24.296152 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 150/294] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:24 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:24.296852 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 145/295] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:58:24.302258 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be6fa4-d15a-47ab-aa74-559076d48359 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:24.302442 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94020d6-129a-4dc1-8d17-6363fb41aec8 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:24.302734 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94020d6-129a-4dc1-8d17-6363fb41aec8 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:24.303014 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94020d6-129a-4dc1-8d17-6363fb41aec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:24.303341 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be6fa4-d15a-47ab-aa74-559076d48359 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:24.303821 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be6fa4-d15a-47ab-aa74-559076d48359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:24.321966 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-b94020d6-129a-4dc1-8d17-6363fb41aec8 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:24.323165 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-b94020d6-129a-4dc1-8d17-6363fb41aec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:24.326021 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-c0be6fa4-d15a-47ab-aa74-559076d48359 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:24.327172 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c0be6fa4-d15a-47ab-aa74-559076d48359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:24.331035 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 146/296] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:24.332160 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097604cc-f5a6-4133-97d6-a95080751b65 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:24.332451 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097604cc-f5a6-4133-97d6-a95080751b65 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:24.332726 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097604cc-f5a6-4133-97d6-a95080751b65 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:24.334516 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 147/297] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:24.338817 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 151/298] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Dec 15 15:58:24.340355 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3833b-ff95-44fb-93a9-54ede2bac2a4 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:24.340648 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3833b-ff95-44fb-93a9-54ede2bac2a4 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:24.340925 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3833b-ff95-44fb-93a9-54ede2bac2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:24.353437 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a19c0-6abc-4a79-bd2a-132c8c07ceb5 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:24.353437 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a19c0-6abc-4a79-bd2a-132c8c07ceb5 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:24.353437 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a19c0-6abc-4a79-bd2a-132c8c07ceb5 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:24.354392 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 152/299] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:24.359408 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1cd8b-c23b-4c2f-8e61-cd2eab92a944 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:24.359697 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1cd8b-c23b-4c2f-8e61-cd2eab92a944 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:24.359975 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1cd8b-c23b-4c2f-8e61-cd2eab92a944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:24.360788 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-b1d3833b-ff95-44fb-93a9-54ede2bac2a4 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:24.362013 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-b1d3833b-ff95-44fb-93a9-54ede2bac2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:24.370294 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 148/300] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:24.371078 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3833b-ff95-44fb-93a9-54ede2bac2a4 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:24.378982 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-d0f1cd8b-c23b-4c2f-8e61-cd2eab92a944 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:24.379997 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3833b-ff95-44fb-93a9-54ede2bac2a4 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:24.380181 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-d0f1cd8b-c23b-4c2f-8e61-cd2eab92a944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:24.384244 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a127176-3fa1-41a1-b235-639e3d68744e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:24.385000 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a127176-3fa1-41a1-b235-639e3d68744e admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:24.385277 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a127176-3fa1-41a1-b235-639e3d68744e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:24.385575 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a127176-3fa1-41a1-b235-639e3d68744e admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:24.388259 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 153/301] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:58:24.389101 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1cd8b-c23b-4c2f-8e61-cd2eab92a944 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:24.397370 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a127176-3fa1-41a1-b235-639e3d68744e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:24.398472 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1cd8b-c23b-4c2f-8e61-cd2eab92a944 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:24.403600 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27837f8d-a522-4177-a1b6-c0e0351ff6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:24.404359 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27837f8d-a522-4177-a1b6-c0e0351ff6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:24.404643 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27837f8d-a522-4177-a1b6-c0e0351ff6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:24.404916 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27837f8d-a522-4177-a1b6-c0e0351ff6b9 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:24.405024 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-5a127176-3fa1-41a1-b235-639e3d68744e admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 15:58:24.406310 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 149/302] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:24 2021] GET /identity/v3/roles/reader => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:24.410540 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a127176-3fa1-41a1-b235-639e3d68744e admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:24.416635 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27837f8d-a522-4177-a1b6-c0e0351ff6b9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:24.420997 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a127176-3fa1-41a1-b235-639e3d68744e admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:24.423591 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-27837f8d-a522-4177-a1b6-c0e0351ff6b9 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 15:58:24.424776 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 154/303] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:24 2021] GET /identity/v3/roles/reader => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:24.425551 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81b031-7678-4299-a4c5-d999f596fc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:24.425678 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27837f8d-a522-4177-a1b6-c0e0351ff6b9 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:24.426348 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81b031-7678-4299-a4c5-d999f596fc40 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:24.426632 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81b031-7678-4299-a4c5-d999f596fc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:24.426915 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81b031-7678-4299-a4c5-d999f596fc40 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:24.428098 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81b031-7678-4299-a4c5-d999f596fc40 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:24.429861 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81b031-7678-4299-a4c5-d999f596fc40 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:24.431456 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 150/304] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:24 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:24.432194 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81b031-7678-4299-a4c5-d999f596fc40 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:24.435629 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27837f8d-a522-4177-a1b6-c0e0351ff6b9 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:24.440198 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f009c-cce9-4198-a620-cca904e45e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:24.440924 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f009c-cce9-4198-a620-cca904e45e59 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:24.441208 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f009c-cce9-4198-a620-cca904e45e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:24.441320 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81b031-7678-4299-a4c5-d999f596fc40 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:24.441519 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f009c-cce9-4198-a620-cca904e45e59 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:24.445525 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8224daf-e884-49f3-af7a-79074854c567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:24.446159 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8224daf-e884-49f3-af7a-79074854c567 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:24.446639 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8224daf-e884-49f3-af7a-79074854c567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:24.446921 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8224daf-e884-49f3-af7a-79074854c567 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:24.447657 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8224daf-e884-49f3-af7a-79074854c567 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:24.447967 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8224daf-e884-49f3-af7a-79074854c567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:24.449546 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8224daf-e884-49f3-af7a-79074854c567 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:24.452404 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f009c-cce9-4198-a620-cca904e45e59 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:24.458357 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 151/305] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:24 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:24.459108 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8224daf-e884-49f3-af7a-79074854c567 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:24.459431 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-4b2f009c-cce9-4198-a620-cca904e45e59 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 15:58:24.460647 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 155/306] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:24 2021] GET /identity/v3/roles/member => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:24.462109 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f009c-cce9-4198-a620-cca904e45e59 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:24.469744 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8224daf-e884-49f3-af7a-79074854c567 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:24.472639 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f009c-cce9-4198-a620-cca904e45e59 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:24.474041 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2e454-0b11-44f6-bc3c-451f5c3f7f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:24.474663 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2e454-0b11-44f6-bc3c-451f5c3f7f4e admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:24.474947 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2e454-0b11-44f6-bc3c-451f5c3f7f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:24.475223 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2e454-0b11-44f6-bc3c-451f5c3f7f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:24.475963 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2e454-0b11-44f6-bc3c-451f5c3f7f4e admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:24.476266 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2e454-0b11-44f6-bc3c-451f5c3f7f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:24.476958 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a609df-5ffd-4d90-bf1b-32e101556222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:24.478528 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a609df-5ffd-4d90-bf1b-32e101556222 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:24.478638 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2e454-0b11-44f6-bc3c-451f5c3f7f4e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:24.478824 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a609df-5ffd-4d90-bf1b-32e101556222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:24.479101 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a609df-5ffd-4d90-bf1b-32e101556222 admin admin] PATH_INFO: `/v3/groups` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:24.479797 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a609df-5ffd-4d90-bf1b-32e101556222 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:24.480804 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING py.warnings [None req-79a609df-5ffd-4d90-bf1b-32e101556222 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:58:24.480804 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: warnings.warn(msg) Dec 15 15:58:24.480804 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: Dec 15 15:58:24.482035 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a609df-5ffd-4d90-bf1b-32e101556222 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:24.486695 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 152/307] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:24 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:24.487509 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2e454-0b11-44f6-bc3c-451f5c3f7f4e admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:24.496961 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2e454-0b11-44f6-bc3c-451f5c3f7f4e admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:24.509425 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 156/308] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Dec 15 15:58:24 2021] POST /identity/v3/groups => generated 229 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:58:24.509425 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a609df-5ffd-4d90-bf1b-32e101556222 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:24.509805 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432875e-48e7-4cbd-988b-ec479ce1dcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:24.509805 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432875e-48e7-4cbd-988b-ec479ce1dcb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:24.509805 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432875e-48e7-4cbd-988b-ec479ce1dcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:24.509805 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432875e-48e7-4cbd-988b-ec479ce1dcb8 admin admin] PATH_INFO: `/v3/users/c734689c70ea4e2b8a2f3c44b25c4b91` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:24.511191 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a609df-5ffd-4d90-bf1b-32e101556222 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:24.516494 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1502db-f5c5-4fe3-b23a-244be25a0c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:24.517181 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1502db-f5c5-4fe3-b23a-244be25a0c8d admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:24.517501 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1502db-f5c5-4fe3-b23a-244be25a0c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:24.517783 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1502db-f5c5-4fe3-b23a-244be25a0c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:24.518580 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1502db-f5c5-4fe3-b23a-244be25a0c8d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:24.518894 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1502db-f5c5-4fe3-b23a-244be25a0c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:24.519881 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432875e-48e7-4cbd-988b-ec479ce1dcb8 admin admin] RBAC: Authorizing `identity:get_user(user_id=c734689c70ea4e2b8a2f3c44b25c4b91)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:24.520568 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1502db-f5c5-4fe3-b23a-244be25a0c8d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:24.522481 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432875e-48e7-4cbd-988b-ec479ce1dcb8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:24.525609 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 153/309] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:24 2021] GET /identity/v3/users/c734689c70ea4e2b8a2f3c44b25c4b91 => generated 293 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:24.526650 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432875e-48e7-4cbd-988b-ec479ce1dcb8 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:24.534980 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 157/310] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:24 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:24.535853 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1502db-f5c5-4fe3-b23a-244be25a0c8d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:24.537173 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432875e-48e7-4cbd-988b-ec479ce1dcb8 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:24.545416 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3297ff4-a344-4303-af8e-2e49a334519b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:24.546205 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3297ff4-a344-4303-af8e-2e49a334519b admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:24.546492 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3297ff4-a344-4303-af8e-2e49a334519b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:24.546769 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3297ff4-a344-4303-af8e-2e49a334519b admin admin] PATH_INFO: `/v3/users/4adf8b78475e460588586180e6c2b04b` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:24.548198 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3297ff4-a344-4303-af8e-2e49a334519b admin admin] RBAC: Authorizing `identity:get_user(user_id=4adf8b78475e460588586180e6c2b04b)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:24.550467 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3297ff4-a344-4303-af8e-2e49a334519b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:24.552278 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1502db-f5c5-4fe3-b23a-244be25a0c8d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:24.552392 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 154/311] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:24 2021] GET /identity/v3/users/4adf8b78475e460588586180e6c2b04b => generated 297 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:24.552873 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3297ff4-a344-4303-af8e-2e49a334519b admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:24.564161 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89421a9e-d571-4ee0-aec6-d86b02b19100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:24.564161 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89421a9e-d571-4ee0-aec6-d86b02b19100 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:24.564161 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89421a9e-d571-4ee0-aec6-d86b02b19100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:24.564161 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89421a9e-d571-4ee0-aec6-d86b02b19100 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:24.564591 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89421a9e-d571-4ee0-aec6-d86b02b19100 admin admin] RBAC: Adding query filter params (role.id=e50f3b500f664b279fa7bd9f661f9dfb, user.id=c734689c70ea4e2b8a2f3c44b25c4b91, scope.system=all) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:24.564665 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3297ff4-a344-4303-af8e-2e49a334519b admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:24.564736 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89421a9e-d571-4ee0-aec6-d86b02b19100 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:24.565415 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89421a9e-d571-4ee0-aec6-d86b02b19100 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:24.568461 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6cca3b-c02d-4c00-b9d5-cdd9d13c7a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:24.569348 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cca3b-c02d-4c00-b9d5-cdd9d13c7a5d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:24.569669 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cca3b-c02d-4c00-b9d5-cdd9d13c7a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:24.569942 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cca3b-c02d-4c00-b9d5-cdd9d13c7a5d admin admin] PATH_INFO: `/v3/users/b128020127ce4fcd98e4018edf405584` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:24.571358 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6cca3b-c02d-4c00-b9d5-cdd9d13c7a5d admin admin] RBAC: Authorizing `identity:get_user(user_id=b128020127ce4fcd98e4018edf405584)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:24.573572 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6cca3b-c02d-4c00-b9d5-cdd9d13c7a5d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:24.581901 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 158/312] 10.222.0.36 () {56 vars in 1329 bytes} [Wed Dec 15 15:58:24 2021] GET /identity/v3/role_assignments?user.id=c734689c70ea4e2b8a2f3c44b25c4b91&scope.system=all&role.id=e50f3b500f664b279fa7bd9f661f9dfb => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:24.582106 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 155/313] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:24 2021] GET /identity/v3/users/b128020127ce4fcd98e4018edf405584 => generated 293 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:24.582184 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89421a9e-d571-4ee0-aec6-d86b02b19100 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:24.588688 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6cca3b-c02d-4c00-b9d5-cdd9d13c7a5d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:24.595931 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89421a9e-d571-4ee0-aec6-d86b02b19100 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:24.600622 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6cca3b-c02d-4c00-b9d5-cdd9d13c7a5d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:24.600824 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937f9f2-2856-4835-abc2-e893b2dad853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:24.601315 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937f9f2-2856-4835-abc2-e893b2dad853 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:24.601627 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937f9f2-2856-4835-abc2-e893b2dad853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:24.602731 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937f9f2-2856-4835-abc2-e893b2dad853 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:24.606070 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d8454-187e-4f32-a553-3c06501b257f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:24.606952 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d8454-187e-4f32-a553-3c06501b257f admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:24.607235 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d8454-187e-4f32-a553-3c06501b257f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:24.607509 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d8454-187e-4f32-a553-3c06501b257f admin admin] PATH_INFO: `/v3/system/users/b128020127ce4fcd98e4018edf405584/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:24.610299 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d8454-187e-4f32-a553-3c06501b257f admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b128020127ce4fcd98e4018edf405584, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:24.611370 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING py.warnings [None req-098d8454-187e-4f32-a553-3c06501b257f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:58:24.611370 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: warnings.warn(msg) Dec 15 15:58:24.611370 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: Dec 15 15:58:24.612266 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d8454-187e-4f32-a553-3c06501b257f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:24.613597 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b937f9f2-2856-4835-abc2-e893b2dad853 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:24.615551 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b937f9f2-2856-4835-abc2-e893b2dad853 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:24.624792 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 156/314] 10.222.0.36 () {58 vars in 1355 bytes} [Wed Dec 15 15:58:24 2021] PUT /identity/v3/system/users/b128020127ce4fcd98e4018edf405584/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 15:58:24.633821 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 159/315] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:24 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:24.642541 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d8454-187e-4f32-a553-3c06501b257f admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:24.656191 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d8454-187e-4f32-a553-3c06501b257f admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:24.665421 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8e144-68f5-499b-9086-f94fca04d35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:24.667877 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8e144-68f5-499b-9086-f94fca04d35d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:24.668272 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8e144-68f5-499b-9086-f94fca04d35d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:24.668489 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8e144-68f5-499b-9086-f94fca04d35d admin admin] PATH_INFO: `/v3/projects/2a96cf65568148549e7ca922f4c5215f` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:24.670601 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8e144-68f5-499b-9086-f94fca04d35d admin admin] RBAC: Authorizing `identity:get_project(project_id=2a96cf65568148549e7ca922f4c5215f)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:24.672821 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8e144-68f5-499b-9086-f94fca04d35d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:24.675252 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 157/316] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:24 2021] GET /identity/v3/projects/2a96cf65568148549e7ca922f4c5215f => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:24.682497 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937f9f2-2856-4835-abc2-e893b2dad853 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:24.692744 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937f9f2-2856-4835-abc2-e893b2dad853 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:24.697987 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699920e-3f57-4bf6-9ec9-2905febfbfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:24.698672 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699920e-3f57-4bf6-9ec9-2905febfbfba admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:24.698958 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699920e-3f57-4bf6-9ec9-2905febfbfba admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:24.699240 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699920e-3f57-4bf6-9ec9-2905febfbfba admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:24.700153 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699920e-3f57-4bf6-9ec9-2905febfbfba admin admin] RBAC: Adding query filter params (role.id=e50f3b500f664b279fa7bd9f661f9dfb, scope.project.id=2a96cf65568148549e7ca922f4c5215f, user.id=4adf8b78475e460588586180e6c2b04b) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:24.700470 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699920e-3f57-4bf6-9ec9-2905febfbfba admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:24.702498 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699920e-3f57-4bf6-9ec9-2905febfbfba admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:24.709820 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 160/317] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:24 2021] GET /identity/v3/role_assignments?user.id=4adf8b78475e460588586180e6c2b04b&scope.project.id=2a96cf65568148549e7ca922f4c5215f&role.id=e50f3b500f664b279fa7bd9f661f9dfb => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:26.939234 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50931f-78a5-4a88-9b56-a3f1c727f559 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:26.939751 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50931f-78a5-4a88-9b56-a3f1c727f559 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:26.939751 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50931f-78a5-4a88-9b56-a3f1c727f559 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:26.941763 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 158/318] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:26.948064 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38dc0e-08b0-4744-9517-40d557ffd7a0 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:26.948473 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38dc0e-08b0-4744-9517-40d557ffd7a0 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:26.948662 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38dc0e-08b0-4744-9517-40d557ffd7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:26.966080 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-9b38dc0e-08b0-4744-9517-40d557ffd7a0 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:26.967276 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-9b38dc0e-08b0-4744-9517-40d557ffd7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:26.974866 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 161/319] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:26.998850 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50931f-78a5-4a88-9b56-a3f1c727f559 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:27.011594 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50931f-78a5-4a88-9b56-a3f1c727f559 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:27.015888 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7147867-27b7-4ffb-a362-aa5829332861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:27.016384 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b07fa-68da-43c3-afb7-1f34ea5bea90 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:27.016658 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7147867-27b7-4ffb-a362-aa5829332861 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:27.016772 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b07fa-68da-43c3-afb7-1f34ea5bea90 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:27.016937 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7147867-27b7-4ffb-a362-aa5829332861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:27.017031 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b07fa-68da-43c3-afb7-1f34ea5bea90 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:27.017201 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7147867-27b7-4ffb-a362-aa5829332861 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:27.018387 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7147867-27b7-4ffb-a362-aa5829332861 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:27.018845 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 162/320] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:58:27.020162 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7147867-27b7-4ffb-a362-aa5829332861 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:27.025415 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 159/321] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:26 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:27.025543 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06126c95-a1c3-419b-9a82-dfad4692027e None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:27.025543 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06126c95-a1c3-419b-9a82-dfad4692027e None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:27.025543 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06126c95-a1c3-419b-9a82-dfad4692027e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:27.028125 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7147867-27b7-4ffb-a362-aa5829332861 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:27.040786 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7147867-27b7-4ffb-a362-aa5829332861 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:27.044520 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-06126c95-a1c3-419b-9a82-dfad4692027e None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:27.045311 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335780a-8c8d-4c56-8c4d-75e2f3da2633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:27.045761 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-06126c95-a1c3-419b-9a82-dfad4692027e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:27.045993 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335780a-8c8d-4c56-8c4d-75e2f3da2633 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:27.046270 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335780a-8c8d-4c56-8c4d-75e2f3da2633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:27.046694 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335780a-8c8d-4c56-8c4d-75e2f3da2633 admin admin] PATH_INFO: `/v3/groups` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:27.047392 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335780a-8c8d-4c56-8c4d-75e2f3da2633 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:27.048395 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING py.warnings [None req-5335780a-8c8d-4c56-8c4d-75e2f3da2633 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:58:27.048395 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: warnings.warn(msg) Dec 15 15:58:27.048395 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: Dec 15 15:58:27.049590 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335780a-8c8d-4c56-8c4d-75e2f3da2633 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:27.057427 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 163/322] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:27.063290 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba6aaf-79db-4f14-9088-eee194c6a9c3 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:27.063863 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba6aaf-79db-4f14-9088-eee194c6a9c3 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:27.064335 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba6aaf-79db-4f14-9088-eee194c6a9c3 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:27.066448 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 164/323] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:58:27.073429 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 160/324] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Dec 15 15:58:27 2021] POST /identity/v3/groups => generated 226 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 15:58:27.075198 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df23c9-e1bd-43ee-9567-9215b06b83f7 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:27.075487 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df23c9-e1bd-43ee-9567-9215b06b83f7 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:27.075764 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df23c9-e1bd-43ee-9567-9215b06b83f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:27.081086 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335780a-8c8d-4c56-8c4d-75e2f3da2633 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:27.094437 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335780a-8c8d-4c56-8c4d-75e2f3da2633 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:27.095995 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-c2df23c9-e1bd-43ee-9567-9215b06b83f7 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:27.097220 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c2df23c9-e1bd-43ee-9567-9215b06b83f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:27.099106 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccd597-0966-4c8e-932b-9c46a5960863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:27.099916 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccd597-0966-4c8e-932b-9c46a5960863 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:27.100198 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccd597-0966-4c8e-932b-9c46a5960863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:27.100470 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccd597-0966-4c8e-932b-9c46a5960863 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:27.106287 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 165/325] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:27.114356 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ccd597-0966-4c8e-932b-9c46a5960863 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:27.122410 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-05ccd597-0966-4c8e-932b-9c46a5960863 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 15:58:27.123949 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 161/326] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:27 2021] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:27.130269 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df23c9-e1bd-43ee-9567-9215b06b83f7 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:27.131793 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccd597-0966-4c8e-932b-9c46a5960863 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:27.140651 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df23c9-e1bd-43ee-9567-9215b06b83f7 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:27.143158 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccd597-0966-4c8e-932b-9c46a5960863 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:27.145184 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6a1c3-8c99-429d-af87-90e42de6f3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:27.145904 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6a1c3-8c99-429d-af87-90e42de6f3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:27.146187 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6a1c3-8c99-429d-af87-90e42de6f3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:27.146465 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6a1c3-8c99-429d-af87-90e42de6f3f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:27.147241 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6a1c3-8c99-429d-af87-90e42de6f3f5 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:27.147557 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6a1c3-8c99-429d-af87-90e42de6f3f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:27.148134 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245c5cd-fc8a-47c3-ad10-613b15ea1146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:27.149262 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245c5cd-fc8a-47c3-ad10-613b15ea1146 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:27.149722 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245c5cd-fc8a-47c3-ad10-613b15ea1146 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:27.149815 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6a1c3-8c99-429d-af87-90e42de6f3f5 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:27.150011 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245c5cd-fc8a-47c3-ad10-613b15ea1146 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:27.158893 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 166/327] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:27 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:27.166313 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6a1c3-8c99-429d-af87-90e42de6f3f5 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:27.166498 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245c5cd-fc8a-47c3-ad10-613b15ea1146 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:27.173718 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-2245c5cd-fc8a-47c3-ad10-613b15ea1146 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 15:58:27.175113 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 162/328] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:27 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:27.176358 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6a1c3-8c99-429d-af87-90e42de6f3f5 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:27.181341 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe59237-bb75-402d-a640-aad8a00c3fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:27.182247 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245c5cd-fc8a-47c3-ad10-613b15ea1146 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:27.182350 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe59237-bb75-402d-a640-aad8a00c3fac admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:27.182522 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe59237-bb75-402d-a640-aad8a00c3fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:27.182795 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe59237-bb75-402d-a640-aad8a00c3fac admin admin] PATH_INFO: `/v3/users/c734689c70ea4e2b8a2f3c44b25c4b91` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:27.184012 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe59237-bb75-402d-a640-aad8a00c3fac admin admin] RBAC: Authorizing `identity:get_user(user_id=c734689c70ea4e2b8a2f3c44b25c4b91)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:27.186206 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe59237-bb75-402d-a640-aad8a00c3fac admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:27.187867 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 167/329] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:27 2021] GET /identity/v3/users/c734689c70ea4e2b8a2f3c44b25c4b91 => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:27.194451 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe59237-bb75-402d-a640-aad8a00c3fac admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:27.197898 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245c5cd-fc8a-47c3-ad10-613b15ea1146 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:27.202508 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346e0e0-0d73-4bae-b7c6-499259c9c018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:27.203192 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346e0e0-0d73-4bae-b7c6-499259c9c018 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:27.203476 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346e0e0-0d73-4bae-b7c6-499259c9c018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:27.203752 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346e0e0-0d73-4bae-b7c6-499259c9c018 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:27.204530 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346e0e0-0d73-4bae-b7c6-499259c9c018 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:27.204635 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe59237-bb75-402d-a640-aad8a00c3fac admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:27.204838 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346e0e0-0d73-4bae-b7c6-499259c9c018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:27.206531 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346e0e0-0d73-4bae-b7c6-499259c9c018 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:27.209092 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92bdd3-5335-4722-a192-f54cefe0ec74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:27.209986 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92bdd3-5335-4722-a192-f54cefe0ec74 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:27.210267 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92bdd3-5335-4722-a192-f54cefe0ec74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:27.210540 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92bdd3-5335-4722-a192-f54cefe0ec74 admin admin] PATH_INFO: `/v3/system/users/c734689c70ea4e2b8a2f3c44b25c4b91/roles/e50f3b500f664b279fa7bd9f661f9dfb` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:27.212188 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b92bdd3-5335-4722-a192-f54cefe0ec74 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c734689c70ea4e2b8a2f3c44b25c4b91, role_id=e50f3b500f664b279fa7bd9f661f9dfb)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:27.213215 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING py.warnings [None req-1b92bdd3-5335-4722-a192-f54cefe0ec74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:58:27.213215 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: warnings.warn(msg) Dec 15 15:58:27.213215 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: Dec 15 15:58:27.214129 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b92bdd3-5335-4722-a192-f54cefe0ec74 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:27.216405 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 163/330] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:27 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:27.222547 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346e0e0-0d73-4bae-b7c6-499259c9c018 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:27.223759 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 168/331] 10.222.0.36 () {58 vars in 1355 bytes} [Wed Dec 15 15:58:27 2021] PUT /identity/v3/system/users/c734689c70ea4e2b8a2f3c44b25c4b91/roles/e50f3b500f664b279fa7bd9f661f9dfb => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 15:58:27.239550 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346e0e0-0d73-4bae-b7c6-499259c9c018 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:27.245214 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56791c2a-7548-49af-84f3-2afd4a0cebd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:27.246142 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56791c2a-7548-49af-84f3-2afd4a0cebd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:27.246424 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56791c2a-7548-49af-84f3-2afd4a0cebd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:27.246697 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56791c2a-7548-49af-84f3-2afd4a0cebd3 admin admin] PATH_INFO: `/v3/users/b128020127ce4fcd98e4018edf405584` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:27.248003 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56791c2a-7548-49af-84f3-2afd4a0cebd3 admin admin] RBAC: Authorizing `identity:get_user(user_id=b128020127ce4fcd98e4018edf405584)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:27.250284 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56791c2a-7548-49af-84f3-2afd4a0cebd3 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:27.252044 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 164/332] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:27 2021] GET /identity/v3/users/b128020127ce4fcd98e4018edf405584 => generated 293 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:27.259393 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92bdd3-5335-4722-a192-f54cefe0ec74 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:27.269934 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92bdd3-5335-4722-a192-f54cefe0ec74 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:27.275282 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064dce2c-eaae-4498-9b10-6eee193e1fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:27.275986 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dce2c-eaae-4498-9b10-6eee193e1fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:27.276274 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dce2c-eaae-4498-9b10-6eee193e1fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:27.276548 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dce2c-eaae-4498-9b10-6eee193e1fe0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:27.277441 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064dce2c-eaae-4498-9b10-6eee193e1fe0 admin admin] RBAC: Adding query filter params (role.id=530f09f883ac47cba230257bcf458141, user.id=b128020127ce4fcd98e4018edf405584, scope.system=all) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:27.277761 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064dce2c-eaae-4498-9b10-6eee193e1fe0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:27.279696 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064dce2c-eaae-4498-9b10-6eee193e1fe0 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:27.304510 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 169/333] 10.222.0.36 () {56 vars in 1329 bytes} [Wed Dec 15 15:58:27 2021] GET /identity/v3/role_assignments?user.id=b128020127ce4fcd98e4018edf405584&scope.system=all&role.id=530f09f883ac47cba230257bcf458141 => generated 510 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:29.847183 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcd6bd-dff5-4ab4-a850-d5fc6fb2de15 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:29.847789 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcd6bd-dff5-4ab4-a850-d5fc6fb2de15 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:29.847789 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcd6bd-dff5-4ab4-a850-d5fc6fb2de15 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:29.849625 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 165/334] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:29.856371 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99ce46-77a2-4540-bfa5-b62ade69180d None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:29.856861 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99ce46-77a2-4540-bfa5-b62ade69180d None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:29.856944 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99ce46-77a2-4540-bfa5-b62ade69180d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:29.878256 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-af99ce46-77a2-4540-bfa5-b62ade69180d None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:29.879448 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-af99ce46-77a2-4540-bfa5-b62ade69180d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:29.891320 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 170/335] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:29.931740 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcd6bd-dff5-4ab4-a850-d5fc6fb2de15 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:29.944062 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcd6bd-dff5-4ab4-a850-d5fc6fb2de15 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:29.949202 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef698702-beeb-40db-9e5f-a8cbbaf7caf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:29.952920 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef698702-beeb-40db-9e5f-a8cbbaf7caf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:29.953209 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef698702-beeb-40db-9e5f-a8cbbaf7caf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:29.953499 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef698702-beeb-40db-9e5f-a8cbbaf7caf5 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:29.970697 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef698702-beeb-40db-9e5f-a8cbbaf7caf5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:29.978299 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-ef698702-beeb-40db-9e5f-a8cbbaf7caf5 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 15:58:29.979724 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 166/336] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:29 2021] GET /identity/v3/roles/reader => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:29.989429 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99ce46-77a2-4540-bfa5-b62ade69180d None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:29.999161 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99ce46-77a2-4540-bfa5-b62ade69180d None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:30.010158 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb46400-27c9-4f0e-8b36-b1326df19ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:30.010845 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb46400-27c9-4f0e-8b36-b1326df19ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:30.011133 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb46400-27c9-4f0e-8b36-b1326df19ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:30.011412 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb46400-27c9-4f0e-8b36-b1326df19ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:30.012185 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb46400-27c9-4f0e-8b36-b1326df19ef4 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:30.012493 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb46400-27c9-4f0e-8b36-b1326df19ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:30.014203 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb46400-27c9-4f0e-8b36-b1326df19ef4 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:30.023394 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 171/337] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:29 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:30.029693 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef698702-beeb-40db-9e5f-a8cbbaf7caf5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:30.041135 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef698702-beeb-40db-9e5f-a8cbbaf7caf5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:30.045570 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97752e27-48ae-4a20-858b-2258f7a04072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:30.046434 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97752e27-48ae-4a20-858b-2258f7a04072 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:30.046712 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97752e27-48ae-4a20-858b-2258f7a04072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:30.046986 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97752e27-48ae-4a20-858b-2258f7a04072 admin admin] PATH_INFO: `/v3/users/c734689c70ea4e2b8a2f3c44b25c4b91` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:30.048188 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97752e27-48ae-4a20-858b-2258f7a04072 admin admin] RBAC: Authorizing `identity:get_user(user_id=c734689c70ea4e2b8a2f3c44b25c4b91)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:30.050351 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97752e27-48ae-4a20-858b-2258f7a04072 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:30.053417 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 167/338] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:58:30 2021] GET /identity/v3/users/c734689c70ea4e2b8a2f3c44b25c4b91 => generated 293 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:30.062777 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb46400-27c9-4f0e-8b36-b1326df19ef4 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:30.073806 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb46400-27c9-4f0e-8b36-b1326df19ef4 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:30.080987 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2bcad-55fe-4d2b-95be-d0f37125cb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:30.081673 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2bcad-55fe-4d2b-95be-d0f37125cb0a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:30.081957 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2bcad-55fe-4d2b-95be-d0f37125cb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:30.082235 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2bcad-55fe-4d2b-95be-d0f37125cb0a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:30.083089 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2bcad-55fe-4d2b-95be-d0f37125cb0a admin admin] RBAC: Adding query filter params (role.id=e50f3b500f664b279fa7bd9f661f9dfb, user.id=c734689c70ea4e2b8a2f3c44b25c4b91, scope.system=all) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:30.083399 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2bcad-55fe-4d2b-95be-d0f37125cb0a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:30.085260 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2bcad-55fe-4d2b-95be-d0f37125cb0a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:30.100655 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 172/339] 10.222.0.36 () {56 vars in 1329 bytes} [Wed Dec 15 15:58:30 2021] GET /identity/v3/role_assignments?user.id=c734689c70ea4e2b8a2f3c44b25c4b91&scope.system=all&role.id=e50f3b500f664b279fa7bd9f661f9dfb => generated 510 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:30.254673 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf49b7-e6ef-4293-a552-8f6af2aef4f8 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:30.255055 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf49b7-e6ef-4293-a552-8f6af2aef4f8 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:30.255235 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf49b7-e6ef-4293-a552-8f6af2aef4f8 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:30.257277 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 168/340] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:30.263661 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caccb04-b89a-480d-b6b7-7217f253f149 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:30.263988 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caccb04-b89a-480d-b6b7-7217f253f149 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:30.264227 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caccb04-b89a-480d-b6b7-7217f253f149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:30.298146 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-9caccb04-b89a-480d-b6b7-7217f253f149 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:30.299403 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-9caccb04-b89a-480d-b6b7-7217f253f149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:30.310642 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 173/341] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:30.356324 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf49b7-e6ef-4293-a552-8f6af2aef4f8 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:30.374947 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf49b7-e6ef-4293-a552-8f6af2aef4f8 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:30.379385 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c12085-f2af-46e8-84bb-06fd60910744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:30.380179 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c12085-f2af-46e8-84bb-06fd60910744 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:30.380462 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c12085-f2af-46e8-84bb-06fd60910744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:30.380736 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c12085-f2af-46e8-84bb-06fd60910744 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:30.396480 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c12085-f2af-46e8-84bb-06fd60910744 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:30.412474 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-98c12085-f2af-46e8-84bb-06fd60910744 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 15:58:30.414721 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 169/342] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:30 2021] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:30.426751 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caccb04-b89a-480d-b6b7-7217f253f149 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:30.443149 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caccb04-b89a-480d-b6b7-7217f253f149 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:30.453362 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff27ecc-bb7f-4312-b1db-55c0a219f4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:30.454083 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff27ecc-bb7f-4312-b1db-55c0a219f4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:30.454363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff27ecc-bb7f-4312-b1db-55c0a219f4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:30.454640 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff27ecc-bb7f-4312-b1db-55c0a219f4f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:30.455422 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff27ecc-bb7f-4312-b1db-55c0a219f4f3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:30.455732 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff27ecc-bb7f-4312-b1db-55c0a219f4f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:30.457376 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff27ecc-bb7f-4312-b1db-55c0a219f4f3 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:30.473285 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 174/343] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:30 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:30.481304 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c12085-f2af-46e8-84bb-06fd60910744 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:30.491340 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c12085-f2af-46e8-84bb-06fd60910744 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:30.495780 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b84a12-77c1-42b6-88d9-c9ce2c21ab85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:30.496418 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b84a12-77c1-42b6-88d9-c9ce2c21ab85 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:30.496701 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b84a12-77c1-42b6-88d9-c9ce2c21ab85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:30.496975 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b84a12-77c1-42b6-88d9-c9ce2c21ab85 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:30.515387 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b84a12-77c1-42b6-88d9-c9ce2c21ab85 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:30.517176 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b84a12-77c1-42b6-88d9-c9ce2c21ab85 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:30.530407 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 170/344] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:30 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:30.536557 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff27ecc-bb7f-4312-b1db-55c0a219f4f3 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:30.550536 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff27ecc-bb7f-4312-b1db-55c0a219f4f3 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:30.561658 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498c3f1-cedd-4c69-b447-ec7a80373d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:30.562520 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498c3f1-cedd-4c69-b447-ec7a80373d0a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:30.562802 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498c3f1-cedd-4c69-b447-ec7a80373d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:30.563078 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498c3f1-cedd-4c69-b447-ec7a80373d0a admin admin] PATH_INFO: `/v3/projects/2a96cf65568148549e7ca922f4c5215f` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:30.565514 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498c3f1-cedd-4c69-b447-ec7a80373d0a admin admin] RBAC: Authorizing `identity:get_project(project_id=2a96cf65568148549e7ca922f4c5215f)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:30.567555 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498c3f1-cedd-4c69-b447-ec7a80373d0a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:30.569563 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 175/345] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:30 2021] GET /identity/v3/projects/2a96cf65568148549e7ca922f4c5215f => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:30.577202 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b84a12-77c1-42b6-88d9-c9ce2c21ab85 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:30.586983 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b84a12-77c1-42b6-88d9-c9ce2c21ab85 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:30.591468 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651518b-40ed-4227-9a46-04a6b3057879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:30.592316 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651518b-40ed-4227-9a46-04a6b3057879 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:30.592600 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651518b-40ed-4227-9a46-04a6b3057879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:30.592873 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651518b-40ed-4227-9a46-04a6b3057879 admin admin] PATH_INFO: `/v3/groups/82fda1a82eeb488eaa41c41fa6dd711d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:30.603298 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651518b-40ed-4227-9a46-04a6b3057879 admin admin] RBAC: Authorizing `identity:get_group(group_id=82fda1a82eeb488eaa41c41fa6dd711d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:30.604354 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING py.warnings [None req-1651518b-40ed-4227-9a46-04a6b3057879 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:58:30.604354 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: warnings.warn(msg) Dec 15 15:58:30.604354 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: Dec 15 15:58:30.605581 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651518b-40ed-4227-9a46-04a6b3057879 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:30.607326 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 171/346] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Dec 15 15:58:30 2021] GET /identity/v3/groups/82fda1a82eeb488eaa41c41fa6dd711d => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:30.614619 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498c3f1-cedd-4c69-b447-ec7a80373d0a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:30.628081 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498c3f1-cedd-4c69-b447-ec7a80373d0a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:30.636185 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497adf66-3956-416a-a5a3-3790b240c757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:30.636842 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497adf66-3956-416a-a5a3-3790b240c757 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:30.637124 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497adf66-3956-416a-a5a3-3790b240c757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:30.637413 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497adf66-3956-416a-a5a3-3790b240c757 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:30.638267 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497adf66-3956-416a-a5a3-3790b240c757 admin admin] RBAC: Adding query filter params (group.id=82fda1a82eeb488eaa41c41fa6dd711d, role.id=530f09f883ac47cba230257bcf458141, scope.project.id=2a96cf65568148549e7ca922f4c5215f) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:30.638581 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497adf66-3956-416a-a5a3-3790b240c757 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:30.640444 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497adf66-3956-416a-a5a3-3790b240c757 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:30.646975 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b7373-d343-4e2f-a44f-f4a33e21a8b5 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:30.647265 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b7373-d343-4e2f-a44f-f4a33e21a8b5 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:30.647543 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b7373-d343-4e2f-a44f-f4a33e21a8b5 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:30.653631 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 172/347] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:30 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:30.655680 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 176/348] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Dec 15 15:58:30 2021] GET /identity/v3/role_assignments?group.id=82fda1a82eeb488eaa41c41fa6dd711d&scope.project.id=2a96cf65568148549e7ca922f4c5215f&role.id=530f09f883ac47cba230257bcf458141 => generated 260 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:30.656895 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdc781-a33c-4067-b70b-de98410fca88 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:30.657343 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdc781-a33c-4067-b70b-de98410fca88 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:30.657678 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdc781-a33c-4067-b70b-de98410fca88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:30.698574 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-5cbdc781-a33c-4067-b70b-de98410fca88 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:30.699852 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-5cbdc781-a33c-4067-b70b-de98410fca88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:30.723226 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 173/349] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:30.757766 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497adf66-3956-416a-a5a3-3790b240c757 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:30.773669 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497adf66-3956-416a-a5a3-3790b240c757 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:30.780748 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4205e34-9c1f-4393-a9ea-4127a87e5708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:30.781588 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4205e34-9c1f-4393-a9ea-4127a87e5708 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:30.781873 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4205e34-9c1f-4393-a9ea-4127a87e5708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:30.782152 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4205e34-9c1f-4393-a9ea-4127a87e5708 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:30.811122 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4205e34-9c1f-4393-a9ea-4127a87e5708 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:30.819057 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-f4205e34-9c1f-4393-a9ea-4127a87e5708 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 15:58:30.820945 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 177/350] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:30 2021] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:30.829319 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdc781-a33c-4067-b70b-de98410fca88 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:30.844777 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdc781-a33c-4067-b70b-de98410fca88 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:30.859434 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bfe63-969d-4fdc-808d-a2bc8b0c6e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:30.860056 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bfe63-969d-4fdc-808d-a2bc8b0c6e66 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:30.860323 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bfe63-969d-4fdc-808d-a2bc8b0c6e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:30.860600 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bfe63-969d-4fdc-808d-a2bc8b0c6e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:30.861456 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bfe63-969d-4fdc-808d-a2bc8b0c6e66 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:30.861775 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bfe63-969d-4fdc-808d-a2bc8b0c6e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:30.863588 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bfe63-969d-4fdc-808d-a2bc8b0c6e66 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:30.885890 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 174/351] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:30 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:30.892894 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4205e34-9c1f-4393-a9ea-4127a87e5708 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:30.906591 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4205e34-9c1f-4393-a9ea-4127a87e5708 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:30.913983 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc30b6-5cb3-4207-9c85-1be6a4975c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:30.914729 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc30b6-5cb3-4207-9c85-1be6a4975c59 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:30.915018 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc30b6-5cb3-4207-9c85-1be6a4975c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:30.915587 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc30b6-5cb3-4207-9c85-1be6a4975c59 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:30.941652 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc30b6-5cb3-4207-9c85-1be6a4975c59 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:30.943647 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc30b6-5cb3-4207-9c85-1be6a4975c59 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:30.962301 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 178/352] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:30 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:30.970439 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bfe63-969d-4fdc-808d-a2bc8b0c6e66 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:30.988926 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bfe63-969d-4fdc-808d-a2bc8b0c6e66 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:31.005490 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710be406-5d84-49cc-9656-71bce8d350d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:31.006579 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710be406-5d84-49cc-9656-71bce8d350d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:31.006861 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710be406-5d84-49cc-9656-71bce8d350d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:31.007694 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710be406-5d84-49cc-9656-71bce8d350d6 admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:31.009283 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710be406-5d84-49cc-9656-71bce8d350d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=f6644073b15349a5b18a70868298c841)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:31.010477 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e9fc2-fe38-4924-be3c-b3c72d6415b2 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:31.010835 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e9fc2-fe38-4924-be3c-b3c72d6415b2 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:31.011168 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e9fc2-fe38-4924-be3c-b3c72d6415b2 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:31.011435 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710be406-5d84-49cc-9656-71bce8d350d6 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:31.013122 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 179/353] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:31.014696 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 175/354] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:30 2021] GET /identity/v3/projects/f6644073b15349a5b18a70868298c841 => generated 298 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:31.019533 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3a152-6313-4669-ab0b-f956e1f5961b None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:31.019997 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3a152-6313-4669-ab0b-f956e1f5961b None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:31.020160 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3a152-6313-4669-ab0b-f956e1f5961b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:31.020795 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710be406-5d84-49cc-9656-71bce8d350d6 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:31.047895 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710be406-5d84-49cc-9656-71bce8d350d6 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:31.055696 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8652e5-f91e-4445-a2a4-387785040dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:31.055696 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8652e5-f91e-4445-a2a4-387785040dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:31.055696 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8652e5-f91e-4445-a2a4-387785040dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:31.055696 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8652e5-f91e-4445-a2a4-387785040dd0 admin admin] PATH_INFO: `/v3/groups/82fda1a82eeb488eaa41c41fa6dd711d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:31.058609 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-74f3a152-6313-4669-ab0b-f956e1f5961b None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:31.059965 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-74f3a152-6313-4669-ab0b-f956e1f5961b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:31.061795 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8652e5-f91e-4445-a2a4-387785040dd0 admin admin] RBAC: Authorizing `identity:get_group(group_id=82fda1a82eeb488eaa41c41fa6dd711d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:31.063858 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8652e5-f91e-4445-a2a4-387785040dd0 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:31.071587 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 176/355] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Dec 15 15:58:31 2021] GET /identity/v3/groups/82fda1a82eeb488eaa41c41fa6dd711d => generated 226 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:31.079612 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8652e5-f91e-4445-a2a4-387785040dd0 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:31.084085 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 180/356] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:58:31.099637 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8652e5-f91e-4445-a2a4-387785040dd0 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:31.114067 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3a152-6313-4669-ab0b-f956e1f5961b None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:31.115505 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8ff8b-7fdb-43a7-9585-dfae9e05416d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:31.116176 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8ff8b-7fdb-43a7-9585-dfae9e05416d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:31.116502 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8ff8b-7fdb-43a7-9585-dfae9e05416d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:31.116821 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8ff8b-7fdb-43a7-9585-dfae9e05416d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:31.117664 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8ff8b-7fdb-43a7-9585-dfae9e05416d admin admin] RBAC: Adding query filter params (group.id=82fda1a82eeb488eaa41c41fa6dd711d, role.id=530f09f883ac47cba230257bcf458141, scope.project.id=f6644073b15349a5b18a70868298c841) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:31.117978 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8ff8b-7fdb-43a7-9585-dfae9e05416d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:31.119830 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8ff8b-7fdb-43a7-9585-dfae9e05416d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:31.126810 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3a152-6313-4669-ab0b-f956e1f5961b None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:31.139183 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811960c8-2aa0-4eb5-9cef-bedda0ee51c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:31.140299 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811960c8-2aa0-4eb5-9cef-bedda0ee51c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:31.140437 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 177/357] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Dec 15 15:58:31 2021] GET /identity/v3/role_assignments?group.id=82fda1a82eeb488eaa41c41fa6dd711d&scope.project.id=f6644073b15349a5b18a70868298c841&role.id=530f09f883ac47cba230257bcf458141 => generated 260 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:31.140935 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811960c8-2aa0-4eb5-9cef-bedda0ee51c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:31.141456 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811960c8-2aa0-4eb5-9cef-bedda0ee51c6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:31.169967 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811960c8-2aa0-4eb5-9cef-bedda0ee51c6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:31.181015 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-811960c8-2aa0-4eb5-9cef-bedda0ee51c6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 15:58:31.184509 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 181/358] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Dec 15 15:58:31 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:31.194532 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8ff8b-7fdb-43a7-9585-dfae9e05416d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:31.221803 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8ff8b-7fdb-43a7-9585-dfae9e05416d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:31.246460 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35374a4c-019e-4bb5-aada-c792179add80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:31.247161 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35374a4c-019e-4bb5-aada-c792179add80 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:31.247445 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35374a4c-019e-4bb5-aada-c792179add80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:31.247945 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35374a4c-019e-4bb5-aada-c792179add80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:31.248948 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35374a4c-019e-4bb5-aada-c792179add80 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:31.249260 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35374a4c-019e-4bb5-aada-c792179add80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:31.250932 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35374a4c-019e-4bb5-aada-c792179add80 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:31.269014 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 178/359] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:31 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:31.277933 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811960c8-2aa0-4eb5-9cef-bedda0ee51c6 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:31.295771 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811960c8-2aa0-4eb5-9cef-bedda0ee51c6 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:31.306902 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cf044-ed95-4dc5-9c3d-3e030ce99b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:31.308018 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cf044-ed95-4dc5-9c3d-3e030ce99b20 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:31.308497 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cf044-ed95-4dc5-9c3d-3e030ce99b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:31.309034 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cf044-ed95-4dc5-9c3d-3e030ce99b20 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:31.327023 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07cf044-ed95-4dc5-9c3d-3e030ce99b20 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:31.329233 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07cf044-ed95-4dc5-9c3d-3e030ce99b20 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:31.341142 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 182/360] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:31 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:31.347952 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35374a4c-019e-4bb5-aada-c792179add80 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:31.360926 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35374a4c-019e-4bb5-aada-c792179add80 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:31.366057 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f957a-1a38-4bfc-9050-d8159efd8465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:31.367862 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f957a-1a38-4bfc-9050-d8159efd8465 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:31.368346 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f957a-1a38-4bfc-9050-d8159efd8465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:31.368831 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f957a-1a38-4bfc-9050-d8159efd8465 admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:31.370469 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f957a-1a38-4bfc-9050-d8159efd8465 admin admin] RBAC: Authorizing `identity:get_project(project_id=f6644073b15349a5b18a70868298c841)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:31.372821 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f957a-1a38-4bfc-9050-d8159efd8465 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:31.375013 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 179/361] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:31 2021] GET /identity/v3/projects/f6644073b15349a5b18a70868298c841 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:31.381533 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cf044-ed95-4dc5-9c3d-3e030ce99b20 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:31.394452 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cf044-ed95-4dc5-9c3d-3e030ce99b20 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:31.400126 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac7c31-859d-487e-a70e-3e0b31554781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:31.401367 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac7c31-859d-487e-a70e-3e0b31554781 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:31.401926 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac7c31-859d-487e-a70e-3e0b31554781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:31.402438 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac7c31-859d-487e-a70e-3e0b31554781 admin admin] PATH_INFO: `/v3/groups/82fda1a82eeb488eaa41c41fa6dd711d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:31.403888 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac7c31-859d-487e-a70e-3e0b31554781 admin admin] RBAC: Authorizing `identity:get_group(group_id=82fda1a82eeb488eaa41c41fa6dd711d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:31.405233 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING py.warnings [None req-07ac7c31-859d-487e-a70e-3e0b31554781 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:58:31.405233 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: warnings.warn(msg) Dec 15 15:58:31.405233 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: Dec 15 15:58:31.406800 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac7c31-859d-487e-a70e-3e0b31554781 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:31.409069 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 183/362] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Dec 15 15:58:31 2021] GET /identity/v3/groups/82fda1a82eeb488eaa41c41fa6dd711d => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:31.416966 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f957a-1a38-4bfc-9050-d8159efd8465 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:31.427662 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f957a-1a38-4bfc-9050-d8159efd8465 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:31.434643 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49546879-ba8e-4a8e-8de7-531564ef22f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:31.435628 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49546879-ba8e-4a8e-8de7-531564ef22f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:31.436171 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49546879-ba8e-4a8e-8de7-531564ef22f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:31.436732 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49546879-ba8e-4a8e-8de7-531564ef22f7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:31.437803 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49546879-ba8e-4a8e-8de7-531564ef22f7 admin admin] RBAC: Adding query filter params (group.id=82fda1a82eeb488eaa41c41fa6dd711d, role.id=d042901298ef4d56b504a30c45128dca, scope.project.id=f6644073b15349a5b18a70868298c841) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:31.438342 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49546879-ba8e-4a8e-8de7-531564ef22f7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:31.440486 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49546879-ba8e-4a8e-8de7-531564ef22f7 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:31.447415 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 180/363] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Dec 15 15:58:31 2021] GET /identity/v3/role_assignments?group.id=82fda1a82eeb488eaa41c41fa6dd711d&scope.project.id=f6644073b15349a5b18a70868298c841&role.id=d042901298ef4d56b504a30c45128dca => generated 260 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:31.859619 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8c9b5-2213-4771-8525-a63cf4d7e4b6 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:31.860315 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8c9b5-2213-4771-8525-a63cf4d7e4b6 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:31.860810 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8c9b5-2213-4771-8525-a63cf4d7e4b6 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:31.862795 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 184/364] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:31.871320 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284794a-a4e9-4564-89fe-ec5af5f7fd1a None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:31.872249 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284794a-a4e9-4564-89fe-ec5af5f7fd1a None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:31.872726 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284794a-a4e9-4564-89fe-ec5af5f7fd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:31.894703 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-2284794a-a4e9-4564-89fe-ec5af5f7fd1a None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:31.896207 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-2284794a-a4e9-4564-89fe-ec5af5f7fd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:31.907202 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 181/365] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:31.955093 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8c9b5-2213-4771-8525-a63cf4d7e4b6 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:31.971319 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8c9b5-2213-4771-8525-a63cf4d7e4b6 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:31.976594 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f3329-9ea5-4d70-ad0c-e820f180a2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:31.977638 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f3329-9ea5-4d70-ad0c-e820f180a2ea admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:31.978116 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f3329-9ea5-4d70-ad0c-e820f180a2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:31.978598 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f3329-9ea5-4d70-ad0c-e820f180a2ea admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:31.991256 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f3329-9ea5-4d70-ad0c-e820f180a2ea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:31.998959 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-ab9f3329-9ea5-4d70-ad0c-e820f180a2ea admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 15:58:32.000351 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 185/366] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Dec 15 15:58:31 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:32.006449 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284794a-a4e9-4564-89fe-ec5af5f7fd1a None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:32.016001 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284794a-a4e9-4564-89fe-ec5af5f7fd1a None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:32.025039 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48067ee-cb53-479c-83a2-be2babb36426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:32.025984 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48067ee-cb53-479c-83a2-be2babb36426 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:32.026461 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48067ee-cb53-479c-83a2-be2babb36426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:32.026927 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48067ee-cb53-479c-83a2-be2babb36426 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:32.027900 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48067ee-cb53-479c-83a2-be2babb36426 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:32.028405 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48067ee-cb53-479c-83a2-be2babb36426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:32.030233 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48067ee-cb53-479c-83a2-be2babb36426 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:32.047588 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 182/367] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:32 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:32.054551 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f3329-9ea5-4d70-ad0c-e820f180a2ea admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:32.070649 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f3329-9ea5-4d70-ad0c-e820f180a2ea admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:32.075452 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43d741-702f-4d83-b2b9-b9aaf2403f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:32.076337 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43d741-702f-4d83-b2b9-b9aaf2403f10 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:32.076841 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43d741-702f-4d83-b2b9-b9aaf2403f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:32.077330 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43d741-702f-4d83-b2b9-b9aaf2403f10 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:32.090496 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef43d741-702f-4d83-b2b9-b9aaf2403f10 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:32.092617 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef43d741-702f-4d83-b2b9-b9aaf2403f10 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:32.103560 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 186/368] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:32 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:32.109696 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48067ee-cb53-479c-83a2-be2babb36426 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:32.122261 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48067ee-cb53-479c-83a2-be2babb36426 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:32.133262 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab90d5-86bb-4b64-9f7a-6d6d5349f662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:32.134404 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab90d5-86bb-4b64-9f7a-6d6d5349f662 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:32.134876 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab90d5-86bb-4b64-9f7a-6d6d5349f662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:32.135416 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab90d5-86bb-4b64-9f7a-6d6d5349f662 admin admin] PATH_INFO: `/v3/projects/2a96cf65568148549e7ca922f4c5215f` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:32.136921 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab90d5-86bb-4b64-9f7a-6d6d5349f662 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a96cf65568148549e7ca922f4c5215f)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:32.139275 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab90d5-86bb-4b64-9f7a-6d6d5349f662 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:32.141180 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 183/369] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:32 2021] GET /identity/v3/projects/2a96cf65568148549e7ca922f4c5215f => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:32.147079 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43d741-702f-4d83-b2b9-b9aaf2403f10 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:32.159681 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43d741-702f-4d83-b2b9-b9aaf2403f10 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:32.166903 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d0134-fa4c-425b-a3a9-f2ad89cc1ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:32.167749 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d0134-fa4c-425b-a3a9-f2ad89cc1ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:32.168035 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d0134-fa4c-425b-a3a9-f2ad89cc1ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:32.168316 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d0134-fa4c-425b-a3a9-f2ad89cc1ac0 admin admin] PATH_INFO: `/v3/groups/82fda1a82eeb488eaa41c41fa6dd711d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:32.169909 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d0134-fa4c-425b-a3a9-f2ad89cc1ac0 admin admin] RBAC: Authorizing `identity:get_group(group_id=82fda1a82eeb488eaa41c41fa6dd711d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:32.171871 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d0134-fa4c-425b-a3a9-f2ad89cc1ac0 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:32.173777 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 187/370] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Dec 15 15:58:32 2021] GET /identity/v3/groups/82fda1a82eeb488eaa41c41fa6dd711d => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:32.180193 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab90d5-86bb-4b64-9f7a-6d6d5349f662 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:32.194441 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab90d5-86bb-4b64-9f7a-6d6d5349f662 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:32.200214 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3e677-6c06-4b48-8dad-c9b509dce9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:32.201137 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3e677-6c06-4b48-8dad-c9b509dce9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:32.201697 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3e677-6c06-4b48-8dad-c9b509dce9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:32.202166 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3e677-6c06-4b48-8dad-c9b509dce9d2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:32.203284 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3e677-6c06-4b48-8dad-c9b509dce9d2 admin admin] RBAC: Adding query filter params (group.id=82fda1a82eeb488eaa41c41fa6dd711d, role.id=d042901298ef4d56b504a30c45128dca, scope.project.id=2a96cf65568148549e7ca922f4c5215f) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:32.203814 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3e677-6c06-4b48-8dad-c9b509dce9d2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:32.206048 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3e677-6c06-4b48-8dad-c9b509dce9d2 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:32.214583 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 184/371] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Dec 15 15:58:32 2021] GET /identity/v3/role_assignments?group.id=82fda1a82eeb488eaa41c41fa6dd711d&scope.project.id=2a96cf65568148549e7ca922f4c5215f&role.id=d042901298ef4d56b504a30c45128dca => generated 260 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:32.491230 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a273887-0d33-4455-9593-b79e2c6f7420 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:32.492134 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a273887-0d33-4455-9593-b79e2c6f7420 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:32.492443 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a273887-0d33-4455-9593-b79e2c6f7420 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:32.494611 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 188/372] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:32.500692 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ee46b-ab68-4046-947b-977034c7dc98 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:32.500984 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ee46b-ab68-4046-947b-977034c7dc98 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:32.501241 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ee46b-ab68-4046-947b-977034c7dc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:32.521936 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-2d1ee46b-ab68-4046-947b-977034c7dc98 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:32.523326 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-2d1ee46b-ab68-4046-947b-977034c7dc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:32.535306 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 185/373] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:32.565850 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a273887-0d33-4455-9593-b79e2c6f7420 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:32.581491 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a273887-0d33-4455-9593-b79e2c6f7420 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:32.587517 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2665c3-c1ed-4c0a-bce7-ce8a178ea70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:32.588656 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2665c3-c1ed-4c0a-bce7-ce8a178ea70d admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:32.589151 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2665c3-c1ed-4c0a-bce7-ce8a178ea70d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:32.589660 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2665c3-c1ed-4c0a-bce7-ce8a178ea70d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:32.605088 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2665c3-c1ed-4c0a-bce7-ce8a178ea70d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:32.612363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-5a2665c3-c1ed-4c0a-bce7-ce8a178ea70d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 15:58:32.613816 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 189/374] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:58:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:32.620772 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ee46b-ab68-4046-947b-977034c7dc98 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:32.632994 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ee46b-ab68-4046-947b-977034c7dc98 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:32.639412 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d951981-214b-459a-8211-0ec3fdb12c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:32.640078 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d951981-214b-459a-8211-0ec3fdb12c47 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:32.640356 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d951981-214b-459a-8211-0ec3fdb12c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:32.640627 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d951981-214b-459a-8211-0ec3fdb12c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:32.641456 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d951981-214b-459a-8211-0ec3fdb12c47 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:32.641762 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d951981-214b-459a-8211-0ec3fdb12c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:32.643370 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d951981-214b-459a-8211-0ec3fdb12c47 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:32.658191 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 186/375] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:32.665227 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2665c3-c1ed-4c0a-bce7-ce8a178ea70d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:32.678430 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2665c3-c1ed-4c0a-bce7-ce8a178ea70d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:32.689616 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790928ec-136a-447f-986c-65d05d7cfbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:32.690596 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790928ec-136a-447f-986c-65d05d7cfbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:32.691078 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790928ec-136a-447f-986c-65d05d7cfbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:32.691564 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790928ec-136a-447f-986c-65d05d7cfbb0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:32.706235 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790928ec-136a-447f-986c-65d05d7cfbb0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:32.708312 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790928ec-136a-447f-986c-65d05d7cfbb0 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:32.723432 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 190/376] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:32 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:32.730446 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d951981-214b-459a-8211-0ec3fdb12c47 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:32.747042 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d951981-214b-459a-8211-0ec3fdb12c47 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:32.762175 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ba371-f41a-4e47-b8c5-596886848532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:32.763059 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ba371-f41a-4e47-b8c5-596886848532 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:32.763338 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ba371-f41a-4e47-b8c5-596886848532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:32.763618 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ba371-f41a-4e47-b8c5-596886848532 admin admin] PATH_INFO: `/v3/projects/d7bb9a879a6841dda52e30764e5ba9c7` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:32.764988 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ba371-f41a-4e47-b8c5-596886848532 admin admin] RBAC: Authorizing `identity:get_project(project_id=d7bb9a879a6841dda52e30764e5ba9c7)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:32.766841 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ba371-f41a-4e47-b8c5-596886848532 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:32.768808 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 187/377] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:32 2021] GET /identity/v3/projects/d7bb9a879a6841dda52e30764e5ba9c7 => generated 344 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:32.776106 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790928ec-136a-447f-986c-65d05d7cfbb0 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:32.791395 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790928ec-136a-447f-986c-65d05d7cfbb0 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:32.801588 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6e5ee-1057-4b56-abf7-c906f21438a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:32.802686 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6e5ee-1057-4b56-abf7-c906f21438a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:32.803163 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6e5ee-1057-4b56-abf7-c906f21438a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:32.803651 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6e5ee-1057-4b56-abf7-c906f21438a3 admin admin] PATH_INFO: `/v3/groups/195f7284c08c4732a894407516e0b99a` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:32.815634 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6e5ee-1057-4b56-abf7-c906f21438a3 admin admin] RBAC: Authorizing `identity:get_group(group_id=195f7284c08c4732a894407516e0b99a)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:32.817883 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6e5ee-1057-4b56-abf7-c906f21438a3 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:32.820134 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 191/378] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Dec 15 15:58:32 2021] GET /identity/v3/groups/195f7284c08c4732a894407516e0b99a => generated 229 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:32.826777 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ba371-f41a-4e47-b8c5-596886848532 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:32.842718 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ba371-f41a-4e47-b8c5-596886848532 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:32.850641 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255af7dd-d46c-4a8c-bf0a-9b1167a4d699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:32.851966 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255af7dd-d46c-4a8c-bf0a-9b1167a4d699 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:32.852248 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255af7dd-d46c-4a8c-bf0a-9b1167a4d699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:32.852520 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255af7dd-d46c-4a8c-bf0a-9b1167a4d699 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:32.853370 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255af7dd-d46c-4a8c-bf0a-9b1167a4d699 admin admin] RBAC: Adding query filter params (group.id=195f7284c08c4732a894407516e0b99a, role.id=bc362f875c6d4cee83ba65b8d134462d, scope.project.id=d7bb9a879a6841dda52e30764e5ba9c7) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:32.853727 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255af7dd-d46c-4a8c-bf0a-9b1167a4d699 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:32.855607 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255af7dd-d46c-4a8c-bf0a-9b1167a4d699 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:32.866074 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 188/379] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Dec 15 15:58:32 2021] GET /identity/v3/role_assignments?group.id=195f7284c08c4732a894407516e0b99a&scope.project.id=d7bb9a879a6841dda52e30764e5ba9c7&role.id=bc362f875c6d4cee83ba65b8d134462d => generated 260 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:34.101266 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438fe54-08a4-41d1-b2c6-7482fa03122a None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:34.101804 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438fe54-08a4-41d1-b2c6-7482fa03122a None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:34.101879 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438fe54-08a4-41d1-b2c6-7482fa03122a None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:34.103976 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 192/380] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:34.109588 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547d5bd-a549-4c4b-8f8d-e3797fe6c2ca None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:34.110019 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547d5bd-a549-4c4b-8f8d-e3797fe6c2ca None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:34.110125 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547d5bd-a549-4c4b-8f8d-e3797fe6c2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:34.138444 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-1547d5bd-a549-4c4b-8f8d-e3797fe6c2ca None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:34.139643 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-1547d5bd-a549-4c4b-8f8d-e3797fe6c2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:34.148339 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 189/381] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:34.183672 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438fe54-08a4-41d1-b2c6-7482fa03122a None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:34.200303 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438fe54-08a4-41d1-b2c6-7482fa03122a None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:34.204777 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9d857-e09a-4c00-824d-541016a764e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:34.205598 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9d857-e09a-4c00-824d-541016a764e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:34.205887 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9d857-e09a-4c00-824d-541016a764e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:34.206167 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9d857-e09a-4c00-824d-541016a764e6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:34.223666 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9d857-e09a-4c00-824d-541016a764e6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:34.231696 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-d0a9d857-e09a-4c00-824d-541016a764e6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 15:58:34.237498 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 193/382] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:34 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:34.239084 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547d5bd-a549-4c4b-8f8d-e3797fe6c2ca None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:34.255919 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547d5bd-a549-4c4b-8f8d-e3797fe6c2ca None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:34.263848 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb380665-2fc4-47aa-ac02-8ce762f65dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:34.264515 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb380665-2fc4-47aa-ac02-8ce762f65dee admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:34.264797 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb380665-2fc4-47aa-ac02-8ce762f65dee admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:34.265072 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb380665-2fc4-47aa-ac02-8ce762f65dee admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:34.265864 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb380665-2fc4-47aa-ac02-8ce762f65dee admin admin] RBAC: Adding query filter params (name=member) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:34.266172 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb380665-2fc4-47aa-ac02-8ce762f65dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:34.267780 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb380665-2fc4-47aa-ac02-8ce762f65dee admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:34.281739 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 190/383] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:34 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:34.285509 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9d857-e09a-4c00-824d-541016a764e6 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:34.299708 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9d857-e09a-4c00-824d-541016a764e6 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:34.315030 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab6e25-39d8-49d1-84fa-62051ce9236e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:34.315894 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab6e25-39d8-49d1-84fa-62051ce9236e admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:34.316179 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab6e25-39d8-49d1-84fa-62051ce9236e admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:34.316460 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab6e25-39d8-49d1-84fa-62051ce9236e admin admin] PATH_INFO: `/v3/groups/82fda1a82eeb488eaa41c41fa6dd711d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:34.322742 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab6e25-39d8-49d1-84fa-62051ce9236e admin admin] RBAC: Authorizing `identity:get_group(group_id=82fda1a82eeb488eaa41c41fa6dd711d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:34.325213 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab6e25-39d8-49d1-84fa-62051ce9236e admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:34.328241 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 194/384] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Dec 15 15:58:34 2021] GET /identity/v3/groups/82fda1a82eeb488eaa41c41fa6dd711d => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:34.334030 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb380665-2fc4-47aa-ac02-8ce762f65dee admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:34.344406 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb380665-2fc4-47aa-ac02-8ce762f65dee admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:34.358039 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930e774-21fa-4f78-af4b-e58583501242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:34.358902 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930e774-21fa-4f78-af4b-e58583501242 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:34.359192 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930e774-21fa-4f78-af4b-e58583501242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:34.359469 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930e774-21fa-4f78-af4b-e58583501242 admin admin] PATH_INFO: `/v3/projects/2a96cf65568148549e7ca922f4c5215f` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:34.360698 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930e774-21fa-4f78-af4b-e58583501242 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a96cf65568148549e7ca922f4c5215f)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:34.362781 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930e774-21fa-4f78-af4b-e58583501242 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:34.364444 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 191/385] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:34 2021] GET /identity/v3/projects/2a96cf65568148549e7ca922f4c5215f => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:34.371810 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab6e25-39d8-49d1-84fa-62051ce9236e admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:34.394525 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab6e25-39d8-49d1-84fa-62051ce9236e admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:34.402894 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c80f0-cff6-4468-9536-bbbf6f6ad9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:34.403785 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c80f0-cff6-4468-9536-bbbf6f6ad9e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:34.404069 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c80f0-cff6-4468-9536-bbbf6f6ad9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:34.404347 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c80f0-cff6-4468-9536-bbbf6f6ad9e5 admin admin] PATH_INFO: `/v3/projects/2a96cf65568148549e7ca922f4c5215f/groups/82fda1a82eeb488eaa41c41fa6dd711d/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:34.407447 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c80f0-cff6-4468-9536-bbbf6f6ad9e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a96cf65568148549e7ca922f4c5215f, group_id=82fda1a82eeb488eaa41c41fa6dd711d, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:34.410149 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c80f0-cff6-4468-9536-bbbf6f6ad9e5 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:34.435867 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 195/386] 10.222.0.36 () {58 vars in 1463 bytes} [Wed Dec 15 15:58:34 2021] PUT /identity/v3/projects/2a96cf65568148549e7ca922f4c5215f/groups/82fda1a82eeb488eaa41c41fa6dd711d/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 15:58:34.529719 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e5a7b-69d1-4d20-a08c-67fbf8687c9c None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:34.530040 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e5a7b-69d1-4d20-a08c-67fbf8687c9c None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:34.530270 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e5a7b-69d1-4d20-a08c-67fbf8687c9c None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:34.532309 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 192/387] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:34.539406 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23faca6-15e2-493d-ad59-2574b5fa3197 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:34.539715 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23faca6-15e2-493d-ad59-2574b5fa3197 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:34.539948 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23faca6-15e2-493d-ad59-2574b5fa3197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:34.566755 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-e23faca6-15e2-493d-ad59-2574b5fa3197 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:34.567897 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-e23faca6-15e2-493d-ad59-2574b5fa3197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:34.640226 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 196/388] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:34.681711 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e5a7b-69d1-4d20-a08c-67fbf8687c9c None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:34.699161 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e5a7b-69d1-4d20-a08c-67fbf8687c9c None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:34.703596 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bdbd5-4e4b-4196-a2b5-894b7fbd9df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:34.704440 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bdbd5-4e4b-4196-a2b5-894b7fbd9df9 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:34.704678 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bdbd5-4e4b-4196-a2b5-894b7fbd9df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:34.704952 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bdbd5-4e4b-4196-a2b5-894b7fbd9df9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:34.728303 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3bdbd5-4e4b-4196-a2b5-894b7fbd9df9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:34.730752 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829f8a8-4ace-4a13-b6d8-3c02b9fe45a4 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:34.731038 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829f8a8-4ace-4a13-b6d8-3c02b9fe45a4 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:34.731309 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829f8a8-4ace-4a13-b6d8-3c02b9fe45a4 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:34.733149 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 197/389] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:34.739970 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-4a3bdbd5-4e4b-4196-a2b5-894b7fbd9df9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 15:58:34.745787 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7830c-807d-4cad-8278-82d94291ffd3 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:34.746202 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7830c-807d-4cad-8278-82d94291ffd3 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:34.746446 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7830c-807d-4cad-8278-82d94291ffd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:34.748366 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 193/390] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Dec 15 15:58:34 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:34.757538 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bdbd5-4e4b-4196-a2b5-894b7fbd9df9 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:34.772930 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bdbd5-4e4b-4196-a2b5-894b7fbd9df9 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:34.774854 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-7fc7830c-807d-4cad-8278-82d94291ffd3 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:34.776090 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-7fc7830c-807d-4cad-8278-82d94291ffd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:34.789127 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dff7d-872e-4bda-88ea-11a083d6871a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:34.789530 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 198/391] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:34.789837 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dff7d-872e-4bda-88ea-11a083d6871a admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:34.790121 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dff7d-872e-4bda-88ea-11a083d6871a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:34.790387 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dff7d-872e-4bda-88ea-11a083d6871a admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:34.791155 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8dff7d-872e-4bda-88ea-11a083d6871a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:34.791458 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8dff7d-872e-4bda-88ea-11a083d6871a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:34.793111 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8dff7d-872e-4bda-88ea-11a083d6871a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:34.802436 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 194/392] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:34 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:34.808993 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7830c-807d-4cad-8278-82d94291ffd3 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:34.816394 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dff7d-872e-4bda-88ea-11a083d6871a admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:34.826360 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7830c-807d-4cad-8278-82d94291ffd3 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:34.826526 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dff7d-872e-4bda-88ea-11a083d6871a admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:34.831137 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d26fe-60b5-4d17-a21d-32512139206c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:34.831765 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d917a5-af5b-41ae-9973-6ac2dda29902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:34.831970 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d26fe-60b5-4d17-a21d-32512139206c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:34.832207 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d26fe-60b5-4d17-a21d-32512139206c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:34.832484 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d26fe-60b5-4d17-a21d-32512139206c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:34.832654 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d917a5-af5b-41ae-9973-6ac2dda29902 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:34.832883 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d917a5-af5b-41ae-9973-6ac2dda29902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:34.833156 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d917a5-af5b-41ae-9973-6ac2dda29902 admin admin] PATH_INFO: `/v3/groups/82fda1a82eeb488eaa41c41fa6dd711d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:34.834475 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d917a5-af5b-41ae-9973-6ac2dda29902 admin admin] RBAC: Authorizing `identity:get_group(group_id=82fda1a82eeb488eaa41c41fa6dd711d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:34.836622 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d917a5-af5b-41ae-9973-6ac2dda29902 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:34.838724 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 199/393] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Dec 15 15:58:34 2021] GET /identity/v3/groups/82fda1a82eeb488eaa41c41fa6dd711d => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:34.846881 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d26fe-60b5-4d17-a21d-32512139206c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:34.847130 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d917a5-af5b-41ae-9973-6ac2dda29902 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:34.855741 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-4a9d26fe-60b5-4d17-a21d-32512139206c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 15:58:34.859034 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d917a5-af5b-41ae-9973-6ac2dda29902 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:34.860152 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 195/394] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:34 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:34.863931 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64016690-16c7-4924-b580-b83336c2cc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:34.864834 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d26fe-60b5-4d17-a21d-32512139206c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:34.864945 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64016690-16c7-4924-b580-b83336c2cc9e admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:34.865122 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64016690-16c7-4924-b580-b83336c2cc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:34.865462 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64016690-16c7-4924-b580-b83336c2cc9e admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:34.867299 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64016690-16c7-4924-b580-b83336c2cc9e admin admin] RBAC: Authorizing `identity:get_project(project_id=f6644073b15349a5b18a70868298c841)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:34.870031 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64016690-16c7-4924-b580-b83336c2cc9e admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:34.872063 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 200/395] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:34 2021] GET /identity/v3/projects/f6644073b15349a5b18a70868298c841 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:34.877690 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d26fe-60b5-4d17-a21d-32512139206c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:34.878013 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64016690-16c7-4924-b580-b83336c2cc9e admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:34.883703 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d676e27-9924-443c-aa03-19f7712b6729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:34.884479 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d676e27-9924-443c-aa03-19f7712b6729 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:34.884763 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d676e27-9924-443c-aa03-19f7712b6729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:34.885694 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d676e27-9924-443c-aa03-19f7712b6729 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:34.886488 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d676e27-9924-443c-aa03-19f7712b6729 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:34.886801 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d676e27-9924-443c-aa03-19f7712b6729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:34.888934 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d676e27-9924-443c-aa03-19f7712b6729 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:34.890815 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64016690-16c7-4924-b580-b83336c2cc9e admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:34.895411 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47f1b0-98ab-4d66-9ce7-995e0072838d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:34.896389 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47f1b0-98ab-4d66-9ce7-995e0072838d admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:34.896672 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47f1b0-98ab-4d66-9ce7-995e0072838d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:34.896951 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47f1b0-98ab-4d66-9ce7-995e0072838d admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841/groups/82fda1a82eeb488eaa41c41fa6dd711d/roles/d042901298ef4d56b504a30c45128dca` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:34.901447 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47f1b0-98ab-4d66-9ce7-995e0072838d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6644073b15349a5b18a70868298c841, group_id=82fda1a82eeb488eaa41c41fa6dd711d, role_id=d042901298ef4d56b504a30c45128dca)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:34.904301 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47f1b0-98ab-4d66-9ce7-995e0072838d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:34.905491 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 196/396] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:34 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:34.907764 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d676e27-9924-443c-aa03-19f7712b6729 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:34.919667 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d676e27-9924-443c-aa03-19f7712b6729 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:34.922607 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 201/397] 10.222.0.36 () {58 vars in 1463 bytes} [Wed Dec 15 15:58:34 2021] PUT /identity/v3/projects/f6644073b15349a5b18a70868298c841/groups/82fda1a82eeb488eaa41c41fa6dd711d/roles/d042901298ef4d56b504a30c45128dca => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 15:58:34.984495 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856689b-5844-4bbe-b069-3b692e370b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:34.985360 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856689b-5844-4bbe-b069-3b692e370b28 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:34.985665 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856689b-5844-4bbe-b069-3b692e370b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:34.985945 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856689b-5844-4bbe-b069-3b692e370b28 admin admin] PATH_INFO: `/v3/groups/82fda1a82eeb488eaa41c41fa6dd711d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:34.987175 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856689b-5844-4bbe-b069-3b692e370b28 admin admin] RBAC: Authorizing `identity:get_group(group_id=82fda1a82eeb488eaa41c41fa6dd711d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:34.989109 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856689b-5844-4bbe-b069-3b692e370b28 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:34.996635 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 197/398] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Dec 15 15:58:34 2021] GET /identity/v3/groups/82fda1a82eeb488eaa41c41fa6dd711d => generated 226 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:34.998134 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47f1b0-98ab-4d66-9ce7-995e0072838d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:35.016505 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47f1b0-98ab-4d66-9ce7-995e0072838d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:35.029162 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69a78f-60cb-4479-a98b-f476ec086321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:35.030235 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69a78f-60cb-4479-a98b-f476ec086321 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:35.030579 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69a78f-60cb-4479-a98b-f476ec086321 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:35.030907 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69a78f-60cb-4479-a98b-f476ec086321 admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:35.032293 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69a78f-60cb-4479-a98b-f476ec086321 admin admin] RBAC: Authorizing `identity:get_project(project_id=f6644073b15349a5b18a70868298c841)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:35.034557 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69a78f-60cb-4479-a98b-f476ec086321 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:35.040206 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 202/399] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:34 2021] GET /identity/v3/projects/f6644073b15349a5b18a70868298c841 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:35.049417 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856689b-5844-4bbe-b069-3b692e370b28 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:35.061988 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856689b-5844-4bbe-b069-3b692e370b28 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:35.074261 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b5e6c-807a-4c13-845d-cb5444ca074d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:35.075185 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b5e6c-807a-4c13-845d-cb5444ca074d admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:35.075470 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b5e6c-807a-4c13-845d-cb5444ca074d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:35.075750 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b5e6c-807a-4c13-845d-cb5444ca074d admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841/groups/82fda1a82eeb488eaa41c41fa6dd711d/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:35.078074 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b5e6c-807a-4c13-845d-cb5444ca074d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6644073b15349a5b18a70868298c841, group_id=82fda1a82eeb488eaa41c41fa6dd711d, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:35.080725 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b5e6c-807a-4c13-845d-cb5444ca074d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:35.104557 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 198/400] 10.222.0.36 () {58 vars in 1463 bytes} [Wed Dec 15 15:58:35 2021] PUT /identity/v3/projects/f6644073b15349a5b18a70868298c841/groups/82fda1a82eeb488eaa41c41fa6dd711d/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 15:58:35.148648 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b9a68-3868-4fd3-bed7-85d17966e373 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:35.149209 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b9a68-3868-4fd3-bed7-85d17966e373 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:35.149209 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b9a68-3868-4fd3-bed7-85d17966e373 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:35.151151 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 203/401] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:35.157796 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431caaf-874b-42cb-881c-ad003bfb896b None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:35.158318 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431caaf-874b-42cb-881c-ad003bfb896b None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:35.158430 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431caaf-874b-42cb-881c-ad003bfb896b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:35.182184 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-c431caaf-874b-42cb-881c-ad003bfb896b None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:35.183448 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-c431caaf-874b-42cb-881c-ad003bfb896b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:35.260284 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 199/402] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:35.287477 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b9a68-3868-4fd3-bed7-85d17966e373 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:35.301642 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b9a68-3868-4fd3-bed7-85d17966e373 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:35.306704 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886a0f3-4e74-4ad5-99e3-ae8965fbe31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:35.307527 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886a0f3-4e74-4ad5-99e3-ae8965fbe31f admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:35.307815 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886a0f3-4e74-4ad5-99e3-ae8965fbe31f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:35.308089 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886a0f3-4e74-4ad5-99e3-ae8965fbe31f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:35.322331 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886a0f3-4e74-4ad5-99e3-ae8965fbe31f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:35.329947 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-0886a0f3-4e74-4ad5-99e3-ae8965fbe31f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 15:58:35.337560 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 204/403] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Dec 15 15:58:35 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:35.338961 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431caaf-874b-42cb-881c-ad003bfb896b None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:35.348318 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431caaf-874b-42cb-881c-ad003bfb896b None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:35.354018 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87218737-a387-4de5-9a09-5f3e6eb69d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:35.354713 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87218737-a387-4de5-9a09-5f3e6eb69d6c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:35.354999 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87218737-a387-4de5-9a09-5f3e6eb69d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:35.355273 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87218737-a387-4de5-9a09-5f3e6eb69d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:35.356049 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87218737-a387-4de5-9a09-5f3e6eb69d6c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:35.356358 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87218737-a387-4de5-9a09-5f3e6eb69d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:35.358068 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87218737-a387-4de5-9a09-5f3e6eb69d6c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:35.369957 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 200/404] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:35 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:35.376778 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886a0f3-4e74-4ad5-99e3-ae8965fbe31f admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:35.390645 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886a0f3-4e74-4ad5-99e3-ae8965fbe31f admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:35.395667 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6f03a-82be-4acb-ac96-3ef55d2f2006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:35.396611 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6f03a-82be-4acb-ac96-3ef55d2f2006 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:35.396939 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6f03a-82be-4acb-ac96-3ef55d2f2006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:35.397422 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6f03a-82be-4acb-ac96-3ef55d2f2006 admin admin] PATH_INFO: `/v3/groups/82fda1a82eeb488eaa41c41fa6dd711d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:35.401077 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6f03a-82be-4acb-ac96-3ef55d2f2006 admin admin] RBAC: Authorizing `identity:get_group(group_id=82fda1a82eeb488eaa41c41fa6dd711d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:35.403166 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6f03a-82be-4acb-ac96-3ef55d2f2006 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:35.405404 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 205/405] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Dec 15 15:58:35 2021] GET /identity/v3/groups/82fda1a82eeb488eaa41c41fa6dd711d => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:35.411563 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87218737-a387-4de5-9a09-5f3e6eb69d6c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:35.427213 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87218737-a387-4de5-9a09-5f3e6eb69d6c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:35.440885 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01455f17-224c-437d-99e4-a69808a1c80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:35.441790 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01455f17-224c-437d-99e4-a69808a1c80a admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:35.442072 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01455f17-224c-437d-99e4-a69808a1c80a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:35.442349 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01455f17-224c-437d-99e4-a69808a1c80a admin admin] PATH_INFO: `/v3/projects/2a96cf65568148549e7ca922f4c5215f` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:35.445952 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01455f17-224c-437d-99e4-a69808a1c80a admin admin] RBAC: Authorizing `identity:get_project(project_id=2a96cf65568148549e7ca922f4c5215f)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:35.448047 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01455f17-224c-437d-99e4-a69808a1c80a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:35.449778 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 201/406] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:35 2021] GET /identity/v3/projects/2a96cf65568148549e7ca922f4c5215f => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:35.455874 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6f03a-82be-4acb-ac96-3ef55d2f2006 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:35.469285 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6f03a-82be-4acb-ac96-3ef55d2f2006 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:35.473804 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619416a-9457-4ec8-9760-3e13200d4659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:35.474675 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619416a-9457-4ec8-9760-3e13200d4659 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:35.474961 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619416a-9457-4ec8-9760-3e13200d4659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:35.475899 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619416a-9457-4ec8-9760-3e13200d4659 admin admin] PATH_INFO: `/v3/projects/2a96cf65568148549e7ca922f4c5215f/groups/82fda1a82eeb488eaa41c41fa6dd711d/roles/d042901298ef4d56b504a30c45128dca` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:35.478524 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619416a-9457-4ec8-9760-3e13200d4659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a96cf65568148549e7ca922f4c5215f, group_id=82fda1a82eeb488eaa41c41fa6dd711d, role_id=d042901298ef4d56b504a30c45128dca)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:35.481169 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619416a-9457-4ec8-9760-3e13200d4659 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:35.502371 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 206/407] 10.222.0.36 () {58 vars in 1463 bytes} [Wed Dec 15 15:58:35 2021] PUT /identity/v3/projects/2a96cf65568148549e7ca922f4c5215f/groups/82fda1a82eeb488eaa41c41fa6dd711d/roles/d042901298ef4d56b504a30c45128dca => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 15:58:36.160170 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d546d-fcdd-4951-ab73-cb75d9ddd4bf None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:36.160843 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d546d-fcdd-4951-ab73-cb75d9ddd4bf None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:36.160843 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d546d-fcdd-4951-ab73-cb75d9ddd4bf None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:36.162846 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 202/408] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:36.168967 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949eb199-aa8d-4d13-9ff9-cce364e64afb None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:36.169827 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949eb199-aa8d-4d13-9ff9-cce364e64afb None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:36.170334 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949eb199-aa8d-4d13-9ff9-cce364e64afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:36.190835 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-949eb199-aa8d-4d13-9ff9-cce364e64afb None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:36.192347 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-949eb199-aa8d-4d13-9ff9-cce364e64afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:36.274849 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 207/409] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:36.309885 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d546d-fcdd-4951-ab73-cb75d9ddd4bf None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:36.326977 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d546d-fcdd-4951-ab73-cb75d9ddd4bf None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:36.331869 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1577bf4-0a83-4e77-a953-96a6b1883550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:36.332921 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1577bf4-0a83-4e77-a953-96a6b1883550 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:36.333423 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1577bf4-0a83-4e77-a953-96a6b1883550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:36.333922 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1577bf4-0a83-4e77-a953-96a6b1883550 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:36.348046 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1577bf4-0a83-4e77-a953-96a6b1883550 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:36.358096 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-c1577bf4-0a83-4e77-a953-96a6b1883550 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 15:58:36.359608 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 203/410] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:58:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:36.366015 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949eb199-aa8d-4d13-9ff9-cce364e64afb None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:36.375560 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949eb199-aa8d-4d13-9ff9-cce364e64afb None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:36.380624 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41622566-43cd-435f-8921-5339521dcfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:36.382259 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41622566-43cd-435f-8921-5339521dcfcb admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:36.382947 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41622566-43cd-435f-8921-5339521dcfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:36.383429 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41622566-43cd-435f-8921-5339521dcfcb admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:36.384415 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41622566-43cd-435f-8921-5339521dcfcb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:36.384926 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41622566-43cd-435f-8921-5339521dcfcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:36.386777 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41622566-43cd-435f-8921-5339521dcfcb admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:36.402008 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 208/411] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:36.408060 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1577bf4-0a83-4e77-a953-96a6b1883550 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:36.419343 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1577bf4-0a83-4e77-a953-96a6b1883550 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:36.430370 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db001d-4bc2-4730-b4a4-78a2807fba12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:36.431517 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db001d-4bc2-4730-b4a4-78a2807fba12 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:36.432018 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db001d-4bc2-4730-b4a4-78a2807fba12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:36.432532 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db001d-4bc2-4730-b4a4-78a2807fba12 admin admin] PATH_INFO: `/v3/groups/195f7284c08c4732a894407516e0b99a` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:36.438114 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db001d-4bc2-4730-b4a4-78a2807fba12 admin admin] RBAC: Authorizing `identity:get_group(group_id=195f7284c08c4732a894407516e0b99a)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:36.440280 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db001d-4bc2-4730-b4a4-78a2807fba12 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:36.442442 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 204/412] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Dec 15 15:58:36 2021] GET /identity/v3/groups/195f7284c08c4732a894407516e0b99a => generated 229 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:36.448690 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41622566-43cd-435f-8921-5339521dcfcb admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:36.462909 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41622566-43cd-435f-8921-5339521dcfcb admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:36.472680 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da1f80-b5b6-44f3-b48f-f6f1bf13bc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:36.473565 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da1f80-b5b6-44f3-b48f-f6f1bf13bc3b admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:36.473847 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da1f80-b5b6-44f3-b48f-f6f1bf13bc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:36.474119 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da1f80-b5b6-44f3-b48f-f6f1bf13bc3b admin admin] PATH_INFO: `/v3/projects/d7bb9a879a6841dda52e30764e5ba9c7` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:36.477089 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da1f80-b5b6-44f3-b48f-f6f1bf13bc3b admin admin] RBAC: Authorizing `identity:get_project(project_id=d7bb9a879a6841dda52e30764e5ba9c7)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:36.478915 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da1f80-b5b6-44f3-b48f-f6f1bf13bc3b admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:36.480593 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 209/413] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:36 2021] GET /identity/v3/projects/d7bb9a879a6841dda52e30764e5ba9c7 => generated 344 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:36.486571 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db001d-4bc2-4730-b4a4-78a2807fba12 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:36.497335 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db001d-4bc2-4730-b4a4-78a2807fba12 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:36.506978 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f149f0d-418e-47ef-9128-f9011939b012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:36.508109 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f149f0d-418e-47ef-9128-f9011939b012 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:36.508601 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f149f0d-418e-47ef-9128-f9011939b012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:36.509078 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f149f0d-418e-47ef-9128-f9011939b012 admin admin] PATH_INFO: `/v3/projects/d7bb9a879a6841dda52e30764e5ba9c7/groups/195f7284c08c4732a894407516e0b99a/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:36.514679 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f149f0d-418e-47ef-9128-f9011939b012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7bb9a879a6841dda52e30764e5ba9c7, group_id=195f7284c08c4732a894407516e0b99a, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:36.517586 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f149f0d-418e-47ef-9128-f9011939b012 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:36.535834 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 205/414] 10.222.0.36 () {58 vars in 1463 bytes} [Wed Dec 15 15:58:36 2021] PUT /identity/v3/projects/d7bb9a879a6841dda52e30764e5ba9c7/groups/195f7284c08c4732a894407516e0b99a/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 15:58:37.622613 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7d0fb-56a7-44e9-b88e-bdaccfcca9fe None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:37.623126 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7d0fb-56a7-44e9-b88e-bdaccfcca9fe None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:37.623202 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7d0fb-56a7-44e9-b88e-bdaccfcca9fe None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:37.625223 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 210/415] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:37.631058 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bfbaf-7b3c-45f1-a747-e4b218781345 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:37.632620 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bfbaf-7b3c-45f1-a747-e4b218781345 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:37.633109 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bfbaf-7b3c-45f1-a747-e4b218781345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:37.658512 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-db6bfbaf-7b3c-45f1-a747-e4b218781345 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:37.660113 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-db6bfbaf-7b3c-45f1-a747-e4b218781345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:37.735137 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 206/416] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:37.767394 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7d0fb-56a7-44e9-b88e-bdaccfcca9fe None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:37.791316 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7d0fb-56a7-44e9-b88e-bdaccfcca9fe None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:37.802284 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f8324-cb0d-450f-809a-972947f72f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:37.803775 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f8324-cb0d-450f-809a-972947f72f42 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:37.804105 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f8324-cb0d-450f-809a-972947f72f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:37.804389 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f8324-cb0d-450f-809a-972947f72f42 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:37.822172 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f8324-cb0d-450f-809a-972947f72f42 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:37.829213 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-5b0f8324-cb0d-450f-809a-972947f72f42 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 15:58:37.830756 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 211/417] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:37 2021] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:37.837081 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bfbaf-7b3c-45f1-a747-e4b218781345 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:37.851087 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bfbaf-7b3c-45f1-a747-e4b218781345 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:37.864149 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c267a54-8fd9-41c2-b2de-d53420ec43e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:37.865111 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c267a54-8fd9-41c2-b2de-d53420ec43e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:37.866338 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c267a54-8fd9-41c2-b2de-d53420ec43e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:37.866874 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c267a54-8fd9-41c2-b2de-d53420ec43e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:37.867839 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c267a54-8fd9-41c2-b2de-d53420ec43e5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:37.868339 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c267a54-8fd9-41c2-b2de-d53420ec43e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:37.870200 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c267a54-8fd9-41c2-b2de-d53420ec43e5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:37.887763 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 207/418] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:37 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:37.893302 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f8324-cb0d-450f-809a-972947f72f42 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:37.910516 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f8324-cb0d-450f-809a-972947f72f42 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:37.917526 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23538e3a-0813-43b9-882f-15d70f09ca15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:37.918169 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23538e3a-0813-43b9-882f-15d70f09ca15 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:37.918455 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23538e3a-0813-43b9-882f-15d70f09ca15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:37.918737 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23538e3a-0813-43b9-882f-15d70f09ca15 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:37.934197 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23538e3a-0813-43b9-882f-15d70f09ca15 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:37.935982 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23538e3a-0813-43b9-882f-15d70f09ca15 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:37.953657 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 212/419] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:37 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:37.959489 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c267a54-8fd9-41c2-b2de-d53420ec43e5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:37.969901 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c267a54-8fd9-41c2-b2de-d53420ec43e5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:37.976214 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de835c-f4f4-40f4-b1e8-c00ff0c3c3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:37.977427 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de835c-f4f4-40f4-b1e8-c00ff0c3c3cd admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:37.977965 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de835c-f4f4-40f4-b1e8-c00ff0c3c3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:37.978452 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de835c-f4f4-40f4-b1e8-c00ff0c3c3cd admin admin] PATH_INFO: `/v3/projects/2a96cf65568148549e7ca922f4c5215f` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:37.979926 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de835c-f4f4-40f4-b1e8-c00ff0c3c3cd admin admin] RBAC: Authorizing `identity:get_project(project_id=2a96cf65568148549e7ca922f4c5215f)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:37.982281 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de835c-f4f4-40f4-b1e8-c00ff0c3c3cd admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:37.984199 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 208/420] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:37 2021] GET /identity/v3/projects/2a96cf65568148549e7ca922f4c5215f => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:37.990248 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23538e3a-0813-43b9-882f-15d70f09ca15 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:38.000608 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23538e3a-0813-43b9-882f-15d70f09ca15 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:38.009602 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970af91e-fb2d-4f44-a862-446630771513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:38.010758 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970af91e-fb2d-4f44-a862-446630771513 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.011238 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970af91e-fb2d-4f44-a862-446630771513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.011786 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970af91e-fb2d-4f44-a862-446630771513 admin admin] PATH_INFO: `/v3/groups/82fda1a82eeb488eaa41c41fa6dd711d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.014480 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970af91e-fb2d-4f44-a862-446630771513 admin admin] RBAC: Authorizing `identity:get_group(group_id=82fda1a82eeb488eaa41c41fa6dd711d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:38.016704 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970af91e-fb2d-4f44-a862-446630771513 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:38.018973 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 213/421] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Dec 15 15:58:37 2021] GET /identity/v3/groups/82fda1a82eeb488eaa41c41fa6dd711d => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:38.025010 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de835c-f4f4-40f4-b1e8-c00ff0c3c3cd admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:38.057879 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de835c-f4f4-40f4-b1e8-c00ff0c3c3cd admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:38.062560 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71aca7-37ae-48d6-b714-ffab3aa24ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:38.063208 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71aca7-37ae-48d6-b714-ffab3aa24ddc admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.063480 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71aca7-37ae-48d6-b714-ffab3aa24ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.063756 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71aca7-37ae-48d6-b714-ffab3aa24ddc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.064595 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71aca7-37ae-48d6-b714-ffab3aa24ddc admin admin] RBAC: Adding query filter params (group.id=82fda1a82eeb488eaa41c41fa6dd711d, role.id=530f09f883ac47cba230257bcf458141, scope.project.id=2a96cf65568148549e7ca922f4c5215f) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:38.064905 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71aca7-37ae-48d6-b714-ffab3aa24ddc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:38.066795 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71aca7-37ae-48d6-b714-ffab3aa24ddc admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:38.074292 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 209/422] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Dec 15 15:58:38 2021] GET /identity/v3/role_assignments?group.id=82fda1a82eeb488eaa41c41fa6dd711d&scope.project.id=2a96cf65568148549e7ca922f4c5215f&role.id=530f09f883ac47cba230257bcf458141 => generated 611 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:38.428543 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba34432-7364-4265-9bf8-88cbdc12d00c None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.429260 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba34432-7364-4265-9bf8-88cbdc12d00c None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.429794 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba34432-7364-4265-9bf8-88cbdc12d00c None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.431748 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 214/423] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:38.443445 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887a1e6-29c6-4680-9ec5-3cebcdea8ab2 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.443819 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887a1e6-29c6-4680-9ec5-3cebcdea8ab2 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.444066 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887a1e6-29c6-4680-9ec5-3cebcdea8ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.470493 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-b887a1e6-29c6-4680-9ec5-3cebcdea8ab2 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:38.471706 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-b887a1e6-29c6-4680-9ec5-3cebcdea8ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:38.487193 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 210/424] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:38.524085 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba34432-7364-4265-9bf8-88cbdc12d00c None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:38.540854 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba34432-7364-4265-9bf8-88cbdc12d00c None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:38.545668 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5eaec2-2a92-47f4-a122-8d0a58d9d96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:38.546744 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5eaec2-2a92-47f4-a122-8d0a58d9d96b admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.547241 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5eaec2-2a92-47f4-a122-8d0a58d9d96b admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.547727 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5eaec2-2a92-47f4-a122-8d0a58d9d96b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.559536 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5eaec2-2a92-47f4-a122-8d0a58d9d96b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:38.571209 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-4e5eaec2-2a92-47f4-a122-8d0a58d9d96b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 15:58:38.574237 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 215/425] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Dec 15 15:58:38 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:38.579718 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887a1e6-29c6-4680-9ec5-3cebcdea8ab2 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:38.589608 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887a1e6-29c6-4680-9ec5-3cebcdea8ab2 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:38.596508 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f9ff3-5063-404d-9203-577de37ebc47 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.597040 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f9ff3-5063-404d-9203-577de37ebc47 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.597544 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f9ff3-5063-404d-9203-577de37ebc47 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.598760 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056446c9-7767-423e-83a2-c9b8b393db03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:38.599456 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056446c9-7767-423e-83a2-c9b8b393db03 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.600310 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056446c9-7767-423e-83a2-c9b8b393db03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.600553 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056446c9-7767-423e-83a2-c9b8b393db03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.601003 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 216/426] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:58:38.601327 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056446c9-7767-423e-83a2-c9b8b393db03 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:38.601671 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056446c9-7767-423e-83a2-c9b8b393db03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:38.604597 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056446c9-7767-423e-83a2-c9b8b393db03 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:38.612715 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 211/427] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:38 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:38.614316 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680afbe7-962e-45f9-9339-f13a9f3f0c9a None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.614819 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680afbe7-962e-45f9-9339-f13a9f3f0c9a None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.615706 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680afbe7-962e-45f9-9339-f13a9f3f0c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.620188 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056446c9-7767-423e-83a2-c9b8b393db03 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:38.633120 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056446c9-7767-423e-83a2-c9b8b393db03 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:38.638256 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-680afbe7-962e-45f9-9339-f13a9f3f0c9a None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:38.643459 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d41efa-e10d-401f-8022-fcd863053148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:38.644000 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-680afbe7-962e-45f9-9339-f13a9f3f0c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:38.644109 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d41efa-e10d-401f-8022-fcd863053148 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.644389 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d41efa-e10d-401f-8022-fcd863053148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.644663 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d41efa-e10d-401f-8022-fcd863053148 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.659413 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 217/428] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:38.659738 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d41efa-e10d-401f-8022-fcd863053148 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:38.661270 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebb1e6-8d4e-4b7e-ac05-96a2f840b3a8 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.661716 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d41efa-e10d-401f-8022-fcd863053148 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:38.661941 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebb1e6-8d4e-4b7e-ac05-96a2f840b3a8 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.662262 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebb1e6-8d4e-4b7e-ac05-96a2f840b3a8 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.664429 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 218/429] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:38.671691 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a467e-a447-462c-9cad-86b5c0c3fc1c None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.671978 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a467e-a447-462c-9cad-86b5c0c3fc1c None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.672341 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a467e-a447-462c-9cad-86b5c0c3fc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.676079 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 212/430] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:38 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 15:58:38.682675 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d41efa-e10d-401f-8022-fcd863053148 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:38.691923 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-d35a467e-a447-462c-9cad-86b5c0c3fc1c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:38.693103 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-d35a467e-a447-462c-9cad-86b5c0c3fc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:38.694885 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d41efa-e10d-401f-8022-fcd863053148 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:38.702003 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81314995-f07b-4132-86ae-88ef70af5750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:38.703265 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81314995-f07b-4132-86ae-88ef70af5750 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.703553 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81314995-f07b-4132-86ae-88ef70af5750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.703831 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81314995-f07b-4132-86ae-88ef70af5750 admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.705910 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 219/431] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:38.706182 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81314995-f07b-4132-86ae-88ef70af5750 admin admin] RBAC: Authorizing `identity:get_project(project_id=f6644073b15349a5b18a70868298c841)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:38.706732 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a467e-a447-462c-9cad-86b5c0c3fc1c None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:38.708428 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81314995-f07b-4132-86ae-88ef70af5750 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:38.710883 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 213/432] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:38 2021] GET /identity/v3/projects/f6644073b15349a5b18a70868298c841 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:38.717211 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81314995-f07b-4132-86ae-88ef70af5750 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:38.722481 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a467e-a447-462c-9cad-86b5c0c3fc1c None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:38.731129 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81314995-f07b-4132-86ae-88ef70af5750 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:38.734355 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3036d-ac0b-4bd7-9e0a-9fb3910e9c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:38.735160 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3036d-ac0b-4bd7-9e0a-9fb3910e9c21 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.735442 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3036d-ac0b-4bd7-9e0a-9fb3910e9c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.735712 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3036d-ac0b-4bd7-9e0a-9fb3910e9c21 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.739943 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38613126-5343-4716-b0d7-daef8dc260ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:38.741859 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38613126-5343-4716-b0d7-daef8dc260ed admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.742552 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38613126-5343-4716-b0d7-daef8dc260ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.743009 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38613126-5343-4716-b0d7-daef8dc260ed admin admin] PATH_INFO: `/v3/groups/82fda1a82eeb488eaa41c41fa6dd711d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.744786 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38613126-5343-4716-b0d7-daef8dc260ed admin admin] RBAC: Authorizing `identity:get_group(group_id=82fda1a82eeb488eaa41c41fa6dd711d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:38.747480 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38613126-5343-4716-b0d7-daef8dc260ed admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:38.749678 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3036d-ac0b-4bd7-9e0a-9fb3910e9c21 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:38.750081 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 214/433] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Dec 15 15:58:38 2021] GET /identity/v3/groups/82fda1a82eeb488eaa41c41fa6dd711d => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:38.750982 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38613126-5343-4716-b0d7-daef8dc260ed admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:38.761309 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38613126-5343-4716-b0d7-daef8dc260ed admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:38.762797 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-54b3036d-ac0b-4bd7-9e0a-9fb3910e9c21 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 15:58:38.764122 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 220/434] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Dec 15 15:58:38 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:38.764762 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3036d-ac0b-4bd7-9e0a-9fb3910e9c21 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:38.766357 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562975c-c71b-4f9a-a578-ab20766059c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:38.767116 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562975c-c71b-4f9a-a578-ab20766059c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.767450 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562975c-c71b-4f9a-a578-ab20766059c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.767724 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562975c-c71b-4f9a-a578-ab20766059c9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.777854 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3036d-ac0b-4bd7-9e0a-9fb3910e9c21 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:38.783227 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562975c-c71b-4f9a-a578-ab20766059c9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:38.784815 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56f6f5-7ce4-4343-8c00-7d97edab3866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:38.785485 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56f6f5-7ce4-4343-8c00-7d97edab3866 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.785772 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56f6f5-7ce4-4343-8c00-7d97edab3866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.786049 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56f6f5-7ce4-4343-8c00-7d97edab3866 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.787165 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56f6f5-7ce4-4343-8c00-7d97edab3866 admin admin] RBAC: Adding query filter params (group.id=82fda1a82eeb488eaa41c41fa6dd711d, role.id=d042901298ef4d56b504a30c45128dca, scope.project.id=f6644073b15349a5b18a70868298c841) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:38.788151 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56f6f5-7ce4-4343-8c00-7d97edab3866 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:38.791314 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56f6f5-7ce4-4343-8c00-7d97edab3866 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:38.791426 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-5562975c-c71b-4f9a-a578-ab20766059c9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 15:58:38.792516 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 215/435] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:38 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:38.794447 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562975c-c71b-4f9a-a578-ab20766059c9 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:38.801651 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 221/436] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Dec 15 15:58:38 2021] GET /identity/v3/role_assignments?group.id=82fda1a82eeb488eaa41c41fa6dd711d&scope.project.id=f6644073b15349a5b18a70868298c841&role.id=d042901298ef4d56b504a30c45128dca => generated 611 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:38.803667 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56f6f5-7ce4-4343-8c00-7d97edab3866 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:38.812478 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562975c-c71b-4f9a-a578-ab20766059c9 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:38.817419 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56f6f5-7ce4-4343-8c00-7d97edab3866 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:38.817623 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff678db7-546b-4118-ac0d-f8aad6de8d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:38.818113 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff678db7-546b-4118-ac0d-f8aad6de8d54 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.818399 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff678db7-546b-4118-ac0d-f8aad6de8d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.818867 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff678db7-546b-4118-ac0d-f8aad6de8d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.819855 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff678db7-546b-4118-ac0d-f8aad6de8d54 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:38.820167 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff678db7-546b-4118-ac0d-f8aad6de8d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:38.821908 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff678db7-546b-4118-ac0d-f8aad6de8d54 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:38.824967 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc351e5d-9bb7-41fd-b48b-1f787fdd9a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:38.825959 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc351e5d-9bb7-41fd-b48b-1f787fdd9a92 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.826447 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc351e5d-9bb7-41fd-b48b-1f787fdd9a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.826921 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc351e5d-9bb7-41fd-b48b-1f787fdd9a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.828535 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc351e5d-9bb7-41fd-b48b-1f787fdd9a92 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:38.829092 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc351e5d-9bb7-41fd-b48b-1f787fdd9a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:38.831274 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc351e5d-9bb7-41fd-b48b-1f787fdd9a92 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:38.831972 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 216/437] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:38 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:38.839044 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff678db7-546b-4118-ac0d-f8aad6de8d54 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:38.843190 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 222/438] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:58:38 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:38.851129 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc351e5d-9bb7-41fd-b48b-1f787fdd9a92 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:38.854547 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff678db7-546b-4118-ac0d-f8aad6de8d54 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:38.863007 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd59311-53e7-4eff-b07a-631edafbaf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:38.863923 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd59311-53e7-4eff-b07a-631edafbaf1f admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.864418 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd59311-53e7-4eff-b07a-631edafbaf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.864843 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd59311-53e7-4eff-b07a-631edafbaf1f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.865166 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc351e5d-9bb7-41fd-b48b-1f787fdd9a92 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:38.870247 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af1936-1c44-4e72-9635-b2d8e42f37d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:38.871703 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af1936-1c44-4e72-9635-b2d8e42f37d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.871703 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af1936-1c44-4e72-9635-b2d8e42f37d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.872049 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af1936-1c44-4e72-9635-b2d8e42f37d2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.876184 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd59311-53e7-4eff-b07a-631edafbaf1f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:38.878477 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd59311-53e7-4eff-b07a-631edafbaf1f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:38.882824 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af1936-1c44-4e72-9635-b2d8e42f37d2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:38.885562 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af1936-1c44-4e72-9635-b2d8e42f37d2 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:38.890083 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 217/439] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:38 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:38.896253 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 223/440] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:38 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:38.897533 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd59311-53e7-4eff-b07a-631edafbaf1f admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:38.904087 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af1936-1c44-4e72-9635-b2d8e42f37d2 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:38.909008 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd59311-53e7-4eff-b07a-631edafbaf1f admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:38.915829 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440b8f8-bd81-46bf-af5a-0acdc7e0508d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:38.916825 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af1936-1c44-4e72-9635-b2d8e42f37d2 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:38.917325 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440b8f8-bd81-46bf-af5a-0acdc7e0508d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.917847 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440b8f8-bd81-46bf-af5a-0acdc7e0508d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.918381 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440b8f8-bd81-46bf-af5a-0acdc7e0508d admin admin] PATH_INFO: `/v3/projects/2a96cf65568148549e7ca922f4c5215f` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.919962 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440b8f8-bd81-46bf-af5a-0acdc7e0508d admin admin] RBAC: Authorizing `identity:get_project(project_id=2a96cf65568148549e7ca922f4c5215f)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:38.921435 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fcec8-3464-4a07-865c-817e88a76849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:38.922308 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fcec8-3464-4a07-865c-817e88a76849 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.922587 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fcec8-3464-4a07-865c-817e88a76849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.922868 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fcec8-3464-4a07-865c-817e88a76849 admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.923459 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440b8f8-bd81-46bf-af5a-0acdc7e0508d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:38.924087 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fcec8-3464-4a07-865c-817e88a76849 admin admin] RBAC: Authorizing `identity:get_project(project_id=f6644073b15349a5b18a70868298c841)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:38.926050 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 218/441] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:38 2021] GET /identity/v3/projects/2a96cf65568148549e7ca922f4c5215f => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:38.926185 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fcec8-3464-4a07-865c-817e88a76849 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:38.928192 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 224/442] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:38 2021] GET /identity/v3/projects/f6644073b15349a5b18a70868298c841 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:38.932660 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440b8f8-bd81-46bf-af5a-0acdc7e0508d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:38.934495 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fcec8-3464-4a07-865c-817e88a76849 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:38.945098 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fcec8-3464-4a07-865c-817e88a76849 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:38.946720 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440b8f8-bd81-46bf-af5a-0acdc7e0508d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:38.950322 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2990c-af82-4fff-9ab4-58357433dd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:38.951206 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2990c-af82-4fff-9ab4-58357433dd1f admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.951487 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2990c-af82-4fff-9ab4-58357433dd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.951764 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2990c-af82-4fff-9ab4-58357433dd1f admin admin] PATH_INFO: `/v3/groups/82fda1a82eeb488eaa41c41fa6dd711d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.953210 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2990c-af82-4fff-9ab4-58357433dd1f admin admin] RBAC: Authorizing `identity:get_group(group_id=82fda1a82eeb488eaa41c41fa6dd711d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:38.953892 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36acbaab-ba02-4d2c-b4e8-35dee97434df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:38.955121 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acbaab-ba02-4d2c-b4e8-35dee97434df admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.955305 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2990c-af82-4fff-9ab4-58357433dd1f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:38.955839 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acbaab-ba02-4d2c-b4e8-35dee97434df admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.956327 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acbaab-ba02-4d2c-b4e8-35dee97434df admin admin] PATH_INFO: `/v3/groups/82fda1a82eeb488eaa41c41fa6dd711d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.957307 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 225/443] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Dec 15 15:58:38 2021] GET /identity/v3/groups/82fda1a82eeb488eaa41c41fa6dd711d => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:38.958149 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36acbaab-ba02-4d2c-b4e8-35dee97434df admin admin] RBAC: Authorizing `identity:get_group(group_id=82fda1a82eeb488eaa41c41fa6dd711d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:38.960610 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36acbaab-ba02-4d2c-b4e8-35dee97434df admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:38.962352 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 219/444] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Dec 15 15:58:38 2021] GET /identity/v3/groups/82fda1a82eeb488eaa41c41fa6dd711d => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:38.965503 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2990c-af82-4fff-9ab4-58357433dd1f admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:38.969371 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36acbaab-ba02-4d2c-b4e8-35dee97434df admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:38.974368 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2990c-af82-4fff-9ab4-58357433dd1f admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:38.981839 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf49e3-770b-44df-ac1e-71a733ed33a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:38.982635 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf49e3-770b-44df-ac1e-71a733ed33a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.982948 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36acbaab-ba02-4d2c-b4e8-35dee97434df admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:38.983281 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf49e3-770b-44df-ac1e-71a733ed33a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.983657 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf49e3-770b-44df-ac1e-71a733ed33a8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.984737 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf49e3-770b-44df-ac1e-71a733ed33a8 admin admin] RBAC: Adding query filter params (group.id=82fda1a82eeb488eaa41c41fa6dd711d, role.id=530f09f883ac47cba230257bcf458141, scope.project.id=f6644073b15349a5b18a70868298c841) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:38.985276 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf49e3-770b-44df-ac1e-71a733ed33a8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:38.987983 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf49e3-770b-44df-ac1e-71a733ed33a8 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:38.988918 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee435e05-81ca-43fc-a66b-8da3a047d830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:38.989833 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee435e05-81ca-43fc-a66b-8da3a047d830 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:38.990390 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee435e05-81ca-43fc-a66b-8da3a047d830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:38.990876 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee435e05-81ca-43fc-a66b-8da3a047d830 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:38.991968 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee435e05-81ca-43fc-a66b-8da3a047d830 admin admin] RBAC: Adding query filter params (group.id=82fda1a82eeb488eaa41c41fa6dd711d, role.id=d042901298ef4d56b504a30c45128dca, scope.project.id=2a96cf65568148549e7ca922f4c5215f) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:38.992472 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee435e05-81ca-43fc-a66b-8da3a047d830 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:38.994623 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee435e05-81ca-43fc-a66b-8da3a047d830 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:38.996319 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 226/445] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Dec 15 15:58:38 2021] GET /identity/v3/role_assignments?group.id=82fda1a82eeb488eaa41c41fa6dd711d&scope.project.id=f6644073b15349a5b18a70868298c841&role.id=530f09f883ac47cba230257bcf458141 => generated 611 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:39.001634 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 220/446] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Dec 15 15:58:38 2021] GET /identity/v3/role_assignments?group.id=82fda1a82eeb488eaa41c41fa6dd711d&scope.project.id=2a96cf65568148549e7ca922f4c5215f&role.id=d042901298ef4d56b504a30c45128dca => generated 611 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:39.618487 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f847a-1423-4d26-8c7d-f19db16b3a4b None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:39.618774 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f847a-1423-4d26-8c7d-f19db16b3a4b None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:39.619045 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f847a-1423-4d26-8c7d-f19db16b3a4b None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:39.620796 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 227/447] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:39.626606 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708ab7a-5c3b-439b-8125-b2f1f6182130 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:39.626898 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708ab7a-5c3b-439b-8125-b2f1f6182130 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:39.627175 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708ab7a-5c3b-439b-8125-b2f1f6182130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:39.644847 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-f708ab7a-5c3b-439b-8125-b2f1f6182130 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:39.646064 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-f708ab7a-5c3b-439b-8125-b2f1f6182130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:39.654585 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 221/448] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:39.678685 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f847a-1423-4d26-8c7d-f19db16b3a4b None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:39.690844 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f847a-1423-4d26-8c7d-f19db16b3a4b None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:39.695305 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdb944-daf7-48e5-ab50-c359d30e4786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:39.696080 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdb944-daf7-48e5-ab50-c359d30e4786 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:39.696365 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdb944-daf7-48e5-ab50-c359d30e4786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:39.696649 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdb944-daf7-48e5-ab50-c359d30e4786 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:39.707129 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bdb944-daf7-48e5-ab50-c359d30e4786 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:39.714611 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-d5bdb944-daf7-48e5-ab50-c359d30e4786 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 15:58:39.715783 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 228/449] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:58:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:39.721986 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708ab7a-5c3b-439b-8125-b2f1f6182130 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:39.731747 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708ab7a-5c3b-439b-8125-b2f1f6182130 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:39.736236 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30563727-33dd-486d-ac7d-0877906357e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:39.736894 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30563727-33dd-486d-ac7d-0877906357e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:39.737175 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30563727-33dd-486d-ac7d-0877906357e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:39.737476 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30563727-33dd-486d-ac7d-0877906357e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:39.738235 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30563727-33dd-486d-ac7d-0877906357e3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:39.738538 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30563727-33dd-486d-ac7d-0877906357e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:39.740142 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30563727-33dd-486d-ac7d-0877906357e3 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:39.749045 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 222/450] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:39.755267 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdb944-daf7-48e5-ab50-c359d30e4786 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:39.765734 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdb944-daf7-48e5-ab50-c359d30e4786 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:39.770142 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1fc27-f901-4ad4-bfed-381f9a2432da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:39.770766 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1fc27-f901-4ad4-bfed-381f9a2432da admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:39.771061 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1fc27-f901-4ad4-bfed-381f9a2432da admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:39.771337 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1fc27-f901-4ad4-bfed-381f9a2432da admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:39.780093 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1fc27-f901-4ad4-bfed-381f9a2432da admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:39.781891 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1fc27-f901-4ad4-bfed-381f9a2432da admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:39.791856 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 229/451] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:39 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:39.798021 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30563727-33dd-486d-ac7d-0877906357e3 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:39.807717 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30563727-33dd-486d-ac7d-0877906357e3 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:39.811993 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94765f-0135-4e3d-b1ea-2a648cac7063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:39.812825 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94765f-0135-4e3d-b1ea-2a648cac7063 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:39.813105 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94765f-0135-4e3d-b1ea-2a648cac7063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:39.813375 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94765f-0135-4e3d-b1ea-2a648cac7063 admin admin] PATH_INFO: `/v3/projects/d7bb9a879a6841dda52e30764e5ba9c7` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:39.814673 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94765f-0135-4e3d-b1ea-2a648cac7063 admin admin] RBAC: Authorizing `identity:get_project(project_id=d7bb9a879a6841dda52e30764e5ba9c7)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:39.816455 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94765f-0135-4e3d-b1ea-2a648cac7063 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:39.818111 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 223/452] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:58:39 2021] GET /identity/v3/projects/d7bb9a879a6841dda52e30764e5ba9c7 => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:39.824465 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1fc27-f901-4ad4-bfed-381f9a2432da admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:39.833339 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1fc27-f901-4ad4-bfed-381f9a2432da admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:39.838435 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7c39f-da03-4ee0-943b-ecfb83bf17e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:39.839264 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7c39f-da03-4ee0-943b-ecfb83bf17e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:39.839541 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7c39f-da03-4ee0-943b-ecfb83bf17e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:39.839808 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7c39f-da03-4ee0-943b-ecfb83bf17e5 admin admin] PATH_INFO: `/v3/groups/195f7284c08c4732a894407516e0b99a` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:39.840974 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7c39f-da03-4ee0-943b-ecfb83bf17e5 admin admin] RBAC: Authorizing `identity:get_group(group_id=195f7284c08c4732a894407516e0b99a)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:39.842938 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7c39f-da03-4ee0-943b-ecfb83bf17e5 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:39.844489 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 230/453] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Dec 15 15:58:39 2021] GET /identity/v3/groups/195f7284c08c4732a894407516e0b99a => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:39.850741 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94765f-0135-4e3d-b1ea-2a648cac7063 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:39.860930 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94765f-0135-4e3d-b1ea-2a648cac7063 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:39.865260 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d862df-657f-42b8-bdb9-f34d19446a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:39.865920 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d862df-657f-42b8-bdb9-f34d19446a97 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:39.866196 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d862df-657f-42b8-bdb9-f34d19446a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:39.866465 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d862df-657f-42b8-bdb9-f34d19446a97 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:39.867298 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d862df-657f-42b8-bdb9-f34d19446a97 admin admin] RBAC: Adding query filter params (group.id=195f7284c08c4732a894407516e0b99a, role.id=bc362f875c6d4cee83ba65b8d134462d, scope.project.id=d7bb9a879a6841dda52e30764e5ba9c7) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:39.867601 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d862df-657f-42b8-bdb9-f34d19446a97 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:39.869549 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d862df-657f-42b8-bdb9-f34d19446a97 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:39.875331 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 224/454] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Dec 15 15:58:39 2021] GET /identity/v3/role_assignments?group.id=195f7284c08c4732a894407516e0b99a&scope.project.id=d7bb9a879a6841dda52e30764e5ba9c7&role.id=bc362f875c6d4cee83ba65b8d134462d => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:43.002570 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f71161-44fe-40de-9474-1f01bf8e5d7d None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:43.003594 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f71161-44fe-40de-9474-1f01bf8e5d7d None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:43.004080 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f71161-44fe-40de-9474-1f01bf8e5d7d None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:43.006836 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 231/455] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:43.009627 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422c28f-b04b-456e-94da-2157dbf25004 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:43.010548 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422c28f-b04b-456e-94da-2157dbf25004 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:43.011031 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422c28f-b04b-456e-94da-2157dbf25004 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:43.013197 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 225/456] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:43.014752 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88a23a-18d1-4d45-997c-e3ef7e607f75 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:43.015243 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88a23a-18d1-4d45-997c-e3ef7e607f75 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:43.015878 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88a23a-18d1-4d45-997c-e3ef7e607f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:43.018269 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e0447-2a54-4e17-af81-8d2d1908f5c0 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:43.018758 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e0447-2a54-4e17-af81-8d2d1908f5c0 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:43.019228 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e0447-2a54-4e17-af81-8d2d1908f5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:43.055758 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-000e0447-2a54-4e17-af81-8d2d1908f5c0 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:43.064529 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-000e0447-2a54-4e17-af81-8d2d1908f5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:43.064687 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-fd88a23a-18d1-4d45-997c-e3ef7e607f75 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:43.064687 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-fd88a23a-18d1-4d45-997c-e3ef7e607f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:43.071272 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 232/457] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:43.072662 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2530bf-5b85-472b-8421-20a552e2f083 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:43.072771 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 226/458] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:58:43.072952 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2530bf-5b85-472b-8421-20a552e2f083 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:43.073231 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2530bf-5b85-472b-8421-20a552e2f083 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:43.075028 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 233/459] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:43.082584 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216fb52-b054-4d55-85b7-99c9c10f9839 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:43.082584 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216fb52-b054-4d55-85b7-99c9c10f9839 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:43.082584 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216fb52-b054-4d55-85b7-99c9c10f9839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:43.103434 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2530bf-5b85-472b-8421-20a552e2f083 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:43.116883 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-2216fb52-b054-4d55-85b7-99c9c10f9839 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:43.118337 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-2216fb52-b054-4d55-85b7-99c9c10f9839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:43.118790 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2530bf-5b85-472b-8421-20a552e2f083 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:43.123489 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a5f3c-58dd-4972-b968-7d6b2c5e639d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:43.124265 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a5f3c-58dd-4972-b968-7d6b2c5e639d admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:43.124547 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a5f3c-58dd-4972-b968-7d6b2c5e639d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:43.124830 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a5f3c-58dd-4972-b968-7d6b2c5e639d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:43.127372 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 227/460] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:43.133408 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216fb52-b054-4d55-85b7-99c9c10f9839 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:43.136636 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a5f3c-58dd-4972-b968-7d6b2c5e639d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:43.141420 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a5f3c-58dd-4972-b968-7d6b2c5e639d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:43.147043 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216fb52-b054-4d55-85b7-99c9c10f9839 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:43.156974 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-8c8a5f3c-58dd-4972-b968-7d6b2c5e639d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:43.157702 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd1161-1e02-47ff-abcb-30a3226bcaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:43.158548 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 234/461] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:43.158811 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd1161-1e02-47ff-abcb-30a3226bcaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:43.159252 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd1161-1e02-47ff-abcb-30a3226bcaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:43.159665 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd1161-1e02-47ff-abcb-30a3226bcaf3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:43.164816 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a5f3c-58dd-4972-b968-7d6b2c5e639d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:43.178454 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd1161-1e02-47ff-abcb-30a3226bcaf3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:43.179091 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a5f3c-58dd-4972-b968-7d6b2c5e639d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:43.180886 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd1161-1e02-47ff-abcb-30a3226bcaf3 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:43.183721 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78bd59-59b1-487f-abc4-0f7063fa4571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:43.184369 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78bd59-59b1-487f-abc4-0f7063fa4571 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:43.184652 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78bd59-59b1-487f-abc4-0f7063fa4571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:43.184925 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78bd59-59b1-487f-abc4-0f7063fa4571 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:43.185687 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78bd59-59b1-487f-abc4-0f7063fa4571 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:43.185997 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78bd59-59b1-487f-abc4-0f7063fa4571 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:43.187579 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78bd59-59b1-487f-abc4-0f7063fa4571 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:43.200571 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 235/462] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:43.201232 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-28dd1161-1e02-47ff-abcb-30a3226bcaf3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:43.201482 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78bd59-59b1-487f-abc4-0f7063fa4571 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:43.202867 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 228/463] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:43.208334 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd1161-1e02-47ff-abcb-30a3226bcaf3 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:43.212107 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78bd59-59b1-487f-abc4-0f7063fa4571 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:43.216720 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ebffd-27bd-4e81-a5e5-6526895fef03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:43.217602 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ebffd-27bd-4e81-a5e5-6526895fef03 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:43.217883 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ebffd-27bd-4e81-a5e5-6526895fef03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:43.218154 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ebffd-27bd-4e81-a5e5-6526895fef03 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:43.219411 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd1161-1e02-47ff-abcb-30a3226bcaf3 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:43.224304 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c97b0-fad7-429c-ac3d-7af323a09918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:43.225317 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c97b0-fad7-429c-ac3d-7af323a09918 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:43.225634 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c97b0-fad7-429c-ac3d-7af323a09918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:43.225908 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c97b0-fad7-429c-ac3d-7af323a09918 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:43.226631 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c97b0-fad7-429c-ac3d-7af323a09918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:43.228553 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c97b0-fad7-429c-ac3d-7af323a09918 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:43.231039 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ebffd-27bd-4e81-a5e5-6526895fef03 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:43.232858 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ebffd-27bd-4e81-a5e5-6526895fef03 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:43.249692 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 229/464] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Dec 15 15:58:43 2021] POST /identity/v3/users => generated 248 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:58:43.250630 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c97b0-fad7-429c-ac3d-7af323a09918 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:43.252475 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-c64ebffd-27bd-4e81-a5e5-6526895fef03 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:43.253788 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 236/465] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:43.263447 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ebffd-27bd-4e81-a5e5-6526895fef03 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:43.268103 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c97b0-fad7-429c-ac3d-7af323a09918 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:43.281827 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a234b40-3d1f-4f48-9326-4133963c2cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:43.282518 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a234b40-3d1f-4f48-9326-4133963c2cde admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:43.282900 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a234b40-3d1f-4f48-9326-4133963c2cde admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:43.283183 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a234b40-3d1f-4f48-9326-4133963c2cde admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:43.283939 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a234b40-3d1f-4f48-9326-4133963c2cde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:43.284246 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a234b40-3d1f-4f48-9326-4133963c2cde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:43.288824 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ebffd-27bd-4e81-a5e5-6526895fef03 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:43.290239 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING py.warnings [None req-7a234b40-3d1f-4f48-9326-4133963c2cde admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:58:43.290239 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: warnings.warn(msg) Dec 15 15:58:43.290239 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: Dec 15 15:58:43.291277 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a234b40-3d1f-4f48-9326-4133963c2cde admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:43.302371 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4526d1b-a8d6-43a2-a809-464014553280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:43.303398 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4526d1b-a8d6-43a2-a809-464014553280 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:43.303762 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4526d1b-a8d6-43a2-a809-464014553280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:43.303956 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4526d1b-a8d6-43a2-a809-464014553280 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:43.304724 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4526d1b-a8d6-43a2-a809-464014553280 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:43.305033 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4526d1b-a8d6-43a2-a809-464014553280 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:43.306727 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4526d1b-a8d6-43a2-a809-464014553280 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:43.332013 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 230/466] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:43.334049 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a25aa9-0f41-4d57-877e-80f8f90d55dd None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:43.334343 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a25aa9-0f41-4d57-877e-80f8f90d55dd None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:43.334617 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a25aa9-0f41-4d57-877e-80f8f90d55dd None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:43.335091 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 237/467] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:43.336578 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 231/468] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:43.342440 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4526d1b-a8d6-43a2-a809-464014553280 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:43.344235 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed234f-0721-43ab-afd9-de4e04edfba0 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:43.344518 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed234f-0721-43ab-afd9-de4e04edfba0 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:43.344789 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed234f-0721-43ab-afd9-de4e04edfba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:43.356803 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4526d1b-a8d6-43a2-a809-464014553280 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:43.362114 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705a47e-66fc-4f39-9b5a-d036c90c6443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:43.363073 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705a47e-66fc-4f39-9b5a-d036c90c6443 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:43.363664 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705a47e-66fc-4f39-9b5a-d036c90c6443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:43.364147 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705a47e-66fc-4f39-9b5a-d036c90c6443 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:43.364501 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-47ed234f-0721-43ab-afd9-de4e04edfba0 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:43.365842 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705a47e-66fc-4f39-9b5a-d036c90c6443 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:43.366055 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-47ed234f-0721-43ab-afd9-de4e04edfba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:43.368469 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705a47e-66fc-4f39-9b5a-d036c90c6443 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:43.381422 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 232/469] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:43.381422 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed234f-0721-43ab-afd9-de4e04edfba0 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:43.385462 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed234f-0721-43ab-afd9-de4e04edfba0 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:43.391403 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb85fc0-34cb-4a4a-a4f5-80ceeda77992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:43.392287 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb85fc0-34cb-4a4a-a4f5-80ceeda77992 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:43.392856 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb85fc0-34cb-4a4a-a4f5-80ceeda77992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:43.393285 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb85fc0-34cb-4a4a-a4f5-80ceeda77992 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:43.394371 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb85fc0-34cb-4a4a-a4f5-80ceeda77992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:43.397498 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb85fc0-34cb-4a4a-a4f5-80ceeda77992 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:43.408355 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 238/470] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Dec 15 15:58:43 2021] POST /identity/v3/users => generated 248 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 15:58:43.420779 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705a47e-66fc-4f39-9b5a-d036c90c6443 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:43.422902 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 233/471] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Dec 15 15:58:43 2021] POST /identity/v3/users => generated 246 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:58:43.433720 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705a47e-66fc-4f39-9b5a-d036c90c6443 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:43.438989 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640da053-d34c-40fb-83e6-9a43877978d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:43.440107 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640da053-d34c-40fb-83e6-9a43877978d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:43.440557 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640da053-d34c-40fb-83e6-9a43877978d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:43.441018 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640da053-d34c-40fb-83e6-9a43877978d8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:43.454867 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640da053-d34c-40fb-83e6-9a43877978d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:43.457221 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640da053-d34c-40fb-83e6-9a43877978d8 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:43.480101 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-640da053-d34c-40fb-83e6-9a43877978d8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:43.485543 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 239/472] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:43.489535 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb85fc0-34cb-4a4a-a4f5-80ceeda77992 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:43.501145 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb85fc0-34cb-4a4a-a4f5-80ceeda77992 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:43.506492 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32172b45-d15f-4aca-8683-7a6181ad3b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:43.507243 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32172b45-d15f-4aca-8683-7a6181ad3b66 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:43.507625 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32172b45-d15f-4aca-8683-7a6181ad3b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:43.507999 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32172b45-d15f-4aca-8683-7a6181ad3b66 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:43.508872 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32172b45-d15f-4aca-8683-7a6181ad3b66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:43.509284 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32172b45-d15f-4aca-8683-7a6181ad3b66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:43.511295 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32172b45-d15f-4aca-8683-7a6181ad3b66 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:43.526923 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 234/473] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:43.533184 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640da053-d34c-40fb-83e6-9a43877978d8 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:43.546271 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640da053-d34c-40fb-83e6-9a43877978d8 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:43.551442 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb146634-9827-44d8-846b-2a8571afd97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:43.552440 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb146634-9827-44d8-846b-2a8571afd97e admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:43.553151 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb146634-9827-44d8-846b-2a8571afd97e admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:43.553675 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb146634-9827-44d8-846b-2a8571afd97e admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:43.554613 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb146634-9827-44d8-846b-2a8571afd97e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:43.556783 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb146634-9827-44d8-846b-2a8571afd97e admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:43.589627 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 240/474] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Dec 15 15:58:43 2021] POST /identity/v3/users => generated 249 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:58:44.355975 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d00793-1d53-4800-a2f4-206bc28af7b4 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:44.356485 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d00793-1d53-4800-a2f4-206bc28af7b4 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:44.356583 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d00793-1d53-4800-a2f4-206bc28af7b4 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:44.358585 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 235/475] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:44.364681 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b0dd4-764e-4f1d-8c83-2912059e65c8 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:44.365347 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b0dd4-764e-4f1d-8c83-2912059e65c8 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:44.366016 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b0dd4-764e-4f1d-8c83-2912059e65c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:44.394483 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-eb7b0dd4-764e-4f1d-8c83-2912059e65c8 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:44.395700 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-eb7b0dd4-764e-4f1d-8c83-2912059e65c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:44.404343 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 241/476] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:44 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:44.440235 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d00793-1d53-4800-a2f4-206bc28af7b4 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:44.454920 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d00793-1d53-4800-a2f4-206bc28af7b4 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:44.459416 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d157b-8108-4fda-a5aa-96039bb6346a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:44.460071 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d157b-8108-4fda-a5aa-96039bb6346a admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:44.460348 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d157b-8108-4fda-a5aa-96039bb6346a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:44.460621 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d157b-8108-4fda-a5aa-96039bb6346a admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:44.461399 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d157b-8108-4fda-a5aa-96039bb6346a admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:44.463007 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d157b-8108-4fda-a5aa-96039bb6346a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:44.476008 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.sql.core [None req-586d157b-8108-4fda-a5aa-96039bb6346a admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Dec 15 15:58:44.476008 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Dec 15 15:58:44.476008 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [parameters: {'id': '0a0d1b86d8824c4f86cea91eca5a2232', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Dec 15 15:58:44.476008 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79290) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 15 15:58:44.490710 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-586d157b-8108-4fda-a5aa-96039bb6346a admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Dec 15 15:58:44.492461 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 236/477] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 15:58:44 2021] POST /identity/v3/roles => generated 144 bytes in 53 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:44.498314 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b0dd4-764e-4f1d-8c83-2912059e65c8 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:44.507863 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b0dd4-764e-4f1d-8c83-2912059e65c8 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:44.517479 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d5a63-8898-43bb-81ff-04d179412f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:44.518286 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d5a63-8898-43bb-81ff-04d179412f79 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:44.518566 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d5a63-8898-43bb-81ff-04d179412f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:44.518854 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d5a63-8898-43bb-81ff-04d179412f79 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:44.535451 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d5a63-8898-43bb-81ff-04d179412f79 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:44.543629 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-697d5a63-8898-43bb-81ff-04d179412f79 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 15:58:44.545136 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 242/478] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Dec 15 15:58:44 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:44.551213 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d157b-8108-4fda-a5aa-96039bb6346a admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:44.566461 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d157b-8108-4fda-a5aa-96039bb6346a admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:44.574005 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e09e0-a02a-4507-bce9-377ca44841a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:44.574672 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e09e0-a02a-4507-bce9-377ca44841a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:44.574953 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e09e0-a02a-4507-bce9-377ca44841a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:44.575228 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e09e0-a02a-4507-bce9-377ca44841a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:44.575983 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e09e0-a02a-4507-bce9-377ca44841a9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:44.576282 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e09e0-a02a-4507-bce9-377ca44841a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:44.577921 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e09e0-a02a-4507-bce9-377ca44841a9 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:44.587936 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 237/479] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:44 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:46.190866 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766aa3dd-83da-4805-96fd-545a4d23155d None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.191378 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766aa3dd-83da-4805-96fd-545a4d23155d None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.191484 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766aa3dd-83da-4805-96fd-545a4d23155d None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.193317 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 243/480] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:46.207121 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a8d9d-c716-4c01-8814-76bba7799a2e None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.207596 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a8d9d-c716-4c01-8814-76bba7799a2e None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.207693 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a8d9d-c716-4c01-8814-76bba7799a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.234402 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-008a8d9d-c716-4c01-8814-76bba7799a2e None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:46.235638 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-008a8d9d-c716-4c01-8814-76bba7799a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:46.244693 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 238/481] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:46.286800 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766aa3dd-83da-4805-96fd-545a4d23155d None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:46.304119 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766aa3dd-83da-4805-96fd-545a4d23155d None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:46.314562 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c165554-7c9d-4736-9624-d6f62c5936ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:46.315358 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c165554-7c9d-4736-9624-d6f62c5936ce admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.315645 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c165554-7c9d-4736-9624-d6f62c5936ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.315922 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c165554-7c9d-4736-9624-d6f62c5936ce admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.332620 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c165554-7c9d-4736-9624-d6f62c5936ce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:46.340826 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-5c165554-7c9d-4736-9624-d6f62c5936ce admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 15:58:46.342702 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 244/482] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Dec 15 15:58:46 2021] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:46.348552 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a8d9d-c716-4c01-8814-76bba7799a2e None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:46.358590 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a8d9d-c716-4c01-8814-76bba7799a2e None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:46.368992 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b4c97-1d92-4f3e-92d1-456e6f2dba27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:46.369928 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b4c97-1d92-4f3e-92d1-456e6f2dba27 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.370361 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b4c97-1d92-4f3e-92d1-456e6f2dba27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.370783 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b4c97-1d92-4f3e-92d1-456e6f2dba27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.371702 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b4c97-1d92-4f3e-92d1-456e6f2dba27 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:46.372159 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b4c97-1d92-4f3e-92d1-456e6f2dba27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:46.373957 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b4c97-1d92-4f3e-92d1-456e6f2dba27 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:46.388819 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 239/483] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Dec 15 15:58:46 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:46.394764 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c165554-7c9d-4736-9624-d6f62c5936ce admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:46.415236 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c165554-7c9d-4736-9624-d6f62c5936ce admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:46.423456 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40427f9e-6e92-4ffa-bcaa-ae3cd5860e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:46.424447 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40427f9e-6e92-4ffa-bcaa-ae3cd5860e51 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.424877 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40427f9e-6e92-4ffa-bcaa-ae3cd5860e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.425304 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40427f9e-6e92-4ffa-bcaa-ae3cd5860e51 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.439408 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee9abb-0b7f-49b5-bd1e-8e29b0b7afb8 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.439953 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee9abb-0b7f-49b5-bd1e-8e29b0b7afb8 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.440379 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee9abb-0b7f-49b5-bd1e-8e29b0b7afb8 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.442326 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 240/484] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:58:46.445552 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbae36-a124-476d-8ef4-42b38629d3e0 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.446035 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbae36-a124-476d-8ef4-42b38629d3e0 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.446473 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbae36-a124-476d-8ef4-42b38629d3e0 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.448579 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 241/485] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:58:46.449550 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40427f9e-6e92-4ffa-bcaa-ae3cd5860e51 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:46.449969 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8e0d9-0d26-4ed6-9c92-0ffd455dc256 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.450395 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8e0d9-0d26-4ed6-9c92-0ffd455dc256 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.450810 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8e0d9-0d26-4ed6-9c92-0ffd455dc256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.451426 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40427f9e-6e92-4ffa-bcaa-ae3cd5860e51 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:46.469183 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-40427f9e-6e92-4ffa-bcaa-ae3cd5860e51 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:46.470688 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 245/486] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:46.471965 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa825abe-e66c-4ad3-9553-701dbf2b3a7e None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.472253 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa825abe-e66c-4ad3-9553-701dbf2b3a7e None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.472525 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa825abe-e66c-4ad3-9553-701dbf2b3a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.475133 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-b9c8e0d9-0d26-4ed6-9c92-0ffd455dc256 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:46.476490 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-b9c8e0d9-0d26-4ed6-9c92-0ffd455dc256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:46.484449 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 242/487] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:46.485368 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8e0d9-0d26-4ed6-9c92-0ffd455dc256 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:46.505786 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8e0d9-0d26-4ed6-9c92-0ffd455dc256 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:46.509082 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-fa825abe-e66c-4ad3-9553-701dbf2b3a7e None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:46.511233 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-fa825abe-e66c-4ad3-9553-701dbf2b3a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:46.517516 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d2589-7fa2-43bb-b0ff-ac01656c869c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:46.518174 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d2589-7fa2-43bb-b0ff-ac01656c869c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.518450 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d2589-7fa2-43bb-b0ff-ac01656c869c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.518718 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d2589-7fa2-43bb-b0ff-ac01656c869c admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.519449 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d2589-7fa2-43bb-b0ff-ac01656c869c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:46.519745 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d2589-7fa2-43bb-b0ff-ac01656c869c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:46.521931 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d2589-7fa2-43bb-b0ff-ac01656c869c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:46.526762 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 246/488] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:46.527817 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa825abe-e66c-4ad3-9553-701dbf2b3a7e None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:46.545475 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 243/489] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:46.549466 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa825abe-e66c-4ad3-9553-701dbf2b3a7e None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:46.551149 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d2589-7fa2-43bb-b0ff-ac01656c869c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:46.558229 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1aba7-def2-44d2-a3e0-9754949bcf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:46.559585 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1aba7-def2-44d2-a3e0-9754949bcf8d admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.559877 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1aba7-def2-44d2-a3e0-9754949bcf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.560170 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1aba7-def2-44d2-a3e0-9754949bcf8d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.564494 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d2589-7fa2-43bb-b0ff-ac01656c869c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:46.571445 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89dfdcb-72e9-4fa4-9dac-52d2ca1d80fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:46.572869 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89dfdcb-72e9-4fa4-9dac-52d2ca1d80fc admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.573510 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89dfdcb-72e9-4fa4-9dac-52d2ca1d80fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.573697 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1aba7-def2-44d2-a3e0-9754949bcf8d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:46.574211 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89dfdcb-72e9-4fa4-9dac-52d2ca1d80fc admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.581764 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-afe1aba7-def2-44d2-a3e0-9754949bcf8d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 15:58:46.589315 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 247/490] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Dec 15 15:58:46 2021] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:46.589315 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1aba7-def2-44d2-a3e0-9754949bcf8d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:46.591624 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89dfdcb-72e9-4fa4-9dac-52d2ca1d80fc admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:46.594496 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89dfdcb-72e9-4fa4-9dac-52d2ca1d80fc admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:46.594910 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1aba7-def2-44d2-a3e0-9754949bcf8d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:46.600763 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef692d-b984-4f4b-9024-025fd33ba367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:46.601606 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef692d-b984-4f4b-9024-025fd33ba367 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.601887 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef692d-b984-4f4b-9024-025fd33ba367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.602163 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef692d-b984-4f4b-9024-025fd33ba367 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.613215 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-e89dfdcb-72e9-4fa4-9dac-52d2ca1d80fc admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 15 15:58:46.613729 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef692d-b984-4f4b-9024-025fd33ba367 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:46.615297 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 244/491] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:46 2021] GET /identity/v3/users/cinder => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:46.616390 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89dfdcb-72e9-4fa4-9dac-52d2ca1d80fc admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:46.621101 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-32ef692d-b984-4f4b-9024-025fd33ba367 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 15:58:46.622600 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 248/492] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Dec 15 15:58:46 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:46.626049 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef692d-b984-4f4b-9024-025fd33ba367 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:46.631917 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89dfdcb-72e9-4fa4-9dac-52d2ca1d80fc admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:46.637547 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da4374-e1bf-47a0-ad07-679a5a00ef86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:46.638475 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da4374-e1bf-47a0-ad07-679a5a00ef86 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.638973 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da4374-e1bf-47a0-ad07-679a5a00ef86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.639456 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da4374-e1bf-47a0-ad07-679a5a00ef86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.640436 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da4374-e1bf-47a0-ad07-679a5a00ef86 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:46.640965 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da4374-e1bf-47a0-ad07-679a5a00ef86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:46.641316 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef692d-b984-4f4b-9024-025fd33ba367 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:46.643405 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da4374-e1bf-47a0-ad07-679a5a00ef86 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:46.646868 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f16b05-65be-418b-92a0-961fb323a69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:46.647684 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f16b05-65be-418b-92a0-961fb323a69f admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.647955 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f16b05-65be-418b-92a0-961fb323a69f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.648241 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f16b05-65be-418b-92a0-961fb323a69f admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.649101 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f16b05-65be-418b-92a0-961fb323a69f admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:46.649493 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f16b05-65be-418b-92a0-961fb323a69f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:46.650887 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING py.warnings [None req-13f16b05-65be-418b-92a0-961fb323a69f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:58:46.650887 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: warnings.warn(msg) Dec 15 15:58:46.650887 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: Dec 15 15:58:46.652162 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f16b05-65be-418b-92a0-961fb323a69f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:46.656437 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 245/493] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Dec 15 15:58:46 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:46.657551 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da4374-e1bf-47a0-ad07-679a5a00ef86 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:46.672231 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da4374-e1bf-47a0-ad07-679a5a00ef86 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:46.678187 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bafc08-daa6-4def-905a-551331930e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:46.678920 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bafc08-daa6-4def-905a-551331930e01 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.679202 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bafc08-daa6-4def-905a-551331930e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.679476 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bafc08-daa6-4def-905a-551331930e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.680628 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bafc08-daa6-4def-905a-551331930e01 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:46.680987 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bafc08-daa6-4def-905a-551331930e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:46.683009 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bafc08-daa6-4def-905a-551331930e01 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:46.699153 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 246/494] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Dec 15 15:58:46 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:46.699153 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bafc08-daa6-4def-905a-551331930e01 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:46.707627 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 249/495] 10.222.0.36 () {56 vars in 1158 bytes} [Wed Dec 15 15:58:46 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:46.708984 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f16b05-65be-418b-92a0-961fb323a69f admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:46.711893 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bafc08-daa6-4def-905a-551331930e01 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:46.716983 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bed0a8-ffa8-4649-820e-f4f8a23f9079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:46.718062 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bed0a8-ffa8-4649-820e-f4f8a23f9079 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.718592 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f16b05-65be-418b-92a0-961fb323a69f admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:46.718829 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bed0a8-ffa8-4649-820e-f4f8a23f9079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.719406 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bed0a8-ffa8-4649-820e-f4f8a23f9079 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.723185 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a035d-b193-4358-90ed-d61d5542d267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:46.724382 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a035d-b193-4358-90ed-d61d5542d267 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.724670 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a035d-b193-4358-90ed-d61d5542d267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.724928 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a035d-b193-4358-90ed-d61d5542d267 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.733022 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bed0a8-ffa8-4649-820e-f4f8a23f9079 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:46.735203 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bed0a8-ffa8-4649-820e-f4f8a23f9079 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:46.735309 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a035d-b193-4358-90ed-d61d5542d267 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:46.737163 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a035d-b193-4358-90ed-d61d5542d267 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:46.753300 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-c6bed0a8-ffa8-4649-820e-f4f8a23f9079 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:46.754092 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-809a035d-b193-4358-90ed-d61d5542d267 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:46.755695 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 247/496] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:46.756648 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bed0a8-ffa8-4649-820e-f4f8a23f9079 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:46.766418 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 250/497] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:46.766418 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a035d-b193-4358-90ed-d61d5542d267 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:46.776948 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a035d-b193-4358-90ed-d61d5542d267 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:46.778858 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bed0a8-ffa8-4649-820e-f4f8a23f9079 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:46.781678 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a56b72-7a8b-40f3-908a-aba66429999e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:46.782384 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a56b72-7a8b-40f3-908a-aba66429999e admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.782666 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a56b72-7a8b-40f3-908a-aba66429999e admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.782943 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a56b72-7a8b-40f3-908a-aba66429999e admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.783733 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a56b72-7a8b-40f3-908a-aba66429999e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:46.784094 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a56b72-7a8b-40f3-908a-aba66429999e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:46.786073 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a56b72-7a8b-40f3-908a-aba66429999e admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:46.788645 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e15a3-e6bf-448a-b2c1-8796c162e0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:46.789528 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e15a3-e6bf-448a-b2c1-8796c162e0cb admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.790002 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e15a3-e6bf-448a-b2c1-8796c162e0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.790462 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e15a3-e6bf-448a-b2c1-8796c162e0cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.798795 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e15a3-e6bf-448a-b2c1-8796c162e0cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:46.798913 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 251/498] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:46.800890 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e15a3-e6bf-448a-b2c1-8796c162e0cb admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:46.805015 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a56b72-7a8b-40f3-908a-aba66429999e admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:46.811810 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 248/499] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:46 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:46.812793 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e15a3-e6bf-448a-b2c1-8796c162e0cb admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:46.815524 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a56b72-7a8b-40f3-908a-aba66429999e admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:46.820369 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e44be-0652-44c1-b872-a23c4c9bf27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:46.821068 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e44be-0652-44c1-b872-a23c4c9bf27c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.821342 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e44be-0652-44c1-b872-a23c4c9bf27c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.821725 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e44be-0652-44c1-b872-a23c4c9bf27c admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.822486 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e44be-0652-44c1-b872-a23c4c9bf27c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:46.822795 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e44be-0652-44c1-b872-a23c4c9bf27c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:46.824258 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e15a3-e6bf-448a-b2c1-8796c162e0cb admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:46.824528 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e44be-0652-44c1-b872-a23c4c9bf27c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:46.829002 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac2e08-71ec-4430-9fa9-855f25d10d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:46.830543 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac2e08-71ec-4430-9fa9-855f25d10d6b admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.831249 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac2e08-71ec-4430-9fa9-855f25d10d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.831915 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac2e08-71ec-4430-9fa9-855f25d10d6b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.841921 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 252/500] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:46.841921 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e44be-0652-44c1-b872-a23c4c9bf27c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:46.844743 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac2e08-71ec-4430-9fa9-855f25d10d6b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:46.846974 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac2e08-71ec-4430-9fa9-855f25d10d6b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:46.853629 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e44be-0652-44c1-b872-a23c4c9bf27c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:46.858462 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe216671-65d9-46cb-acf4-65cfb80bb435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:46.859466 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe216671-65d9-46cb-acf4-65cfb80bb435 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.859945 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe216671-65d9-46cb-acf4-65cfb80bb435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.860432 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe216671-65d9-46cb-acf4-65cfb80bb435 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.865075 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-dcac2e08-71ec-4430-9fa9-855f25d10d6b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 15:58:46.869465 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 249/501] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Dec 15 15:58:46 2021] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:46.870505 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac2e08-71ec-4430-9fa9-855f25d10d6b admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:46.878921 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe216671-65d9-46cb-acf4-65cfb80bb435 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:46.880963 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe216671-65d9-46cb-acf4-65cfb80bb435 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:46.887842 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac2e08-71ec-4430-9fa9-855f25d10d6b admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:46.893024 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2178c-8e0b-4bfc-ae06-5e947fe0878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:46.894402 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2178c-8e0b-4bfc-ae06-5e947fe0878e admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.894829 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2178c-8e0b-4bfc-ae06-5e947fe0878e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.896069 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2178c-8e0b-4bfc-ae06-5e947fe0878e admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.903598 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-fe216671-65d9-46cb-acf4-65cfb80bb435 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:46.904051 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2178c-8e0b-4bfc-ae06-5e947fe0878e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:46.905317 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 253/502] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:46.906306 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe216671-65d9-46cb-acf4-65cfb80bb435 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:46.906823 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2178c-8e0b-4bfc-ae06-5e947fe0878e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:46.917176 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe216671-65d9-46cb-acf4-65cfb80bb435 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:46.921938 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a01499-33b2-4e98-a8fc-dc8c3e0423ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:46.922672 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a01499-33b2-4e98-a8fc-dc8c3e0423ba admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.923093 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a01499-33b2-4e98-a8fc-dc8c3e0423ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.923455 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a01499-33b2-4e98-a8fc-dc8c3e0423ba admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.924446 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a01499-33b2-4e98-a8fc-dc8c3e0423ba admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:46.924890 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a01499-33b2-4e98-a8fc-dc8c3e0423ba admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:46.925414 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-a8d2178c-8e0b-4bfc-ae06-5e947fe0878e admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 15 15:58:46.927249 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 250/503] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:46 2021] GET /identity/v3/users/glance => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:46.927768 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a01499-33b2-4e98-a8fc-dc8c3e0423ba admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:46.928469 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2178c-8e0b-4bfc-ae06-5e947fe0878e admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:46.940646 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2178c-8e0b-4bfc-ae06-5e947fe0878e admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:46.946566 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae45c1-195d-45c5-ba31-9480836aaf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:46.947388 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae45c1-195d-45c5-ba31-9480836aaf16 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.947853 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 254/504] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Dec 15 15:58:46 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:46.948136 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae45c1-195d-45c5-ba31-9480836aaf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.948586 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae45c1-195d-45c5-ba31-9480836aaf16 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.949577 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae45c1-195d-45c5-ba31-9480836aaf16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:46.950048 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae45c1-195d-45c5-ba31-9480836aaf16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:46.951853 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae45c1-195d-45c5-ba31-9480836aaf16 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:46.953579 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a01499-33b2-4e98-a8fc-dc8c3e0423ba admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:46.963908 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a01499-33b2-4e98-a8fc-dc8c3e0423ba admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:46.967586 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 251/505] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:46.968729 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae45c1-195d-45c5-ba31-9480836aaf16 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:46.968940 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c747f8-4c9a-4904-9768-23b4784304cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:46.969560 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c747f8-4c9a-4904-9768-23b4784304cd admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.969954 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c747f8-4c9a-4904-9768-23b4784304cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.970351 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c747f8-4c9a-4904-9768-23b4784304cd admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.971306 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c747f8-4c9a-4904-9768-23b4784304cd admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:46.971675 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c747f8-4c9a-4904-9768-23b4784304cd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:46.973787 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c747f8-4c9a-4904-9768-23b4784304cd admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:46.981547 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae45c1-195d-45c5-ba31-9480836aaf16 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:46.987354 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a25594-4276-435c-8767-ce6c911d262c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:46.988231 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a25594-4276-435c-8767-ce6c911d262c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:46.988701 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a25594-4276-435c-8767-ce6c911d262c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:46.989151 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a25594-4276-435c-8767-ce6c911d262c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:46.993846 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 255/506] 10.222.0.36 () {56 vars in 1158 bytes} [Wed Dec 15 15:58:46 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:46.994918 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c747f8-4c9a-4904-9768-23b4784304cd admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.001067 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a25594-4276-435c-8767-ce6c911d262c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.002900 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a25594-4276-435c-8767-ce6c911d262c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.011475 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c747f8-4c9a-4904-9768-23b4784304cd admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.017228 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 252/507] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:46 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:47.017228 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3d439-4403-45d5-847b-6d268b19b30d None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.017228 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3d439-4403-45d5-847b-6d268b19b30d None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.017228 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3d439-4403-45d5-847b-6d268b19b30d None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.017228 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 253/508] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:47.017228 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3d439-4403-45d5-847b-6d268b19b30d None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.023745 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa071bd-3aed-498d-ba5d-ddabae4adbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.024546 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa071bd-3aed-498d-ba5d-ddabae4adbc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.024830 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa071bd-3aed-498d-ba5d-ddabae4adbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.025105 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa071bd-3aed-498d-ba5d-ddabae4adbc2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.029163 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3d439-4403-45d5-847b-6d268b19b30d None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.032261 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa071bd-3aed-498d-ba5d-ddabae4adbc2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.033595 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e2588-3478-4cc5-ae40-55ebe3f32601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.034205 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e2588-3478-4cc5-ae40-55ebe3f32601 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.034301 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa071bd-3aed-498d-ba5d-ddabae4adbc2 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.034488 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e2588-3478-4cc5-ae40-55ebe3f32601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.034762 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e2588-3478-4cc5-ae40-55ebe3f32601 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.044469 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e2588-3478-4cc5-ae40-55ebe3f32601 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.046295 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e2588-3478-4cc5-ae40-55ebe3f32601 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.047549 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-4aa071bd-3aed-498d-ba5d-ddabae4adbc2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:58:47.054717 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 256/509] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:47.054717 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa071bd-3aed-498d-ba5d-ddabae4adbc2 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.060686 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 254/510] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:47.062029 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec84e1-b4d9-4d09-998a-3bcc4bea53df None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.062274 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec84e1-b4d9-4d09-998a-3bcc4bea53df None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.062553 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec84e1-b4d9-4d09-998a-3bcc4bea53df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.068770 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa071bd-3aed-498d-ba5d-ddabae4adbc2 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.073481 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db371e-e1c5-4783-81f8-58c47fdde9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.074269 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db371e-e1c5-4783-81f8-58c47fdde9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.074554 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db371e-e1c5-4783-81f8-58c47fdde9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.074829 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db371e-e1c5-4783-81f8-58c47fdde9a7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.082878 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-0eec84e1-b4d9-4d09-998a-3bcc4bea53df None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:47.084349 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-0eec84e1-b4d9-4d09-998a-3bcc4bea53df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:47.085322 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db371e-e1c5-4783-81f8-58c47fdde9a7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.087177 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db371e-e1c5-4783-81f8-58c47fdde9a7 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.092315 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 255/511] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:47.092924 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec84e1-b4d9-4d09-998a-3bcc4bea53df None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.102151 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec84e1-b4d9-4d09-998a-3bcc4bea53df None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.106892 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802f55a-431f-4fd0-9905-cb3f965ae4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.107581 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802f55a-431f-4fd0-9905-cb3f965ae4bd admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.107910 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802f55a-431f-4fd0-9905-cb3f965ae4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.108185 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802f55a-431f-4fd0-9905-cb3f965ae4bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.109075 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802f55a-431f-4fd0-9905-cb3f965ae4bd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:47.109407 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802f55a-431f-4fd0-9905-cb3f965ae4bd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.110530 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING py.warnings [None req-5802f55a-431f-4fd0-9905-cb3f965ae4bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:58:47.110530 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: warnings.warn(msg) Dec 15 15:58:47.110530 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: Dec 15 15:58:47.111728 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802f55a-431f-4fd0-9905-cb3f965ae4bd admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.113883 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-b8db371e-e1c5-4783-81f8-58c47fdde9a7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:47.116042 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 257/512] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:47.117589 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db371e-e1c5-4783-81f8-58c47fdde9a7 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.128977 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db371e-e1c5-4783-81f8-58c47fdde9a7 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.131235 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 256/513] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:47.131902 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802f55a-431f-4fd0-9905-cb3f965ae4bd admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.139101 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdfb40-c7a5-488b-855d-1171122403bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.139873 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdfb40-c7a5-488b-855d-1171122403bc admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.140159 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdfb40-c7a5-488b-855d-1171122403bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.140439 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdfb40-c7a5-488b-855d-1171122403bc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.145548 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802f55a-431f-4fd0-9905-cb3f965ae4bd admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.150548 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8610a6-7941-4ddf-bdc6-194d68aafc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.150836 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdfb40-c7a5-488b-855d-1171122403bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.151325 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8610a6-7941-4ddf-bdc6-194d68aafc4e admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.151609 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8610a6-7941-4ddf-bdc6-194d68aafc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.151882 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8610a6-7941-4ddf-bdc6-194d68aafc4e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.152665 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdfb40-c7a5-488b-855d-1171122403bc admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.162959 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8610a6-7941-4ddf-bdc6-194d68aafc4e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:47.169483 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-bcfdfb40-c7a5-488b-855d-1171122403bc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:47.169880 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-6d8610a6-7941-4ddf-bdc6-194d68aafc4e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 15:58:47.175629 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 258/514] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:47.175825 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 257/515] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:47.175825 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8610a6-7941-4ddf-bdc6-194d68aafc4e admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.176603 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdfb40-c7a5-488b-855d-1171122403bc admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.186030 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8610a6-7941-4ddf-bdc6-194d68aafc4e admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.186496 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdfb40-c7a5-488b-855d-1171122403bc admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.190588 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb7be2-dc68-42bf-b833-8066c73d4c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.190826 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e5779-1efe-4e2a-a40f-f00d160a2b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.191218 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb7be2-dc68-42bf-b833-8066c73d4c17 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.191456 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e5779-1efe-4e2a-a40f-f00d160a2b11 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.191876 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb7be2-dc68-42bf-b833-8066c73d4c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.191950 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e5779-1efe-4e2a-a40f-f00d160a2b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.192016 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb7be2-dc68-42bf-b833-8066c73d4c17 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.192082 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e5779-1efe-4e2a-a40f-f00d160a2b11 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.193156 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb7be2-dc68-42bf-b833-8066c73d4c17 admin admin] RBAC: Adding query filter params (role.id=17e6533ce814487c9a8fb0ee2acaad32, scope.project.id=bc314fbc91c54810b27f9fcad7129c64, user.id=0d18ec9bcc0e481aa000833ec1c0988d) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:47.193347 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e5779-1efe-4e2a-a40f-f00d160a2b11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:47.193535 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb7be2-dc68-42bf-b833-8066c73d4c17 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.193801 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e5779-1efe-4e2a-a40f-f00d160a2b11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.195338 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb7be2-dc68-42bf-b833-8066c73d4c17 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.195448 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e5779-1efe-4e2a-a40f-f00d160a2b11 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.201380 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 258/516] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/role_assignments?user.id=0d18ec9bcc0e481aa000833ec1c0988d&scope.project.id=bc314fbc91c54810b27f9fcad7129c64&role.id=17e6533ce814487c9a8fb0ee2acaad32 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:47.209749 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb7be2-dc68-42bf-b833-8066c73d4c17 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.216964 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 259/517] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:47.220675 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb7be2-dc68-42bf-b833-8066c73d4c17 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.221028 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e5779-1efe-4e2a-a40f-f00d160a2b11 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.232510 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e5779-1efe-4e2a-a40f-f00d160a2b11 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.233458 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d5f8f-6188-490a-93a4-bded978e9dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.234318 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d5f8f-6188-490a-93a4-bded978e9dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.234691 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d5f8f-6188-490a-93a4-bded978e9dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.235087 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d5f8f-6188-490a-93a4-bded978e9dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.235976 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d5f8f-6188-490a-93a4-bded978e9dd4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:47.236351 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d5f8f-6188-490a-93a4-bded978e9dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.237630 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da54f56-e2d8-4311-a3d0-e08234b796b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.238072 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d5f8f-6188-490a-93a4-bded978e9dd4 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.238303 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da54f56-e2d8-4311-a3d0-e08234b796b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.238628 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da54f56-e2d8-4311-a3d0-e08234b796b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.238912 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da54f56-e2d8-4311-a3d0-e08234b796b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.240387 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da54f56-e2d8-4311-a3d0-e08234b796b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:47.240697 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da54f56-e2d8-4311-a3d0-e08234b796b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.242419 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da54f56-e2d8-4311-a3d0-e08234b796b3 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.248364 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 259/518] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:47.249216 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d5f8f-6188-490a-93a4-bded978e9dd4 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.265725 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 260/519] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:47.266019 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d5f8f-6188-490a-93a4-bded978e9dd4 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.266585 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da54f56-e2d8-4311-a3d0-e08234b796b3 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.270873 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07ad60-3da6-4c5c-97a5-fbfb47b5ba05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.272037 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07ad60-3da6-4c5c-97a5-fbfb47b5ba05 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.272421 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07ad60-3da6-4c5c-97a5-fbfb47b5ba05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.272796 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07ad60-3da6-4c5c-97a5-fbfb47b5ba05 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.276934 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da54f56-e2d8-4311-a3d0-e08234b796b3 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.281120 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07ad60-3da6-4c5c-97a5-fbfb47b5ba05 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.281618 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac7b12-090b-404b-87f7-67bb28d76dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.282410 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac7b12-090b-404b-87f7-67bb28d76dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.282692 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac7b12-090b-404b-87f7-67bb28d76dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.282967 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac7b12-090b-404b-87f7-67bb28d76dd7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.283999 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07ad60-3da6-4c5c-97a5-fbfb47b5ba05 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.295519 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac7b12-090b-404b-87f7-67bb28d76dd7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.297413 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac7b12-090b-404b-87f7-67bb28d76dd7 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.300502 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-7d07ad60-3da6-4c5c-97a5-fbfb47b5ba05 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:58:47.302799 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 260/520] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:47.303715 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07ad60-3da6-4c5c-97a5-fbfb47b5ba05 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.319754 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07ad60-3da6-4c5c-97a5-fbfb47b5ba05 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.324200 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-83ac7b12-090b-404b-87f7-67bb28d76dd7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:47.324614 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b774f-feca-4e98-9ee4-524833eb0f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.325632 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b774f-feca-4e98-9ee4-524833eb0f74 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.326013 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b774f-feca-4e98-9ee4-524833eb0f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.326387 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b774f-feca-4e98-9ee4-524833eb0f74 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.329573 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 261/521] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:47.330670 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac7b12-090b-404b-87f7-67bb28d76dd7 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.338576 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b774f-feca-4e98-9ee4-524833eb0f74 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.341587 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b774f-feca-4e98-9ee4-524833eb0f74 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.343448 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac7b12-090b-404b-87f7-67bb28d76dd7 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.348036 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b1dc0-47b3-4f50-84ef-380ec518003d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.349333 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b1dc0-47b3-4f50-84ef-380ec518003d admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.349703 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b1dc0-47b3-4f50-84ef-380ec518003d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.350055 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b1dc0-47b3-4f50-84ef-380ec518003d admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.350959 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b1dc0-47b3-4f50-84ef-380ec518003d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:47.351338 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b1dc0-47b3-4f50-84ef-380ec518003d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.352432 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING py.warnings [None req-329b1dc0-47b3-4f50-84ef-380ec518003d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:58:47.352432 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: warnings.warn(msg) Dec 15 15:58:47.352432 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: Dec 15 15:58:47.353890 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b1dc0-47b3-4f50-84ef-380ec518003d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.357568 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-1e0b774f-feca-4e98-9ee4-524833eb0f74 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:58:47.359618 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 261/522] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:47.360447 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b774f-feca-4e98-9ee4-524833eb0f74 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.373015 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b774f-feca-4e98-9ee4-524833eb0f74 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.377487 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 262/523] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:47.378404 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b1dc0-47b3-4f50-84ef-380ec518003d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.386194 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24acf41-45a4-4bbb-9660-0fd0aefc6f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.387060 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24acf41-45a4-4bbb-9660-0fd0aefc6f22 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.387412 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24acf41-45a4-4bbb-9660-0fd0aefc6f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.387757 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24acf41-45a4-4bbb-9660-0fd0aefc6f22 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.388629 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24acf41-45a4-4bbb-9660-0fd0aefc6f22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:47.389002 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24acf41-45a4-4bbb-9660-0fd0aefc6f22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.390848 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24acf41-45a4-4bbb-9660-0fd0aefc6f22 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.392449 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b1dc0-47b3-4f50-84ef-380ec518003d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.397222 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51ba50-3310-4543-9be3-020ec8112a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.397921 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51ba50-3310-4543-9be3-020ec8112a77 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.398206 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51ba50-3310-4543-9be3-020ec8112a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.398491 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51ba50-3310-4543-9be3-020ec8112a77 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.399303 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51ba50-3310-4543-9be3-020ec8112a77 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:47.400155 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51ba50-3310-4543-9be3-020ec8112a77 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.401539 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51ba50-3310-4543-9be3-020ec8112a77 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.405544 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 262/524] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:47.410078 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24acf41-45a4-4bbb-9660-0fd0aefc6f22 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.415726 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 263/525] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:47.416593 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51ba50-3310-4543-9be3-020ec8112a77 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.423359 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24acf41-45a4-4bbb-9660-0fd0aefc6f22 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.426244 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51ba50-3310-4543-9be3-020ec8112a77 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.429059 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a82df-84f7-4fa7-9b77-decb4a2ae1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.429962 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a82df-84f7-4fa7-9b77-decb4a2ae1ba admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.430348 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a82df-84f7-4fa7-9b77-decb4a2ae1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.430783 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a82df-84f7-4fa7-9b77-decb4a2ae1ba admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.431718 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9fc4c-19d3-48f3-9b4c-3f2a32456df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.431897 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a82df-84f7-4fa7-9b77-decb4a2ae1ba admin admin] RBAC: Adding query filter params (role.id=17e6533ce814487c9a8fb0ee2acaad32, scope.project.id=bc314fbc91c54810b27f9fcad7129c64, user.id=bc13934328e742f9a1a85d1c84ab83dd) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:47.432080 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a82df-84f7-4fa7-9b77-decb4a2ae1ba admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.432705 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9fc4c-19d3-48f3-9b4c-3f2a32456df3 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.433056 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9fc4c-19d3-48f3-9b4c-3f2a32456df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.433420 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9fc4c-19d3-48f3-9b4c-3f2a32456df3 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.434581 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a82df-84f7-4fa7-9b77-decb4a2ae1ba admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.442244 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9fc4c-19d3-48f3-9b4c-3f2a32456df3 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.444622 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9fc4c-19d3-48f3-9b4c-3f2a32456df3 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.445499 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 263/526] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/role_assignments?user.id=bc13934328e742f9a1a85d1c84ab83dd&scope.project.id=bc314fbc91c54810b27f9fcad7129c64&role.id=17e6533ce814487c9a8fb0ee2acaad32 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:47.446487 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a82df-84f7-4fa7-9b77-decb4a2ae1ba admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.470520 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-fbd9fc4c-19d3-48f3-9b4c-3f2a32456df3 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 15 15:58:47.471800 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 264/527] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/users/neutron => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:47.476280 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a82df-84f7-4fa7-9b77-decb4a2ae1ba admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.481189 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9fc4c-19d3-48f3-9b4c-3f2a32456df3 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.487130 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382e995-86fb-4211-b90d-bd0b9d5171a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.487791 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382e995-86fb-4211-b90d-bd0b9d5171a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.488072 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382e995-86fb-4211-b90d-bd0b9d5171a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.488345 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382e995-86fb-4211-b90d-bd0b9d5171a8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.489805 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382e995-86fb-4211-b90d-bd0b9d5171a8 admin admin] RBAC: Adding query filter params (role.id=17e6533ce814487c9a8fb0ee2acaad32, scope.project.id=bc314fbc91c54810b27f9fcad7129c64, user.id=9072bd35fdf046669c196133f485d334) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:47.490345 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382e995-86fb-4211-b90d-bd0b9d5171a8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.492280 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382e995-86fb-4211-b90d-bd0b9d5171a8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.499068 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9fc4c-19d3-48f3-9b4c-3f2a32456df3 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.505547 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3e2d3-4c65-42d0-a1bf-716ab61e9cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.505547 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3e2d3-4c65-42d0-a1bf-716ab61e9cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.505547 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3e2d3-4c65-42d0-a1bf-716ab61e9cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.505547 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3e2d3-4c65-42d0-a1bf-716ab61e9cd4 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.506330 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3e2d3-4c65-42d0-a1bf-716ab61e9cd4 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:47.506330 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3e2d3-4c65-42d0-a1bf-716ab61e9cd4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.507100 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 264/528] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/role_assignments?user.id=9072bd35fdf046669c196133f485d334&scope.project.id=bc314fbc91c54810b27f9fcad7129c64&role.id=17e6533ce814487c9a8fb0ee2acaad32 => generated 259 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:47.513472 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3e2d3-4c65-42d0-a1bf-716ab61e9cd4 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.528999 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 265/529] 10.222.0.36 () {56 vars in 1160 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:47.534991 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382e995-86fb-4211-b90d-bd0b9d5171a8 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.548678 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382e995-86fb-4211-b90d-bd0b9d5171a8 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.554388 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c3c3a-0fae-40ad-a787-802d044829ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.555102 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c3c3a-0fae-40ad-a787-802d044829ea admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.555384 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c3c3a-0fae-40ad-a787-802d044829ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.555657 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c3c3a-0fae-40ad-a787-802d044829ea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.565735 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c3c3a-0fae-40ad-a787-802d044829ea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.568196 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c3c3a-0fae-40ad-a787-802d044829ea admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.578678 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 265/530] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:47.585250 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3e2d3-4c65-42d0-a1bf-716ab61e9cd4 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.595785 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3e2d3-4c65-42d0-a1bf-716ab61e9cd4 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.601425 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb72fb-1547-4485-a0d8-f0c727960581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.602287 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb72fb-1547-4485-a0d8-f0c727960581 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.602569 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb72fb-1547-4485-a0d8-f0c727960581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.602913 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb72fb-1547-4485-a0d8-f0c727960581 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.615245 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb72fb-1547-4485-a0d8-f0c727960581 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.617201 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb72fb-1547-4485-a0d8-f0c727960581 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.637934 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-8abb72fb-1547-4485-a0d8-f0c727960581 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:47.639595 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 266/531] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:47.641910 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb84c7-b170-4e77-bf7d-8d0d33f6c4af None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.642197 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb84c7-b170-4e77-bf7d-8d0d33f6c4af None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.642470 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb84c7-b170-4e77-bf7d-8d0d33f6c4af None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.644531 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 266/532] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:58:47.645330 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb72fb-1547-4485-a0d8-f0c727960581 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.652771 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e1f5c-d24e-4558-8d9d-6a40dd2c594d None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.653465 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e1f5c-d24e-4558-8d9d-6a40dd2c594d None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.653961 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e1f5c-d24e-4558-8d9d-6a40dd2c594d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.662112 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb72fb-1547-4485-a0d8-f0c727960581 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.675147 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d56cd-9d77-4eb9-9c40-a48a628645c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.675823 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d56cd-9d77-4eb9-9c40-a48a628645c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.676103 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d56cd-9d77-4eb9-9c40-a48a628645c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.676379 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d56cd-9d77-4eb9-9c40-a48a628645c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.677907 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d56cd-9d77-4eb9-9c40-a48a628645c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:47.678215 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d56cd-9d77-4eb9-9c40-a48a628645c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.679130 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-dc7e1f5c-d24e-4558-8d9d-6a40dd2c594d None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:47.679857 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d56cd-9d77-4eb9-9c40-a48a628645c5 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.680870 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-dc7e1f5c-d24e-4558-8d9d-6a40dd2c594d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:47.690023 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 267/533] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:47.707809 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 267/534] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:47.714367 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e1f5c-d24e-4558-8d9d-6a40dd2c594d None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.725455 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d56cd-9d77-4eb9-9c40-a48a628645c5 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.733323 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e1f5c-d24e-4558-8d9d-6a40dd2c594d None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.735290 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d56cd-9d77-4eb9-9c40-a48a628645c5 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.740269 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccba15d-c689-408b-9db3-de001a838fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.740622 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011ee8f-b877-40b4-b15e-3e51994b4968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.741456 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011ee8f-b877-40b4-b15e-3e51994b4968 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.741743 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011ee8f-b877-40b4-b15e-3e51994b4968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.742017 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011ee8f-b877-40b4-b15e-3e51994b4968 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.742296 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccba15d-c689-408b-9db3-de001a838fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.742772 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccba15d-c689-408b-9db3-de001a838fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.743241 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccba15d-c689-408b-9db3-de001a838fc3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.758902 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011ee8f-b877-40b4-b15e-3e51994b4968 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.762745 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011ee8f-b877-40b4-b15e-3e51994b4968 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.764906 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccba15d-c689-408b-9db3-de001a838fc3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.767177 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccba15d-c689-408b-9db3-de001a838fc3 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.786491 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-c011ee8f-b877-40b4-b15e-3e51994b4968 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:47.788265 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 268/535] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:47.793153 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-0ccba15d-c689-408b-9db3-de001a838fc3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:58:47.794725 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 268/536] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:47.800782 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011ee8f-b877-40b4-b15e-3e51994b4968 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.800973 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccba15d-c689-408b-9db3-de001a838fc3 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.811995 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccba15d-c689-408b-9db3-de001a838fc3 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.820122 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011ee8f-b877-40b4-b15e-3e51994b4968 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.823166 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713b986-5f7b-4968-88e9-372bc1a4605d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.825423 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713b986-5f7b-4968-88e9-372bc1a4605d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.826799 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713b986-5f7b-4968-88e9-372bc1a4605d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.827168 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713b986-5f7b-4968-88e9-372bc1a4605d admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.828354 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713b986-5f7b-4968-88e9-372bc1a4605d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:47.829478 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713b986-5f7b-4968-88e9-372bc1a4605d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.830094 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5dafcb-ffc8-4dd3-ae9e-d967ceeb4ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.831833 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5dafcb-ffc8-4dd3-ae9e-d967ceeb4ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.832631 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713b986-5f7b-4968-88e9-372bc1a4605d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.833037 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5dafcb-ffc8-4dd3-ae9e-d967ceeb4ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.833538 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5dafcb-ffc8-4dd3-ae9e-d967ceeb4ea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.834553 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5dafcb-ffc8-4dd3-ae9e-d967ceeb4ea2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:47.834960 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5dafcb-ffc8-4dd3-ae9e-d967ceeb4ea2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.837057 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5dafcb-ffc8-4dd3-ae9e-d967ceeb4ea2 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.850261 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 269/537] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:47.854694 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 269/538] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:47.857250 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713b986-5f7b-4968-88e9-372bc1a4605d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.861083 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5dafcb-ffc8-4dd3-ae9e-d967ceeb4ea2 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:47.868489 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713b986-5f7b-4968-88e9-372bc1a4605d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.877005 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5dafcb-ffc8-4dd3-ae9e-d967ceeb4ea2 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:47.878742 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485525e-4077-4a43-921a-5ab810ebb915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.879631 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485525e-4077-4a43-921a-5ab810ebb915 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.880756 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485525e-4077-4a43-921a-5ab810ebb915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.881180 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485525e-4077-4a43-921a-5ab810ebb915 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.882759 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485525e-4077-4a43-921a-5ab810ebb915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.886603 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485525e-4077-4a43-921a-5ab810ebb915 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.890823 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e788ac-1739-4ad8-a408-06becf1bff46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:47.891624 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e788ac-1739-4ad8-a408-06becf1bff46 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:47.894025 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e788ac-1739-4ad8-a408-06becf1bff46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:47.894489 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e788ac-1739-4ad8-a408-06becf1bff46 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:47.895555 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e788ac-1739-4ad8-a408-06becf1bff46 admin admin] RBAC: Adding query filter params (role.id=17e6533ce814487c9a8fb0ee2acaad32, scope.project.id=bc314fbc91c54810b27f9fcad7129c64, user.id=f2f08f47d4e6442a92901fb7d8bed0bf) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:47.896696 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e788ac-1739-4ad8-a408-06becf1bff46 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:47.900963 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e788ac-1739-4ad8-a408-06becf1bff46 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:47.911483 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 270/539] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:47 2021] GET /identity/v3/role_assignments?user.id=f2f08f47d4e6442a92901fb7d8bed0bf&scope.project.id=bc314fbc91c54810b27f9fcad7129c64&role.id=17e6533ce814487c9a8fb0ee2acaad32 => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:47.919284 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 270/540] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Dec 15 15:58:47 2021] POST /identity/v3/users => generated 247 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:58:50.073061 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff2c1b-ee9e-4e85-913b-9cdab4969d0c None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.073593 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff2c1b-ee9e-4e85-913b-9cdab4969d0c None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.073719 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff2c1b-ee9e-4e85-913b-9cdab4969d0c None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.075643 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 271/541] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:50.081301 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf718c-25ea-4b29-aabc-bb3e5a8beb71 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.081747 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf718c-25ea-4b29-aabc-bb3e5a8beb71 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.081865 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf718c-25ea-4b29-aabc-bb3e5a8beb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.102266 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-9baf718c-25ea-4b29-aabc-bb3e5a8beb71 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:50.103668 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-9baf718c-25ea-4b29-aabc-bb3e5a8beb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:50.111831 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 271/542] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:58:50.150105 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff2c1b-ee9e-4e85-913b-9cdab4969d0c None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:50.167997 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff2c1b-ee9e-4e85-913b-9cdab4969d0c None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:50.178005 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9322c-9b10-48d4-a527-0cecebe5ac37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:50.178810 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9322c-9b10-48d4-a527-0cecebe5ac37 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.179110 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9322c-9b10-48d4-a527-0cecebe5ac37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.179597 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9322c-9b10-48d4-a527-0cecebe5ac37 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.198404 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9322c-9b10-48d4-a527-0cecebe5ac37 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:50.205370 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-bbd9322c-9b10-48d4-a527-0cecebe5ac37 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 15:58:50.210657 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 272/543] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Dec 15 15:58:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:50.216984 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf718c-25ea-4b29-aabc-bb3e5a8beb71 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:50.230465 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf718c-25ea-4b29-aabc-bb3e5a8beb71 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:50.237045 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fa39f-ba3a-43e9-8176-b38d2a9aacc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:50.237741 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fa39f-ba3a-43e9-8176-b38d2a9aacc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.238020 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fa39f-ba3a-43e9-8176-b38d2a9aacc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.238292 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fa39f-ba3a-43e9-8176-b38d2a9aacc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.239120 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fa39f-ba3a-43e9-8176-b38d2a9aacc8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:50.239424 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fa39f-ba3a-43e9-8176-b38d2a9aacc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:50.241114 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fa39f-ba3a-43e9-8176-b38d2a9aacc8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:50.254317 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 272/544] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Dec 15 15:58:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:50.260144 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9322c-9b10-48d4-a527-0cecebe5ac37 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:50.274970 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9322c-9b10-48d4-a527-0cecebe5ac37 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:50.285482 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3495a2-5150-4c6f-8012-01af69b0b963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:50.286826 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3495a2-5150-4c6f-8012-01af69b0b963 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.287257 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3495a2-5150-4c6f-8012-01af69b0b963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.287536 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3495a2-5150-4c6f-8012-01af69b0b963 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.309335 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3495a2-5150-4c6f-8012-01af69b0b963 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:50.311136 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3495a2-5150-4c6f-8012-01af69b0b963 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:50.334656 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-7a3495a2-5150-4c6f-8012-01af69b0b963 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:50.335855 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 273/545] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:50.341986 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fa39f-ba3a-43e9-8176-b38d2a9aacc8 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:50.355593 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fa39f-ba3a-43e9-8176-b38d2a9aacc8 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:50.366621 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef888645-ec31-47cc-8431-487a58e8009c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:50.367296 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef888645-ec31-47cc-8431-487a58e8009c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.367582 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef888645-ec31-47cc-8431-487a58e8009c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.367864 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef888645-ec31-47cc-8431-487a58e8009c admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.368607 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef888645-ec31-47cc-8431-487a58e8009c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:50.368915 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef888645-ec31-47cc-8431-487a58e8009c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:50.370554 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef888645-ec31-47cc-8431-487a58e8009c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:50.393214 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 273/546] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:50.399875 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3495a2-5150-4c6f-8012-01af69b0b963 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:50.402636 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bec3b-1d96-46e6-99a8-f8006b8068ef None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.402935 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bec3b-1d96-46e6-99a8-f8006b8068ef None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.403213 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bec3b-1d96-46e6-99a8-f8006b8068ef None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.405232 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 274/547] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:58:50.411417 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734bc90-9c51-41ef-9753-42cdc167f140 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.411706 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734bc90-9c51-41ef-9753-42cdc167f140 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.411989 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734bc90-9c51-41ef-9753-42cdc167f140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.414865 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3495a2-5150-4c6f-8012-01af69b0b963 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:50.425114 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a59aef-4c96-4ef3-87c1-9caf3404f349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:50.425936 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a59aef-4c96-4ef3-87c1-9caf3404f349 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.426216 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a59aef-4c96-4ef3-87c1-9caf3404f349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.426520 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a59aef-4c96-4ef3-87c1-9caf3404f349 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.444512 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a59aef-4c96-4ef3-87c1-9caf3404f349 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:50.447514 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-a734bc90-9c51-41ef-9753-42cdc167f140 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:50.448727 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-a734bc90-9c51-41ef-9753-42cdc167f140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:50.450121 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a59aef-4c96-4ef3-87c1-9caf3404f349 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:50.477055 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-60a59aef-4c96-4ef3-87c1-9caf3404f349 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 15 15:58:50.484433 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 275/548] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:58:50.484733 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 274/549] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:50 2021] GET /identity/v3/users/cinder => generated 84 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:50.499818 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734bc90-9c51-41ef-9753-42cdc167f140 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:50.510561 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734bc90-9c51-41ef-9753-42cdc167f140 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:50.515900 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a59aef-4c96-4ef3-87c1-9caf3404f349 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:50.520711 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c43e26-723d-4790-87ac-d101e5f7be39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:50.521417 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c43e26-723d-4790-87ac-d101e5f7be39 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.521757 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c43e26-723d-4790-87ac-d101e5f7be39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.522078 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c43e26-723d-4790-87ac-d101e5f7be39 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.523021 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c43e26-723d-4790-87ac-d101e5f7be39 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:50.523334 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c43e26-723d-4790-87ac-d101e5f7be39 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:50.524369 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING py.warnings [None req-40c43e26-723d-4790-87ac-d101e5f7be39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:58:50.524369 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: warnings.warn(msg) Dec 15 15:58:50.524369 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: Dec 15 15:58:50.525709 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c43e26-723d-4790-87ac-d101e5f7be39 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:50.531584 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a59aef-4c96-4ef3-87c1-9caf3404f349 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:50.546679 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04ad0d-2c9b-4eec-8291-449e1fa853ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:50.547487 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04ad0d-2c9b-4eec-8291-449e1fa853ec admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.547869 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04ad0d-2c9b-4eec-8291-449e1fa853ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.548148 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04ad0d-2c9b-4eec-8291-449e1fa853ec admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.575243 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04ad0d-2c9b-4eec-8291-449e1fa853ec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:50.584511 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-4f04ad0d-2c9b-4eec-8291-449e1fa853ec admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 15:58:50.586062 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 275/550] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Dec 15 15:58:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:50.594371 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04ad0d-2c9b-4eec-8291-449e1fa853ec admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:50.600276 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 276/551] 10.222.0.36 () {56 vars in 1158 bytes} [Wed Dec 15 15:58:50 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:50.606117 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c43e26-723d-4790-87ac-d101e5f7be39 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:50.611790 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04ad0d-2c9b-4eec-8291-449e1fa853ec admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:50.618272 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c43e26-723d-4790-87ac-d101e5f7be39 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:50.622922 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85776d08-3961-4d65-aa95-7160338e5b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:50.624552 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85776d08-3961-4d65-aa95-7160338e5b5f admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.624884 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85776d08-3961-4d65-aa95-7160338e5b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.625165 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85776d08-3961-4d65-aa95-7160338e5b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.627054 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2dd645-e90a-428f-a514-8293ba17a05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:50.627442 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85776d08-3961-4d65-aa95-7160338e5b5f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:50.627753 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85776d08-3961-4d65-aa95-7160338e5b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:50.629006 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dd645-e90a-428f-a514-8293ba17a05d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.629731 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dd645-e90a-428f-a514-8293ba17a05d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.630042 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dd645-e90a-428f-a514-8293ba17a05d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.631614 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85776d08-3961-4d65-aa95-7160338e5b5f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:50.653525 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 276/552] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Dec 15 15:58:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:50.654762 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2dd645-e90a-428f-a514-8293ba17a05d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:50.656692 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2dd645-e90a-428f-a514-8293ba17a05d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:50.662970 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85776d08-3961-4d65-aa95-7160338e5b5f admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:50.675187 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85776d08-3961-4d65-aa95-7160338e5b5f admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:50.684458 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae77c0f-79d3-4391-bbfe-001c105c948b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:50.685299 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae77c0f-79d3-4391-bbfe-001c105c948b admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.685850 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae77c0f-79d3-4391-bbfe-001c105c948b admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.686132 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae77c0f-79d3-4391-bbfe-001c105c948b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.700999 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-dc2dd645-e90a-428f-a514-8293ba17a05d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:50.704865 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 277/553] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:50.706258 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae77c0f-79d3-4391-bbfe-001c105c948b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:50.709924 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2dd645-e90a-428f-a514-8293ba17a05d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:50.710613 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae77c0f-79d3-4391-bbfe-001c105c948b admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:50.720770 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2dd645-e90a-428f-a514-8293ba17a05d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:50.726237 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60949f1a-888f-47e1-869f-bf3dfba9b2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:50.726889 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60949f1a-888f-47e1-869f-bf3dfba9b2ef admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.727231 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60949f1a-888f-47e1-869f-bf3dfba9b2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.727569 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60949f1a-888f-47e1-869f-bf3dfba9b2ef admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.728344 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60949f1a-888f-47e1-869f-bf3dfba9b2ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:50.728655 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60949f1a-888f-47e1-869f-bf3dfba9b2ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:50.730357 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60949f1a-888f-47e1-869f-bf3dfba9b2ef admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:50.730932 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-0ae77c0f-79d3-4391-bbfe-001c105c948b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:50.737011 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 277/554] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:50.738344 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa8461-3d2d-4210-b001-8504b7728ec1 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.738626 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa8461-3d2d-4210-b001-8504b7728ec1 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.738977 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa8461-3d2d-4210-b001-8504b7728ec1 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.740833 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 278/555] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:50.741576 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa8461-3d2d-4210-b001-8504b7728ec1 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:50.747186 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 278/556] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:50.748451 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cbc79-0f72-4a76-a69d-ced39ca61f23 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.748736 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cbc79-0f72-4a76-a69d-ced39ca61f23 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.749008 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cbc79-0f72-4a76-a69d-ced39ca61f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.765877 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa8461-3d2d-4210-b001-8504b7728ec1 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:50.771297 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426b2dd-699f-42d9-9ab5-f03f576e82ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:50.772043 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426b2dd-699f-42d9-9ab5-f03f576e82ac admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.772327 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426b2dd-699f-42d9-9ab5-f03f576e82ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.772651 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426b2dd-699f-42d9-9ab5-f03f576e82ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.773529 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426b2dd-699f-42d9-9ab5-f03f576e82ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:50.773890 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426b2dd-699f-42d9-9ab5-f03f576e82ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:50.774008 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-ba1cbc79-0f72-4a76-a69d-ced39ca61f23 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:50.775181 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-ba1cbc79-0f72-4a76-a69d-ced39ca61f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:50.775655 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426b2dd-699f-42d9-9ab5-f03f576e82ac admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:50.783399 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 279/557] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:50.784174 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1cbc79-0f72-4a76-a69d-ced39ca61f23 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:50.796080 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 279/558] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:50.799531 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1cbc79-0f72-4a76-a69d-ced39ca61f23 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:50.801961 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426b2dd-699f-42d9-9ab5-f03f576e82ac admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:50.810867 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7365aa6-c27d-4564-83b3-c67a280a0706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:50.811655 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7365aa6-c27d-4564-83b3-c67a280a0706 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.811931 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7365aa6-c27d-4564-83b3-c67a280a0706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.812200 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7365aa6-c27d-4564-83b3-c67a280a0706 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.818762 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426b2dd-699f-42d9-9ab5-f03f576e82ac admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:50.822755 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7365aa6-c27d-4564-83b3-c67a280a0706 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:50.823612 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125449f-6b51-48a6-b77d-fd1e4deedff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:50.824404 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125449f-6b51-48a6-b77d-fd1e4deedff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.824688 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125449f-6b51-48a6-b77d-fd1e4deedff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.824922 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7365aa6-c27d-4564-83b3-c67a280a0706 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:50.825084 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125449f-6b51-48a6-b77d-fd1e4deedff5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.835407 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125449f-6b51-48a6-b77d-fd1e4deedff5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:50.837567 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125449f-6b51-48a6-b77d-fd1e4deedff5 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:50.842202 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-c7365aa6-c27d-4564-83b3-c67a280a0706 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:58:50.843438 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 280/559] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:50.846148 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7365aa6-c27d-4564-83b3-c67a280a0706 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:50.856829 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-2125449f-6b51-48a6-b77d-fd1e4deedff5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 15:58:50.858898 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 280/560] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Dec 15 15:58:50 2021] GET /identity/v3/users/nova => generated 82 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:50.859665 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125449f-6b51-48a6-b77d-fd1e4deedff5 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:50.863651 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7365aa6-c27d-4564-83b3-c67a280a0706 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:50.869875 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366e967-3b7a-4777-a4a1-ec5c55f8edf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:50.871329 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366e967-3b7a-4777-a4a1-ec5c55f8edf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.871619 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366e967-3b7a-4777-a4a1-ec5c55f8edf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.872227 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366e967-3b7a-4777-a4a1-ec5c55f8edf2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.874024 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125449f-6b51-48a6-b77d-fd1e4deedff5 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:50.879093 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcbba3-1577-4400-a517-f3e569788b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:50.879773 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcbba3-1577-4400-a517-f3e569788b52 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.880050 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcbba3-1577-4400-a517-f3e569788b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.880492 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcbba3-1577-4400-a517-f3e569788b52 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.881586 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcbba3-1577-4400-a517-f3e569788b52 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:50.881893 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcbba3-1577-4400-a517-f3e569788b52 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:50.884093 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcbba3-1577-4400-a517-f3e569788b52 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:50.884259 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366e967-3b7a-4777-a4a1-ec5c55f8edf2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:50.892662 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-e366e967-3b7a-4777-a4a1-ec5c55f8edf2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 15:58:50.897047 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 281/562] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:58:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:50.898389 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 281/562] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Dec 15 15:58:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:50.902028 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcbba3-1577-4400-a517-f3e569788b52 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:50.902217 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366e967-3b7a-4777-a4a1-ec5c55f8edf2 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:50.914240 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcbba3-1577-4400-a517-f3e569788b52 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:50.914523 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366e967-3b7a-4777-a4a1-ec5c55f8edf2 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:50.919107 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d0207-85f1-4d6a-8de9-7b48db8887b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:50.919447 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3b888-5a9b-446c-9936-fd1b432cb7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:50.919759 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d0207-85f1-4d6a-8de9-7b48db8887b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.920034 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d0207-85f1-4d6a-8de9-7b48db8887b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.920203 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3b888-5a9b-446c-9936-fd1b432cb7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.920352 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d0207-85f1-4d6a-8de9-7b48db8887b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.920495 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3b888-5a9b-446c-9936-fd1b432cb7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.920682 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3b888-5a9b-446c-9936-fd1b432cb7f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.921136 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d0207-85f1-4d6a-8de9-7b48db8887b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:50.921475 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d0207-85f1-4d6a-8de9-7b48db8887b6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:50.921638 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3b888-5a9b-446c-9936-fd1b432cb7f6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:50.921797 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3b888-5a9b-446c-9936-fd1b432cb7f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:50.923307 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d0207-85f1-4d6a-8de9-7b48db8887b6 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:50.923495 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3b888-5a9b-446c-9936-fd1b432cb7f6 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:50.941130 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 282/563] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Dec 15 15:58:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:50.943083 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3b888-5a9b-446c-9936-fd1b432cb7f6 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:50.945138 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 282/564] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Dec 15 15:58:50 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:50.945987 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d0207-85f1-4d6a-8de9-7b48db8887b6 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:50.960995 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3b888-5a9b-446c-9936-fd1b432cb7f6 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:50.962462 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d0207-85f1-4d6a-8de9-7b48db8887b6 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:50.965445 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6cdf2-bc1d-4db7-9f6a-a68917737221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:50.966321 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6cdf2-bc1d-4db7-9f6a-a68917737221 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.966600 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6cdf2-bc1d-4db7-9f6a-a68917737221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.966722 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79cfef-dfa5-4b0a-80be-49f1bbb331fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:50.966892 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6cdf2-bc1d-4db7-9f6a-a68917737221 admin admin] PATH_INFO: `/v3/projects/bc314fbc91c54810b27f9fcad7129c64/users/0d18ec9bcc0e481aa000833ec1c0988d/roles/17e6533ce814487c9a8fb0ee2acaad32` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.967462 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79cfef-dfa5-4b0a-80be-49f1bbb331fa admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:50.967744 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79cfef-dfa5-4b0a-80be-49f1bbb331fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:50.968019 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79cfef-dfa5-4b0a-80be-49f1bbb331fa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:50.978159 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79cfef-dfa5-4b0a-80be-49f1bbb331fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:50.979971 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79cfef-dfa5-4b0a-80be-49f1bbb331fa admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:50.981702 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6cdf2-bc1d-4db7-9f6a-a68917737221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc314fbc91c54810b27f9fcad7129c64, user_id=0d18ec9bcc0e481aa000833ec1c0988d, role_id=17e6533ce814487c9a8fb0ee2acaad32)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:50.984338 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6cdf2-bc1d-4db7-9f6a-a68917737221 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:50.997013 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 283/565] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Dec 15 15:58:50 2021] PUT /identity/v3/projects/bc314fbc91c54810b27f9fcad7129c64/users/0d18ec9bcc0e481aa000833ec1c0988d/roles/17e6533ce814487c9a8fb0ee2acaad32 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 15:58:50.997173 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-5b79cfef-dfa5-4b0a-80be-49f1bbb331fa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:50.998759 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6cdf2-bc1d-4db7-9f6a-a68917737221 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:50.998870 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 283/566] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:50.999741 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8f9ec-97bc-4ead-92d4-4c373e9d9817 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.000021 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8f9ec-97bc-4ead-92d4-4c373e9d9817 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.000293 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8f9ec-97bc-4ead-92d4-4c373e9d9817 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.007514 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 284/567] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:51.007514 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881b180-5ae2-49e3-bdde-44361365c177 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.007514 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881b180-5ae2-49e3-bdde-44361365c177 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.007514 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881b180-5ae2-49e3-bdde-44361365c177 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.007514 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 285/568] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:51.008181 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881b180-5ae2-49e3-bdde-44361365c177 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.078208 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6cdf2-bc1d-4db7-9f6a-a68917737221 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.082761 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881b180-5ae2-49e3-bdde-44361365c177 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.083314 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953e061-f16f-4a3b-935d-3996c6f4fbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.083816 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953e061-f16f-4a3b-935d-3996c6f4fbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.083919 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953e061-f16f-4a3b-935d-3996c6f4fbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.084228 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953e061-f16f-4a3b-935d-3996c6f4fbb1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.088349 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fa3a7-b1f2-4ce0-8cd3-6a4506224f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.088953 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fa3a7-b1f2-4ce0-8cd3-6a4506224f81 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.089239 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fa3a7-b1f2-4ce0-8cd3-6a4506224f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.089552 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fa3a7-b1f2-4ce0-8cd3-6a4506224f81 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.090300 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fa3a7-b1f2-4ce0-8cd3-6a4506224f81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:51.090609 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fa3a7-b1f2-4ce0-8cd3-6a4506224f81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.092261 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fa3a7-b1f2-4ce0-8cd3-6a4506224f81 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.096189 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953e061-f16f-4a3b-935d-3996c6f4fbb1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.098880 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953e061-f16f-4a3b-935d-3996c6f4fbb1 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.104765 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 286/569] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:51.106798 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83711a44-8734-43b6-9d85-8a82cf0f9ddf None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.107709 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83711a44-8734-43b6-9d85-8a82cf0f9ddf None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.108165 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83711a44-8734-43b6-9d85-8a82cf0f9ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.118778 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-2953e061-f16f-4a3b-935d-3996c6f4fbb1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:51.125009 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 284/570] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:51.125009 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3448f9-592f-4cc7-b327-1185a023873c None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.125009 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3448f9-592f-4cc7-b327-1185a023873c None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.125009 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3448f9-592f-4cc7-b327-1185a023873c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.132420 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-83711a44-8734-43b6-9d85-8a82cf0f9ddf None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:51.133693 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-83711a44-8734-43b6-9d85-8a82cf0f9ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:51.141035 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-4c3448f9-592f-4cc7-b327-1185a023873c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:51.142519 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 287/571] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:51.142628 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-4c3448f9-592f-4cc7-b327-1185a023873c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:51.159734 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 285/572] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:51.159734 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3448f9-592f-4cc7-b327-1185a023873c None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.160247 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83711a44-8734-43b6-9d85-8a82cf0f9ddf None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.167438 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83711a44-8734-43b6-9d85-8a82cf0f9ddf None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.172229 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6e045-15db-4fda-be63-2ff13b0f4622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.173127 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6e045-15db-4fda-be63-2ff13b0f4622 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.173456 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6e045-15db-4fda-be63-2ff13b0f4622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.173733 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6e045-15db-4fda-be63-2ff13b0f4622 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.179416 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3448f9-592f-4cc7-b327-1185a023873c None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.182703 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6e045-15db-4fda-be63-2ff13b0f4622 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.184209 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c175440-9886-4cb3-bc68-da6729249253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.184892 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c175440-9886-4cb3-bc68-da6729249253 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.185100 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6e045-15db-4fda-be63-2ff13b0f4622 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.185199 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c175440-9886-4cb3-bc68-da6729249253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.185445 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c175440-9886-4cb3-bc68-da6729249253 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.186199 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c175440-9886-4cb3-bc68-da6729249253 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:51.186507 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c175440-9886-4cb3-bc68-da6729249253 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.188148 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c175440-9886-4cb3-bc68-da6729249253 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.200702 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 286/573] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:51.201630 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-26a6e045-15db-4fda-be63-2ff13b0f4622 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 15 15:58:51.201739 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c175440-9886-4cb3-bc68-da6729249253 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.203066 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 288/574] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/users/glance => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:51.203968 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6e045-15db-4fda-be63-2ff13b0f4622 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.213959 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c175440-9886-4cb3-bc68-da6729249253 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.220323 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6e045-15db-4fda-be63-2ff13b0f4622 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.221485 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf438b-aa96-4d9f-84f4-a1a1137d3458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.222283 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf438b-aa96-4d9f-84f4-a1a1137d3458 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.222571 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf438b-aa96-4d9f-84f4-a1a1137d3458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.222846 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf438b-aa96-4d9f-84f4-a1a1137d3458 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.225563 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c64317-bc91-4687-aeba-986e55b7f00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.226338 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c64317-bc91-4687-aeba-986e55b7f00f admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.226632 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c64317-bc91-4687-aeba-986e55b7f00f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.226885 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c64317-bc91-4687-aeba-986e55b7f00f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.235443 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf438b-aa96-4d9f-84f4-a1a1137d3458 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:51.239606 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c64317-bc91-4687-aeba-986e55b7f00f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:51.242836 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-9dbf438b-aa96-4d9f-84f4-a1a1137d3458 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 15:58:51.244300 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 287/575] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:51.244985 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf438b-aa96-4d9f-84f4-a1a1137d3458 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.252008 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-43c64317-bc91-4687-aeba-986e55b7f00f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 15:58:51.257407 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 289/576] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:51.257407 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c64317-bc91-4687-aeba-986e55b7f00f admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.257630 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf438b-aa96-4d9f-84f4-a1a1137d3458 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.260729 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb31e7-5fde-4715-a5bf-5a4da45fb9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.261404 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb31e7-5fde-4715-a5bf-5a4da45fb9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.261686 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb31e7-5fde-4715-a5bf-5a4da45fb9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.261957 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb31e7-5fde-4715-a5bf-5a4da45fb9f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.262799 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb31e7-5fde-4715-a5bf-5a4da45fb9f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:51.263103 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb31e7-5fde-4715-a5bf-5a4da45fb9f7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.265074 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb31e7-5fde-4715-a5bf-5a4da45fb9f7 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.267351 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c64317-bc91-4687-aeba-986e55b7f00f admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.272514 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34798184-f196-4e9b-bd89-61e782e1e751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.273275 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34798184-f196-4e9b-bd89-61e782e1e751 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.273583 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34798184-f196-4e9b-bd89-61e782e1e751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.273862 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34798184-f196-4e9b-bd89-61e782e1e751 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.281261 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34798184-f196-4e9b-bd89-61e782e1e751 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.283240 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 288/577] 10.222.0.36 () {56 vars in 1158 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:51.283349 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34798184-f196-4e9b-bd89-61e782e1e751 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.283852 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb31e7-5fde-4715-a5bf-5a4da45fb9f7 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.293311 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb31e7-5fde-4715-a5bf-5a4da45fb9f7 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.297831 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d075b5a-da85-4bde-8036-83932937322f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.298463 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d075b5a-da85-4bde-8036-83932937322f admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.298797 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d075b5a-da85-4bde-8036-83932937322f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.299069 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d075b5a-da85-4bde-8036-83932937322f admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.299809 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d075b5a-da85-4bde-8036-83932937322f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:51.300156 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d075b5a-da85-4bde-8036-83932937322f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.300730 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-34798184-f196-4e9b-bd89-61e782e1e751 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:58:51.302051 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d075b5a-da85-4bde-8036-83932937322f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.302455 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 290/578] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:51.303167 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34798184-f196-4e9b-bd89-61e782e1e751 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.310590 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 289/579] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:51.311370 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d075b5a-da85-4bde-8036-83932937322f admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.320951 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34798184-f196-4e9b-bd89-61e782e1e751 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.321265 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d075b5a-da85-4bde-8036-83932937322f admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.325415 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fb18c-2273-409c-a677-bcb26af891f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.325538 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a8198-f3af-4b45-bda1-cdd828a652ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.326069 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fb18c-2273-409c-a677-bcb26af891f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.326283 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a8198-f3af-4b45-bda1-cdd828a652ac admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.326387 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fb18c-2273-409c-a677-bcb26af891f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.326563 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a8198-f3af-4b45-bda1-cdd828a652ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.326657 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fb18c-2273-409c-a677-bcb26af891f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.326831 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a8198-f3af-4b45-bda1-cdd828a652ac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.327371 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fb18c-2273-409c-a677-bcb26af891f5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:51.327678 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fb18c-2273-409c-a677-bcb26af891f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.329711 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fb18c-2273-409c-a677-bcb26af891f5 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.338122 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a8198-f3af-4b45-bda1-cdd828a652ac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.344444 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 291/580] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:51.344561 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a8198-f3af-4b45-bda1-cdd828a652ac admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.344661 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fb18c-2273-409c-a677-bcb26af891f5 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.354633 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fb18c-2273-409c-a677-bcb26af891f5 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.358944 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9670988-2c3a-40db-8ee8-f4c6d13737a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.359571 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9670988-2c3a-40db-8ee8-f4c6d13737a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.359849 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9670988-2c3a-40db-8ee8-f4c6d13737a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.360116 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9670988-2c3a-40db-8ee8-f4c6d13737a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.360896 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9670988-2c3a-40db-8ee8-f4c6d13737a0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:51.361201 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9670988-2c3a-40db-8ee8-f4c6d13737a0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.361369 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-0a5a8198-f3af-4b45-bda1-cdd828a652ac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:51.362710 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 290/581] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:51.363061 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9670988-2c3a-40db-8ee8-f4c6d13737a0 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.363411 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a8198-f3af-4b45-bda1-cdd828a652ac admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.374078 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a8198-f3af-4b45-bda1-cdd828a652ac admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.374635 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 292/582] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:51.375282 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9670988-2c3a-40db-8ee8-f4c6d13737a0 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.384943 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53ad70-e8ee-4801-8b7b-9e1c82eea975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.385431 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9670988-2c3a-40db-8ee8-f4c6d13737a0 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.385766 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53ad70-e8ee-4801-8b7b-9e1c82eea975 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.386045 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53ad70-e8ee-4801-8b7b-9e1c82eea975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.386316 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53ad70-e8ee-4801-8b7b-9e1c82eea975 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.389762 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c00e4-52b6-4b28-8736-1780e275cf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.390511 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c00e4-52b6-4b28-8736-1780e275cf83 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.390790 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c00e4-52b6-4b28-8736-1780e275cf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.391062 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c00e4-52b6-4b28-8736-1780e275cf83 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.398443 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53ad70-e8ee-4801-8b7b-9e1c82eea975 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.400330 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53ad70-e8ee-4801-8b7b-9e1c82eea975 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.402104 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c00e4-52b6-4b28-8736-1780e275cf83 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.403910 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c00e4-52b6-4b28-8736-1780e275cf83 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.416999 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-ca53ad70-e8ee-4801-8b7b-9e1c82eea975 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:51.426822 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 291/583] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:51.426822 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53ad70-e8ee-4801-8b7b-9e1c82eea975 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.427087 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-f89c00e4-52b6-4b28-8736-1780e275cf83 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:51.427087 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 293/584] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:51.427087 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c00e4-52b6-4b28-8736-1780e275cf83 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.431311 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53ad70-e8ee-4801-8b7b-9e1c82eea975 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.435962 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc41857-c76b-4f2f-b046-1a98c44090b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.436592 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc41857-c76b-4f2f-b046-1a98c44090b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.436874 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc41857-c76b-4f2f-b046-1a98c44090b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.437029 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c00e4-52b6-4b28-8736-1780e275cf83 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.437134 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc41857-c76b-4f2f-b046-1a98c44090b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.437892 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc41857-c76b-4f2f-b046-1a98c44090b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:51.438456 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc41857-c76b-4f2f-b046-1a98c44090b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.439913 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc41857-c76b-4f2f-b046-1a98c44090b7 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.441566 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1408e5-8178-4832-936c-23e6402dd6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.443036 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1408e5-8178-4832-936c-23e6402dd6ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.443507 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1408e5-8178-4832-936c-23e6402dd6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.443852 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1408e5-8178-4832-936c-23e6402dd6ec admin admin] PATH_INFO: `/v3/projects/bc314fbc91c54810b27f9fcad7129c64/users/bc13934328e742f9a1a85d1c84ab83dd/roles/17e6533ce814487c9a8fb0ee2acaad32` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.453670 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 292/585] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:51.454709 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc41857-c76b-4f2f-b046-1a98c44090b7 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.459046 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1408e5-8178-4832-936c-23e6402dd6ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc314fbc91c54810b27f9fcad7129c64, user_id=bc13934328e742f9a1a85d1c84ab83dd, role_id=17e6533ce814487c9a8fb0ee2acaad32)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.461788 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1408e5-8178-4832-936c-23e6402dd6ec admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.464858 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc41857-c76b-4f2f-b046-1a98c44090b7 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.469754 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be2261-7646-415b-a377-7389784bbc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.470418 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be2261-7646-415b-a377-7389784bbc27 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.470701 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be2261-7646-415b-a377-7389784bbc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.470975 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be2261-7646-415b-a377-7389784bbc27 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.471702 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be2261-7646-415b-a377-7389784bbc27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:51.472046 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be2261-7646-415b-a377-7389784bbc27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.473786 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be2261-7646-415b-a377-7389784bbc27 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.474472 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 294/586] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Dec 15 15:58:51 2021] PUT /identity/v3/projects/bc314fbc91c54810b27f9fcad7129c64/users/bc13934328e742f9a1a85d1c84ab83dd/roles/17e6533ce814487c9a8fb0ee2acaad32 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 15:58:51.475108 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1408e5-8178-4832-936c-23e6402dd6ec admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.496352 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 293/587] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:51.497411 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be2261-7646-415b-a377-7389784bbc27 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.511906 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be2261-7646-415b-a377-7389784bbc27 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.552420 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1408e5-8178-4832-936c-23e6402dd6ec admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.557867 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b494cfb-9143-4ace-a04b-4e301bc2a063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.558832 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b494cfb-9143-4ace-a04b-4e301bc2a063 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.559256 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b494cfb-9143-4ace-a04b-4e301bc2a063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.559725 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b494cfb-9143-4ace-a04b-4e301bc2a063 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.560695 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b494cfb-9143-4ace-a04b-4e301bc2a063 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:51.561151 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b494cfb-9143-4ace-a04b-4e301bc2a063 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.563270 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b494cfb-9143-4ace-a04b-4e301bc2a063 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.578313 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 295/588] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:51.579474 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b494cfb-9143-4ace-a04b-4e301bc2a063 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.591125 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b494cfb-9143-4ace-a04b-4e301bc2a063 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.593230 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231fcce-6c8a-4f77-b213-7a049437ebe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.594182 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231fcce-6c8a-4f77-b213-7a049437ebe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.594606 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231fcce-6c8a-4f77-b213-7a049437ebe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.594918 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231fcce-6c8a-4f77-b213-7a049437ebe6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.597321 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8eb95c-4905-469e-a870-fb38d9e053b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.598426 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8eb95c-4905-469e-a870-fb38d9e053b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.598905 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8eb95c-4905-469e-a870-fb38d9e053b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.599439 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8eb95c-4905-469e-a870-fb38d9e053b0 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.604083 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231fcce-6c8a-4f77-b213-7a049437ebe6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.606271 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231fcce-6c8a-4f77-b213-7a049437ebe6 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.609698 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8eb95c-4905-469e-a870-fb38d9e053b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.612095 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8eb95c-4905-469e-a870-fb38d9e053b0 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.623026 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-6231fcce-6c8a-4f77-b213-7a049437ebe6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:58:51.624415 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 294/589] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:51.625324 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231fcce-6c8a-4f77-b213-7a049437ebe6 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.630993 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-ca8eb95c-4905-469e-a870-fb38d9e053b0 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 15:58:51.632833 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 296/590] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/users/swift => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:51.633818 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8eb95c-4905-469e-a870-fb38d9e053b0 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.637062 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231fcce-6c8a-4f77-b213-7a049437ebe6 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.642815 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e2115-84fc-4fb1-a578-e12e06559917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.644035 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e2115-84fc-4fb1-a578-e12e06559917 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.644440 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e2115-84fc-4fb1-a578-e12e06559917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.644848 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e2115-84fc-4fb1-a578-e12e06559917 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.646801 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8eb95c-4905-469e-a870-fb38d9e053b0 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.651841 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912fb84-dac3-4678-ba25-72de2dd44a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.652827 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912fb84-dac3-4678-ba25-72de2dd44a1b admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.653256 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912fb84-dac3-4678-ba25-72de2dd44a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.653729 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912fb84-dac3-4678-ba25-72de2dd44a1b admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.654049 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e2115-84fc-4fb1-a578-e12e06559917 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.654997 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912fb84-dac3-4678-ba25-72de2dd44a1b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:51.655450 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912fb84-dac3-4678-ba25-72de2dd44a1b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.656415 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e2115-84fc-4fb1-a578-e12e06559917 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.658033 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912fb84-dac3-4678-ba25-72de2dd44a1b admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.672816 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 297/591] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:51.674115 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912fb84-dac3-4678-ba25-72de2dd44a1b admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.674898 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-a27e2115-84fc-4fb1-a578-e12e06559917 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 15 15:58:51.681684 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 295/592] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/users/neutron => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:51.682601 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e2115-84fc-4fb1-a578-e12e06559917 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.687589 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912fb84-dac3-4678-ba25-72de2dd44a1b admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.693416 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1a1d8-38ea-4a1d-a5e0-8bf1d44dafdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.694414 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1a1d8-38ea-4a1d-a5e0-8bf1d44dafdb admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.694530 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e2115-84fc-4fb1-a578-e12e06559917 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.694943 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1a1d8-38ea-4a1d-a5e0-8bf1d44dafdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.695472 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1a1d8-38ea-4a1d-a5e0-8bf1d44dafdb admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.696843 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1a1d8-38ea-4a1d-a5e0-8bf1d44dafdb admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:51.697421 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1a1d8-38ea-4a1d-a5e0-8bf1d44dafdb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.699920 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1a1d8-38ea-4a1d-a5e0-8bf1d44dafdb admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.700235 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221703e-cb47-474d-9c98-e8e94bf2e6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.701221 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221703e-cb47-474d-9c98-e8e94bf2e6ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.701628 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221703e-cb47-474d-9c98-e8e94bf2e6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.701994 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221703e-cb47-474d-9c98-e8e94bf2e6ce admin admin] PATH_INFO: `/v3/projects/bc314fbc91c54810b27f9fcad7129c64/users/9072bd35fdf046669c196133f485d334/roles/17e6533ce814487c9a8fb0ee2acaad32` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.718763 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221703e-cb47-474d-9c98-e8e94bf2e6ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc314fbc91c54810b27f9fcad7129c64, user_id=9072bd35fdf046669c196133f485d334, role_id=17e6533ce814487c9a8fb0ee2acaad32)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.719989 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 298/593] 10.222.0.36 () {56 vars in 1156 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:51.720976 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1a1d8-38ea-4a1d-a5e0-8bf1d44dafdb admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.721853 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221703e-cb47-474d-9c98-e8e94bf2e6ce admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.733566 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1a1d8-38ea-4a1d-a5e0-8bf1d44dafdb admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.741292 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 296/594] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Dec 15 15:58:51 2021] PUT /identity/v3/projects/bc314fbc91c54810b27f9fcad7129c64/users/9072bd35fdf046669c196133f485d334/roles/17e6533ce814487c9a8fb0ee2acaad32 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 15:58:51.742353 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221703e-cb47-474d-9c98-e8e94bf2e6ce admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.831747 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221703e-cb47-474d-9c98-e8e94bf2e6ce admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.834127 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee9fa3-1f51-45d5-9797-aa605127302f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.834827 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee9fa3-1f51-45d5-9797-aa605127302f admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.835154 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee9fa3-1f51-45d5-9797-aa605127302f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.835433 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee9fa3-1f51-45d5-9797-aa605127302f admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.836304 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee9fa3-1f51-45d5-9797-aa605127302f admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:51.836615 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee9fa3-1f51-45d5-9797-aa605127302f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.838548 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee9fa3-1f51-45d5-9797-aa605127302f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.849925 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069eb1e0-4d62-42ae-81d7-2d5c1d7d4f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.850510 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069eb1e0-4d62-42ae-81d7-2d5c1d7d4f5a admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.850791 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069eb1e0-4d62-42ae-81d7-2d5c1d7d4f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.851066 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069eb1e0-4d62-42ae-81d7-2d5c1d7d4f5a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.868156 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069eb1e0-4d62-42ae-81d7-2d5c1d7d4f5a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.870004 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069eb1e0-4d62-42ae-81d7-2d5c1d7d4f5a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.880544 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 299/595] 10.222.0.36 () {56 vars in 1160 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:51.881411 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 297/596] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:51.887787 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee9fa3-1f51-45d5-9797-aa605127302f admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.889150 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069eb1e0-4d62-42ae-81d7-2d5c1d7d4f5a admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.904446 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069eb1e0-4d62-42ae-81d7-2d5c1d7d4f5a admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.904935 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee9fa3-1f51-45d5-9797-aa605127302f admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.909265 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5e1c1-6548-4441-a9c9-cdddda211053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.909801 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c5695-bac3-4ad3-a48f-b9c57f668c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.910478 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5e1c1-6548-4441-a9c9-cdddda211053 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.911259 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5e1c1-6548-4441-a9c9-cdddda211053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.911402 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c5695-bac3-4ad3-a48f-b9c57f668c93 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.911560 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5e1c1-6548-4441-a9c9-cdddda211053 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.911652 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c5695-bac3-4ad3-a48f-b9c57f668c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.911903 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c5695-bac3-4ad3-a48f-b9c57f668c93 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.924950 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f5e1c1-6548-4441-a9c9-cdddda211053 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.927593 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f5e1c1-6548-4441-a9c9-cdddda211053 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.930939 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c5695-bac3-4ad3-a48f-b9c57f668c93 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.932833 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c5695-bac3-4ad3-a48f-b9c57f668c93 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.945651 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-b7f5e1c1-6548-4441-a9c9-cdddda211053 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:51.947065 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 298/597] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:51.955357 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5e1c1-6548-4441-a9c9-cdddda211053 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.962471 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-2b4c5695-bac3-4ad3-a48f-b9c57f668c93 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:51.963931 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 300/598] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:51.972581 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c5695-bac3-4ad3-a48f-b9c57f668c93 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:51.975745 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5e1c1-6548-4441-a9c9-cdddda211053 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.980215 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9be087-74fd-40d9-be2a-b6f2869a5c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.980867 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9be087-74fd-40d9-be2a-b6f2869a5c3d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.981150 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9be087-74fd-40d9-be2a-b6f2869a5c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.981472 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9be087-74fd-40d9-be2a-b6f2869a5c3d admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.982218 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9be087-74fd-40d9-be2a-b6f2869a5c3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:51.982519 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9be087-74fd-40d9-be2a-b6f2869a5c3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:51.984132 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9be087-74fd-40d9-be2a-b6f2869a5c3d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:51.987081 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c5695-bac3-4ad3-a48f-b9c57f668c93 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:51.997672 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e776ac-1634-4b46-8515-9fe91a278dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:51.998443 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e776ac-1634-4b46-8515-9fe91a278dcc admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:51.998630 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 299/599] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:51.998835 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e776ac-1634-4b46-8515-9fe91a278dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:51.999174 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e776ac-1634-4b46-8515-9fe91a278dcc admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:51.999983 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e776ac-1634-4b46-8515-9fe91a278dcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:52.000370 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e776ac-1634-4b46-8515-9fe91a278dcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:52.002223 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e776ac-1634-4b46-8515-9fe91a278dcc admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:52.005540 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9be087-74fd-40d9-be2a-b6f2869a5c3d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:52.014850 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 301/600] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:52.016029 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9be087-74fd-40d9-be2a-b6f2869a5c3d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:52.021324 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29f5ed-2c71-46b3-97ec-b2f43e4ea60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:52.021790 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e776ac-1634-4b46-8515-9fe91a278dcc admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:52.022638 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29f5ed-2c71-46b3-97ec-b2f43e4ea60a admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:52.023067 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29f5ed-2c71-46b3-97ec-b2f43e4ea60a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:52.023603 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29f5ed-2c71-46b3-97ec-b2f43e4ea60a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:52.031631 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29f5ed-2c71-46b3-97ec-b2f43e4ea60a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:52.033677 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29f5ed-2c71-46b3-97ec-b2f43e4ea60a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:52.036749 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e776ac-1634-4b46-8515-9fe91a278dcc admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:52.048324 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c634fc3-0ef4-4da8-b527-f54bf55b2130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:52.049344 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c634fc3-0ef4-4da8-b527-f54bf55b2130 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:52.049903 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c634fc3-0ef4-4da8-b527-f54bf55b2130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:52.050329 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c634fc3-0ef4-4da8-b527-f54bf55b2130 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:52.058539 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c634fc3-0ef4-4da8-b527-f54bf55b2130 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:52.059882 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-af29f5ed-2c71-46b3-97ec-b2f43e4ea60a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:58:52.060981 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c634fc3-0ef4-4da8-b527-f54bf55b2130 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:52.063957 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 300/601] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:52.070904 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29f5ed-2c71-46b3-97ec-b2f43e4ea60a admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:52.081195 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29f5ed-2c71-46b3-97ec-b2f43e4ea60a admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:52.085022 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-5c634fc3-0ef4-4da8-b527-f54bf55b2130 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:58:52.086520 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79ca09-ba2a-4249-a187-183b220a89e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:52.087216 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79ca09-ba2a-4249-a187-183b220a89e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:52.087588 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79ca09-ba2a-4249-a187-183b220a89e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:52.087766 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79ca09-ba2a-4249-a187-183b220a89e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:52.092662 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79ca09-ba2a-4249-a187-183b220a89e5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:52.092662 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79ca09-ba2a-4249-a187-183b220a89e5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:52.092662 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79ca09-ba2a-4249-a187-183b220a89e5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:52.093008 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 302/602] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:52.098402 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c634fc3-0ef4-4da8-b527-f54bf55b2130 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:52.109119 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c634fc3-0ef4-4da8-b527-f54bf55b2130 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:52.109430 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 301/603] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:58:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:52.113528 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79ca09-ba2a-4249-a187-183b220a89e5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:52.113767 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943e6b5-6659-4a8d-b3ca-ef7c809ffc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:52.114719 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943e6b5-6659-4a8d-b3ca-ef7c809ffc15 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:52.115072 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943e6b5-6659-4a8d-b3ca-ef7c809ffc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:52.115416 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943e6b5-6659-4a8d-b3ca-ef7c809ffc15 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:52.116435 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943e6b5-6659-4a8d-b3ca-ef7c809ffc15 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:52.116815 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943e6b5-6659-4a8d-b3ca-ef7c809ffc15 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:52.118848 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943e6b5-6659-4a8d-b3ca-ef7c809ffc15 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:52.124717 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79ca09-ba2a-4249-a187-183b220a89e5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:52.131012 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf1425-c631-443b-b35b-cb214d0a670a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:52.131854 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf1425-c631-443b-b35b-cb214d0a670a admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:52.132323 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf1425-c631-443b-b35b-cb214d0a670a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:52.132744 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf1425-c631-443b-b35b-cb214d0a670a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:52.137599 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 303/604] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:58:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:52.137707 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf1425-c631-443b-b35b-cb214d0a670a admin admin] RBAC: Adding query filter params (role.id=17e6533ce814487c9a8fb0ee2acaad32, scope.project.id=bc314fbc91c54810b27f9fcad7129c64, user.id=5e3f652f76424e27a1d4329212d9b66d) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:52.137707 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf1425-c631-443b-b35b-cb214d0a670a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:52.137707 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf1425-c631-443b-b35b-cb214d0a670a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:52.139759 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943e6b5-6659-4a8d-b3ca-ef7c809ffc15 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:52.144712 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 302/605] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:52 2021] GET /identity/v3/role_assignments?user.id=5e3f652f76424e27a1d4329212d9b66d&scope.project.id=bc314fbc91c54810b27f9fcad7129c64&role.id=17e6533ce814487c9a8fb0ee2acaad32 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:52.162413 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943e6b5-6659-4a8d-b3ca-ef7c809ffc15 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:52.172132 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ec25b-7da5-4bd0-b617-cd608b503d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:52.173263 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ec25b-7da5-4bd0-b617-cd608b503d24 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:52.173715 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ec25b-7da5-4bd0-b617-cd608b503d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:52.174152 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ec25b-7da5-4bd0-b617-cd608b503d24 admin admin] PATH_INFO: `/v3/projects/bc314fbc91c54810b27f9fcad7129c64/users/f2f08f47d4e6442a92901fb7d8bed0bf/roles/17e6533ce814487c9a8fb0ee2acaad32` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:52.200423 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ec25b-7da5-4bd0-b617-cd608b503d24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc314fbc91c54810b27f9fcad7129c64, user_id=f2f08f47d4e6442a92901fb7d8bed0bf, role_id=17e6533ce814487c9a8fb0ee2acaad32)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:52.203364 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ec25b-7da5-4bd0-b617-cd608b503d24 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:52.221865 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 304/606] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Dec 15 15:58:52 2021] PUT /identity/v3/projects/bc314fbc91c54810b27f9fcad7129c64/users/f2f08f47d4e6442a92901fb7d8bed0bf/roles/17e6533ce814487c9a8fb0ee2acaad32 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 15:58:53.835055 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762276fb-d940-4b11-904e-d1308894c744 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:53.835678 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762276fb-d940-4b11-904e-d1308894c744 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:53.835933 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762276fb-d940-4b11-904e-d1308894c744 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:53.838091 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 303/607] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:53.844150 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f7a8c-b719-47b9-a670-8042de5948f7 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:53.844576 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f7a8c-b719-47b9-a670-8042de5948f7 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:53.844885 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f7a8c-b719-47b9-a670-8042de5948f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:53.868178 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-4d8f7a8c-b719-47b9-a670-8042de5948f7 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:53.869552 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-4d8f7a8c-b719-47b9-a670-8042de5948f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:53.940833 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 305/608] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:53.979359 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762276fb-d940-4b11-904e-d1308894c744 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:53.993605 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762276fb-d940-4b11-904e-d1308894c744 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:54.005066 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c70ba0-93ef-4615-85f5-a525a674a8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:54.006108 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c70ba0-93ef-4615-85f5-a525a674a8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:54.006487 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c70ba0-93ef-4615-85f5-a525a674a8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:54.006858 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c70ba0-93ef-4615-85f5-a525a674a8e3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:54.026357 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c70ba0-93ef-4615-85f5-a525a674a8e3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:54.033303 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-e8c70ba0-93ef-4615-85f5-a525a674a8e3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 15:58:54.035090 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 304/609] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Dec 15 15:58:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:54.045406 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f7a8c-b719-47b9-a670-8042de5948f7 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:54.057419 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f7a8c-b719-47b9-a670-8042de5948f7 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:54.067686 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4c50a-8d8b-42fc-8db1-a1438caa4616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:54.068486 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4c50a-8d8b-42fc-8db1-a1438caa4616 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:54.068876 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4c50a-8d8b-42fc-8db1-a1438caa4616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:54.069256 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4c50a-8d8b-42fc-8db1-a1438caa4616 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:54.070163 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4c50a-8d8b-42fc-8db1-a1438caa4616 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:54.070584 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4c50a-8d8b-42fc-8db1-a1438caa4616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:54.072332 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4c50a-8d8b-42fc-8db1-a1438caa4616 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:54.090682 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 306/610] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Dec 15 15:58:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:54.096940 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c70ba0-93ef-4615-85f5-a525a674a8e3 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:54.115011 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c70ba0-93ef-4615-85f5-a525a674a8e3 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:54.123463 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081da133-b2d0-41e0-bcbf-dc10bac897c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:54.124256 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081da133-b2d0-41e0-bcbf-dc10bac897c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:54.124541 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081da133-b2d0-41e0-bcbf-dc10bac897c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:54.124814 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081da133-b2d0-41e0-bcbf-dc10bac897c5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:54.145378 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081da133-b2d0-41e0-bcbf-dc10bac897c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:54.147328 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081da133-b2d0-41e0-bcbf-dc10bac897c5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:54.175526 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-081da133-b2d0-41e0-bcbf-dc10bac897c5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:54.178031 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 305/611] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:54.183852 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4c50a-8d8b-42fc-8db1-a1438caa4616 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:54.196867 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4c50a-8d8b-42fc-8db1-a1438caa4616 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:54.204467 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefceca3-aa59-4528-be77-08e550519f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:54.205351 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefceca3-aa59-4528-be77-08e550519f53 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:54.205795 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefceca3-aa59-4528-be77-08e550519f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:54.206213 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefceca3-aa59-4528-be77-08e550519f53 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:54.207243 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefceca3-aa59-4528-be77-08e550519f53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:54.207841 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefceca3-aa59-4528-be77-08e550519f53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:54.209684 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefceca3-aa59-4528-be77-08e550519f53 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:54.235082 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 307/612] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:54.240995 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081da133-b2d0-41e0-bcbf-dc10bac897c5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:54.255442 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081da133-b2d0-41e0-bcbf-dc10bac897c5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:54.270929 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b4070-5b9f-4204-a5de-63e1d89df0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:54.271741 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b4070-5b9f-4204-a5de-63e1d89df0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:54.272028 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b4070-5b9f-4204-a5de-63e1d89df0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:54.272304 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b4070-5b9f-4204-a5de-63e1d89df0c0 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:54.287196 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b4070-5b9f-4204-a5de-63e1d89df0c0 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:54.289307 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b4070-5b9f-4204-a5de-63e1d89df0c0 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:54.313401 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-4a4b4070-5b9f-4204-a5de-63e1d89df0c0 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 15 15:58:54.314968 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 306/613] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:54 2021] GET /identity/v3/users/cinder => generated 84 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:54.321317 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefceca3-aa59-4528-be77-08e550519f53 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:54.334884 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefceca3-aa59-4528-be77-08e550519f53 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:54.342664 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109fe36-1178-415c-ae58-4d6ddce6da87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:54.343544 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109fe36-1178-415c-ae58-4d6ddce6da87 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:54.344005 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109fe36-1178-415c-ae58-4d6ddce6da87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:54.344423 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109fe36-1178-415c-ae58-4d6ddce6da87 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:54.345560 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109fe36-1178-415c-ae58-4d6ddce6da87 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:54.346014 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109fe36-1178-415c-ae58-4d6ddce6da87 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:54.348095 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109fe36-1178-415c-ae58-4d6ddce6da87 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:54.375169 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 308/614] 10.222.0.36 () {56 vars in 1158 bytes} [Wed Dec 15 15:58:54 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:54.382166 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b4070-5b9f-4204-a5de-63e1d89df0c0 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:54.394352 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b4070-5b9f-4204-a5de-63e1d89df0c0 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:54.405603 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b35ef4-0107-4ff9-9d44-de29b6d005da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:54.406251 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b35ef4-0107-4ff9-9d44-de29b6d005da admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:54.406539 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b35ef4-0107-4ff9-9d44-de29b6d005da admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:54.406821 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b35ef4-0107-4ff9-9d44-de29b6d005da admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:54.425036 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b35ef4-0107-4ff9-9d44-de29b6d005da admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:54.427845 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b35ef4-0107-4ff9-9d44-de29b6d005da admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:54.443940 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 307/615] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:54 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:54.449678 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109fe36-1178-415c-ae58-4d6ddce6da87 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:54.464331 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109fe36-1178-415c-ae58-4d6ddce6da87 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:54.472622 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c3253-a05e-47f7-b94d-7a071e497311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:54.473807 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c3253-a05e-47f7-b94d-7a071e497311 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:54.474238 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c3253-a05e-47f7-b94d-7a071e497311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:54.474741 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c3253-a05e-47f7-b94d-7a071e497311 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:54.492953 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c3253-a05e-47f7-b94d-7a071e497311 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:54.495178 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c3253-a05e-47f7-b94d-7a071e497311 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:54.499916 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f6ddf-8b6a-4940-adc2-8bf86e78ee4f None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:54.500436 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f6ddf-8b6a-4940-adc2-8bf86e78ee4f None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:54.500549 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f6ddf-8b6a-4940-adc2-8bf86e78ee4f None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:54.502538 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 308/616] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:54.508651 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f98b93-34ad-44e2-b753-c0fe5f446a31 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:54.509093 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f98b93-34ad-44e2-b753-c0fe5f446a31 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:54.509513 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f98b93-34ad-44e2-b753-c0fe5f446a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:54.517549 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-155c3253-a05e-47f7-b94d-7a071e497311 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:54.519053 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 309/617] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:54.524738 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c3253-a05e-47f7-b94d-7a071e497311 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:54.534897 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c3253-a05e-47f7-b94d-7a071e497311 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:54.539561 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dc954-bab6-42e6-a54f-c14d5c406d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:54.540239 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dc954-bab6-42e6-a54f-c14d5c406d6a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:54.540522 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dc954-bab6-42e6-a54f-c14d5c406d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:54.540799 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dc954-bab6-42e6-a54f-c14d5c406d6a admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:54.541061 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-e8f98b93-34ad-44e2-b753-c0fe5f446a31 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:54.541565 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3dc954-bab6-42e6-a54f-c14d5c406d6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:54.541876 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3dc954-bab6-42e6-a54f-c14d5c406d6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:54.542602 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-e8f98b93-34ad-44e2-b753-c0fe5f446a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:54.543468 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3dc954-bab6-42e6-a54f-c14d5c406d6a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:54.556686 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 310/618] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:54.557140 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 309/619] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:54.562452 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dc954-bab6-42e6-a54f-c14d5c406d6a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:54.573210 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dc954-bab6-42e6-a54f-c14d5c406d6a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:54.577780 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c5890-0124-4e81-9ca3-cf2db4fd6106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:54.578554 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c5890-0124-4e81-9ca3-cf2db4fd6106 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:54.578837 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c5890-0124-4e81-9ca3-cf2db4fd6106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:54.579115 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c5890-0124-4e81-9ca3-cf2db4fd6106 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:54.586908 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c5890-0124-4e81-9ca3-cf2db4fd6106 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:54.588861 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c5890-0124-4e81-9ca3-cf2db4fd6106 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:54.603372 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-d85c5890-0124-4e81-9ca3-cf2db4fd6106 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:58:54.604434 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f98b93-34ad-44e2-b753-c0fe5f446a31 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:54.604553 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 311/620] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:54.610169 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c5890-0124-4e81-9ca3-cf2db4fd6106 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:54.620177 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c5890-0124-4e81-9ca3-cf2db4fd6106 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:54.620689 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f98b93-34ad-44e2-b753-c0fe5f446a31 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:54.624955 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c0ee7-5d0b-4e5b-96ce-f1cdb55f12ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:54.625777 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c0ee7-5d0b-4e5b-96ce-f1cdb55f12ea admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:54.626189 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c0ee7-5d0b-4e5b-96ce-f1cdb55f12ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:54.626517 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c0ee7-5d0b-4e5b-96ce-f1cdb55f12ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:54.627533 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c0ee7-5d0b-4e5b-96ce-f1cdb55f12ea admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:54.627845 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c0ee7-5d0b-4e5b-96ce-f1cdb55f12ea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:54.629997 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c0ee7-5d0b-4e5b-96ce-f1cdb55f12ea admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:54.638074 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7b136-f88e-41e8-83fb-47fb1c3a81e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:54.639019 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7b136-f88e-41e8-83fb-47fb1c3a81e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:54.639406 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7b136-f88e-41e8-83fb-47fb1c3a81e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:54.639785 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7b136-f88e-41e8-83fb-47fb1c3a81e2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:54.643256 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 312/621] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:58:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:54.650920 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c0ee7-5d0b-4e5b-96ce-f1cdb55f12ea admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:54.662720 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c0ee7-5d0b-4e5b-96ce-f1cdb55f12ea admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:54.667813 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57a65b-cfe9-4807-b0a4-847ddc5ce583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:54.668511 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57a65b-cfe9-4807-b0a4-847ddc5ce583 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:54.668791 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57a65b-cfe9-4807-b0a4-847ddc5ce583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:54.669069 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7b136-f88e-41e8-83fb-47fb1c3a81e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:54.669210 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57a65b-cfe9-4807-b0a4-847ddc5ce583 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:54.669985 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57a65b-cfe9-4807-b0a4-847ddc5ce583 admin admin] RBAC: Adding query filter params (role.id=17e6533ce814487c9a8fb0ee2acaad32, scope.project.id=bc314fbc91c54810b27f9fcad7129c64, user.id=0d18ec9bcc0e481aa000833ec1c0988d) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:54.670350 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57a65b-cfe9-4807-b0a4-847ddc5ce583 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:54.672357 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57a65b-cfe9-4807-b0a4-847ddc5ce583 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:54.676962 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-fec7b136-f88e-41e8-83fb-47fb1c3a81e2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 15:58:54.679304 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 313/622] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:54 2021] GET /identity/v3/role_assignments?user.id=0d18ec9bcc0e481aa000833ec1c0988d&scope.project.id=bc314fbc91c54810b27f9fcad7129c64&role.id=17e6533ce814487c9a8fb0ee2acaad32 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:54.687301 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 310/623] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Dec 15 15:58:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:54.693619 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57a65b-cfe9-4807-b0a4-847ddc5ce583 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:54.705019 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57a65b-cfe9-4807-b0a4-847ddc5ce583 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:54.718449 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136410f-f775-4c04-bed3-0ed979ad86ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:54.719126 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136410f-f775-4c04-bed3-0ed979ad86ff admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:54.719462 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136410f-f775-4c04-bed3-0ed979ad86ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:54.719737 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136410f-f775-4c04-bed3-0ed979ad86ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:54.720506 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136410f-f775-4c04-bed3-0ed979ad86ff admin admin] RBAC: Adding query filter params (name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:54.720853 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136410f-f775-4c04-bed3-0ed979ad86ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:54.722581 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136410f-f775-4c04-bed3-0ed979ad86ff admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:54.740816 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 314/624] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Dec 15 15:58:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:54.746562 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7b136-f88e-41e8-83fb-47fb1c3a81e2 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:54.768224 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7b136-f88e-41e8-83fb-47fb1c3a81e2 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:54.783416 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bf441-224a-4a03-bbff-97ad13eb7d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:54.784430 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bf441-224a-4a03-bbff-97ad13eb7d24 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:54.785169 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bf441-224a-4a03-bbff-97ad13eb7d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:54.786324 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bf441-224a-4a03-bbff-97ad13eb7d24 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:54.812066 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bf441-224a-4a03-bbff-97ad13eb7d24 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:54.820757 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bf441-224a-4a03-bbff-97ad13eb7d24 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:54.846258 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040781f-6646-40ea-878d-1756df0780cd None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:54.846789 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040781f-6646-40ea-878d-1756df0780cd None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:54.846789 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040781f-6646-40ea-878d-1756df0780cd None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:54.849014 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 315/625] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:54.849470 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-0a7bf441-224a-4a03-bbff-97ad13eb7d24 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:54.851082 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 311/626] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:54.858469 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e138d-1681-4032-88ac-5a757fc3a1d8 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:54.858469 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e138d-1681-4032-88ac-5a757fc3a1d8 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:54.858469 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e138d-1681-4032-88ac-5a757fc3a1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:54.858961 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bf441-224a-4a03-bbff-97ad13eb7d24 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:54.871461 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bf441-224a-4a03-bbff-97ad13eb7d24 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:54.885381 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64ee0b-b077-4dbf-a024-0a8724634c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:54.888540 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64ee0b-b077-4dbf-a024-0a8724634c3d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:54.889083 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64ee0b-b077-4dbf-a024-0a8724634c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:54.889565 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64ee0b-b077-4dbf-a024-0a8724634c3d admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:54.890784 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64ee0b-b077-4dbf-a024-0a8724634c3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:54.893771 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64ee0b-b077-4dbf-a024-0a8724634c3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:54.897571 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-2d2e138d-1681-4032-88ac-5a757fc3a1d8 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:54.898181 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64ee0b-b077-4dbf-a024-0a8724634c3d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:54.903000 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-2d2e138d-1681-4032-88ac-5a757fc3a1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:54.920182 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 312/627] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:54.930560 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64ee0b-b077-4dbf-a024-0a8724634c3d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:54.933983 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 316/628] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:54.942576 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64ee0b-b077-4dbf-a024-0a8724634c3d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:54.953654 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d057b-7118-45ec-96ad-f06eb877edbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:54.954896 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d057b-7118-45ec-96ad-f06eb877edbc admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:54.955361 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d057b-7118-45ec-96ad-f06eb877edbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:54.955814 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d057b-7118-45ec-96ad-f06eb877edbc admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:54.965652 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d057b-7118-45ec-96ad-f06eb877edbc admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:54.968104 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d057b-7118-45ec-96ad-f06eb877edbc admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:54.983119 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-279d057b-7118-45ec-96ad-f06eb877edbc admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 15:58:54.984907 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 313/629] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Dec 15 15:58:54 2021] GET /identity/v3/users/nova => generated 82 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:54.990803 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e138d-1681-4032-88ac-5a757fc3a1d8 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:54.998331 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d057b-7118-45ec-96ad-f06eb877edbc admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.003237 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e138d-1681-4032-88ac-5a757fc3a1d8 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.010312 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d057b-7118-45ec-96ad-f06eb877edbc admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.010852 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b7a9d-4f51-472c-8874-7bdad7ad9101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.012021 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b7a9d-4f51-472c-8874-7bdad7ad9101 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.012581 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b7a9d-4f51-472c-8874-7bdad7ad9101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.013127 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b7a9d-4f51-472c-8874-7bdad7ad9101 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.015130 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b7a9d-4f51-472c-8874-7bdad7ad9101 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:55.015779 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b7a9d-4f51-472c-8874-7bdad7ad9101 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.016630 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca9e01-7ee2-43d3-8f2c-95e01a706ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.017536 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca9e01-7ee2-43d3-8f2c-95e01a706ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.017819 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca9e01-7ee2-43d3-8f2c-95e01a706ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.018093 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca9e01-7ee2-43d3-8f2c-95e01a706ec8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.019121 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b7a9d-4f51-472c-8874-7bdad7ad9101 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.035052 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca9e01-7ee2-43d3-8f2c-95e01a706ec8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:55.047373 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 317/630] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Dec 15 15:58:54 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:55.048501 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-93ca9e01-7ee2-43d3-8f2c-95e01a706ec8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 15:58:55.051329 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 314/631] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Dec 15 15:58:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:55.063303 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b7a9d-4f51-472c-8874-7bdad7ad9101 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.063604 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca9e01-7ee2-43d3-8f2c-95e01a706ec8 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.077333 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b7a9d-4f51-472c-8874-7bdad7ad9101 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.077708 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca9e01-7ee2-43d3-8f2c-95e01a706ec8 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.086138 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb2c26-aca2-4b42-8028-dd89c0ffb0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.086807 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb2c26-aca2-4b42-8028-dd89c0ffb0df admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.087093 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb2c26-aca2-4b42-8028-dd89c0ffb0df admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.087374 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb2c26-aca2-4b42-8028-dd89c0ffb0df admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.088137 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb2c26-aca2-4b42-8028-dd89c0ffb0df admin admin] RBAC: Adding query filter params (name=service) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:55.088448 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb2c26-aca2-4b42-8028-dd89c0ffb0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.090123 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb2c26-aca2-4b42-8028-dd89c0ffb0df admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.092102 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acacdb4-44c8-4dca-aeb2-2bb921d348ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.092745 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acacdb4-44c8-4dca-aeb2-2bb921d348ab admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.093028 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acacdb4-44c8-4dca-aeb2-2bb921d348ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.093303 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acacdb4-44c8-4dca-aeb2-2bb921d348ab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.103169 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acacdb4-44c8-4dca-aeb2-2bb921d348ab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.104928 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acacdb4-44c8-4dca-aeb2-2bb921d348ab admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.108902 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 315/632] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:55.115969 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb2c26-aca2-4b42-8028-dd89c0ffb0df admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.123065 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 318/633] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:55.124685 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acacdb4-44c8-4dca-aeb2-2bb921d348ab admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.129608 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb2c26-aca2-4b42-8028-dd89c0ffb0df admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.134102 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acacdb4-44c8-4dca-aeb2-2bb921d348ab admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.139648 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d657ed0-a2c0-45c3-8092-67eed6b62615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.140512 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d657ed0-a2c0-45c3-8092-67eed6b62615 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.140767 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d657ed0-a2c0-45c3-8092-67eed6b62615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.141047 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d657ed0-a2c0-45c3-8092-67eed6b62615 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.141163 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0fc95-daa4-4512-b46a-5f38b4df6c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.141907 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0fc95-daa4-4512-b46a-5f38b4df6c3c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.142190 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0fc95-daa4-4512-b46a-5f38b4df6c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.142461 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0fc95-daa4-4512-b46a-5f38b4df6c3c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.152948 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d657ed0-a2c0-45c3-8092-67eed6b62615 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.154369 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0fc95-daa4-4512-b46a-5f38b4df6c3c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.154818 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d657ed0-a2c0-45c3-8092-67eed6b62615 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.156686 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0fc95-daa4-4512-b46a-5f38b4df6c3c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.173218 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-9d657ed0-a2c0-45c3-8092-67eed6b62615 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:55.178735 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-a7e0fc95-daa4-4512-b46a-5f38b4df6c3c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:55.179623 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 319/634] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:55.180375 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 316/635] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:55.180879 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d657ed0-a2c0-45c3-8092-67eed6b62615 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.186068 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0fc95-daa4-4512-b46a-5f38b4df6c3c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.190967 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d657ed0-a2c0-45c3-8092-67eed6b62615 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.197469 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0fc95-daa4-4512-b46a-5f38b4df6c3c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.200941 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce94473-f0ce-407f-a377-6f014ce6aeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.201645 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce94473-f0ce-407f-a377-6f014ce6aeac admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.201930 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce94473-f0ce-407f-a377-6f014ce6aeac admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.202207 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce94473-f0ce-407f-a377-6f014ce6aeac admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.202957 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce94473-f0ce-407f-a377-6f014ce6aeac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:55.203263 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce94473-f0ce-407f-a377-6f014ce6aeac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.204854 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce94473-f0ce-407f-a377-6f014ce6aeac admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.215764 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f096850-bd3e-4885-abdd-f0f019159e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.216435 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f096850-bd3e-4885-abdd-f0f019159e19 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.216718 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f096850-bd3e-4885-abdd-f0f019159e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.216998 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f096850-bd3e-4885-abdd-f0f019159e19 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.217765 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f096850-bd3e-4885-abdd-f0f019159e19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:55.218077 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f096850-bd3e-4885-abdd-f0f019159e19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.219844 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f096850-bd3e-4885-abdd-f0f019159e19 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.232047 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 320/636] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:55.233473 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb31579-c2bb-4674-ae0d-d88cfd290577 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.233774 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb31579-c2bb-4674-ae0d-d88cfd290577 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.234060 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb31579-c2bb-4674-ae0d-d88cfd290577 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.234777 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 317/637] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:55.236235 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f096850-bd3e-4885-abdd-f0f019159e19 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.236373 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 321/638] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:55.242514 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb31579-c2bb-4674-ae0d-d88cfd290577 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.254848 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f096850-bd3e-4885-abdd-f0f019159e19 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.260266 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2528a73-dcaf-4e7b-9d0e-867177981204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.261194 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2528a73-dcaf-4e7b-9d0e-867177981204 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.261674 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2528a73-dcaf-4e7b-9d0e-867177981204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.262027 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb31579-c2bb-4674-ae0d-d88cfd290577 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.262141 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2528a73-dcaf-4e7b-9d0e-867177981204 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.267568 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c96bcb-e5e4-4863-b824-926cbe62061c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.268544 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c96bcb-e5e4-4863-b824-926cbe62061c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.268984 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c96bcb-e5e4-4863-b824-926cbe62061c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.270246 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c96bcb-e5e4-4863-b824-926cbe62061c admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.271018 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2528a73-dcaf-4e7b-9d0e-867177981204 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.273261 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2528a73-dcaf-4e7b-9d0e-867177981204 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.279650 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c96bcb-e5e4-4863-b824-926cbe62061c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.281690 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c96bcb-e5e4-4863-b824-926cbe62061c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.288324 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-b2528a73-dcaf-4e7b-9d0e-867177981204 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:58:55.289677 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 318/639] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:55.290849 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d80b09-bc01-4e6a-9021-05b389b070f3 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.291138 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d80b09-bc01-4e6a-9021-05b389b070f3 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.291417 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d80b09-bc01-4e6a-9021-05b389b070f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.301240 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-d8c96bcb-e5e4-4863-b824-926cbe62061c admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 15 15:58:55.302589 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 322/640] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/users/glance => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:55.305418 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60731282-5a49-400b-869e-0e5a4368468d None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.305418 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60731282-5a49-400b-869e-0e5a4368468d None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.305418 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60731282-5a49-400b-869e-0e5a4368468d None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.306146 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 323/641] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:55.306658 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60731282-5a49-400b-869e-0e5a4368468d None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.313151 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-b8d80b09-bc01-4e6a-9021-05b389b070f3 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:55.314408 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-b8d80b09-bc01-4e6a-9021-05b389b070f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:55.319496 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60731282-5a49-400b-869e-0e5a4368468d None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.329550 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 319/642] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:55.329550 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d80b09-bc01-4e6a-9021-05b389b070f3 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.331364 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b6a47-d7f4-486c-b1d2-6a1e11f20275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.332592 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b6a47-d7f4-486c-b1d2-6a1e11f20275 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.332969 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b6a47-d7f4-486c-b1d2-6a1e11f20275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.333221 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d80b09-bc01-4e6a-9021-05b389b070f3 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.333321 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b6a47-d7f4-486c-b1d2-6a1e11f20275 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.334230 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b6a47-d7f4-486c-b1d2-6a1e11f20275 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:55.334546 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b6a47-d7f4-486c-b1d2-6a1e11f20275 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.336472 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b6a47-d7f4-486c-b1d2-6a1e11f20275 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.338368 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2278c-3485-40e8-863b-53e054a72123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.339486 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2278c-3485-40e8-863b-53e054a72123 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.339779 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2278c-3485-40e8-863b-53e054a72123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.340056 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2278c-3485-40e8-863b-53e054a72123 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.340900 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2278c-3485-40e8-863b-53e054a72123 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:55.341209 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2278c-3485-40e8-863b-53e054a72123 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.343078 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2278c-3485-40e8-863b-53e054a72123 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.352965 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 324/643] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:55.354457 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ca495-4a32-4cad-93bb-17d764385afc None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.355636 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ca495-4a32-4cad-93bb-17d764385afc None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.355922 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ca495-4a32-4cad-93bb-17d764385afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.363723 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 320/644] 10.222.0.36 () {56 vars in 1158 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:55.364806 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2278c-3485-40e8-863b-53e054a72123 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.374070 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2278c-3485-40e8-863b-53e054a72123 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.376018 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-a35ca495-4a32-4cad-93bb-17d764385afc None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:55.377414 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-a35ca495-4a32-4cad-93bb-17d764385afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:55.378471 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e323511-e80a-43d6-af51-b5b6e6983940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.379602 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e323511-e80a-43d6-af51-b5b6e6983940 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.379923 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e323511-e80a-43d6-af51-b5b6e6983940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.380206 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e323511-e80a-43d6-af51-b5b6e6983940 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.387344 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 325/645] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:55.388646 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ca495-4a32-4cad-93bb-17d764385afc None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.390497 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e323511-e80a-43d6-af51-b5b6e6983940 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:55.398490 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-7e323511-e80a-43d6-af51-b5b6e6983940 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 15:58:55.399435 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ca495-4a32-4cad-93bb-17d764385afc None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.399941 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 321/646] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:55.400750 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e323511-e80a-43d6-af51-b5b6e6983940 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.405080 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1aa17-4ad0-4b3e-bbdb-9cc5bf99c64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.406998 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1aa17-4ad0-4b3e-bbdb-9cc5bf99c64e admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.407555 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1aa17-4ad0-4b3e-bbdb-9cc5bf99c64e admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.408310 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1aa17-4ad0-4b3e-bbdb-9cc5bf99c64e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.409468 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1aa17-4ad0-4b3e-bbdb-9cc5bf99c64e admin admin] RBAC: Adding query filter params (role.id=17e6533ce814487c9a8fb0ee2acaad32, scope.project.id=bc314fbc91c54810b27f9fcad7129c64, user.id=bc13934328e742f9a1a85d1c84ab83dd) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:55.410808 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1aa17-4ad0-4b3e-bbdb-9cc5bf99c64e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.411013 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e323511-e80a-43d6-af51-b5b6e6983940 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.413203 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1aa17-4ad0-4b3e-bbdb-9cc5bf99c64e admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.415912 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5f5f8-6508-45ae-8742-cad7afa45f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.416626 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5f5f8-6508-45ae-8742-cad7afa45f61 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.416912 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5f5f8-6508-45ae-8742-cad7afa45f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.417188 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5f5f8-6508-45ae-8742-cad7afa45f61 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.420550 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 326/647] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/role_assignments?user.id=bc13934328e742f9a1a85d1c84ab83dd&scope.project.id=bc314fbc91c54810b27f9fcad7129c64&role.id=17e6533ce814487c9a8fb0ee2acaad32 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:55.421607 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1aa17-4ad0-4b3e-bbdb-9cc5bf99c64e admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.427192 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5f5f8-6508-45ae-8742-cad7afa45f61 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.429114 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5f5f8-6508-45ae-8742-cad7afa45f61 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.437446 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1aa17-4ad0-4b3e-bbdb-9cc5bf99c64e admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.439601 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 322/648] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:55.440493 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5f5f8-6508-45ae-8742-cad7afa45f61 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.443390 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8e9b9-cf68-4262-b880-4eb563600321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.444289 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8e9b9-cf68-4262-b880-4eb563600321 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.444825 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8e9b9-cf68-4262-b880-4eb563600321 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.445532 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8e9b9-cf68-4262-b880-4eb563600321 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.446737 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8e9b9-cf68-4262-b880-4eb563600321 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:55.447897 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8e9b9-cf68-4262-b880-4eb563600321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.450085 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8e9b9-cf68-4262-b880-4eb563600321 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.451191 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5f5f8-6508-45ae-8742-cad7afa45f61 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.456206 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8717454-8820-45c6-8d69-a554cd3396da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.457769 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8717454-8820-45c6-8d69-a554cd3396da admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.458213 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8717454-8820-45c6-8d69-a554cd3396da admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.458692 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8717454-8820-45c6-8d69-a554cd3396da admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.462770 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 327/649] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:55.463941 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8e9b9-cf68-4262-b880-4eb563600321 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.473794 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8717454-8820-45c6-8d69-a554cd3396da admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:55.477759 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8e9b9-cf68-4262-b880-4eb563600321 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.481685 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-b8717454-8820-45c6-8d69-a554cd3396da admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 15:58:55.483030 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a8598-1ed6-400e-a9eb-4eb24908e097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.483167 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 323/650] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:55.484117 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a8598-1ed6-400e-a9eb-4eb24908e097 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.484590 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a8598-1ed6-400e-a9eb-4eb24908e097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.485003 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a8598-1ed6-400e-a9eb-4eb24908e097 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.489315 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8717454-8820-45c6-8d69-a554cd3396da admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.498354 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a8598-1ed6-400e-a9eb-4eb24908e097 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.499648 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8717454-8820-45c6-8d69-a554cd3396da admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.500774 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a8598-1ed6-400e-a9eb-4eb24908e097 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.504853 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14efb8-b2a1-419e-8de9-197d9932ebc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.505789 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14efb8-b2a1-419e-8de9-197d9932ebc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.506149 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14efb8-b2a1-419e-8de9-197d9932ebc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.506497 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14efb8-b2a1-419e-8de9-197d9932ebc8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.518532 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14efb8-b2a1-419e-8de9-197d9932ebc8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.521082 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14efb8-b2a1-419e-8de9-197d9932ebc8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.522087 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-114a8598-1ed6-400e-a9eb-4eb24908e097 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:55.523604 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 328/651] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:55.524531 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a8598-1ed6-400e-a9eb-4eb24908e097 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.534965 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a8598-1ed6-400e-a9eb-4eb24908e097 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.541036 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87354f8d-16e9-46ca-a05e-bfb19dd1295d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.541333 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-7c14efb8-b2a1-419e-8de9-197d9932ebc8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:55.542188 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87354f8d-16e9-46ca-a05e-bfb19dd1295d admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.542656 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87354f8d-16e9-46ca-a05e-bfb19dd1295d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.542865 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 324/652] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:55.543268 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87354f8d-16e9-46ca-a05e-bfb19dd1295d admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.543760 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14efb8-b2a1-419e-8de9-197d9932ebc8 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.544511 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87354f8d-16e9-46ca-a05e-bfb19dd1295d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:55.545061 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87354f8d-16e9-46ca-a05e-bfb19dd1295d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.546938 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87354f8d-16e9-46ca-a05e-bfb19dd1295d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.554115 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14efb8-b2a1-419e-8de9-197d9932ebc8 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.558156 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 329/653] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:55.559339 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87354f8d-16e9-46ca-a05e-bfb19dd1295d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.563719 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8b281-b748-4266-a9ee-d3359f4005ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.565104 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8b281-b748-4266-a9ee-d3359f4005ca admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.566137 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8b281-b748-4266-a9ee-d3359f4005ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.567854 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8b281-b748-4266-a9ee-d3359f4005ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.569673 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8b281-b748-4266-a9ee-d3359f4005ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:55.570134 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8b281-b748-4266-a9ee-d3359f4005ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.571984 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8b281-b748-4266-a9ee-d3359f4005ca admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.577208 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87354f8d-16e9-46ca-a05e-bfb19dd1295d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.582909 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea6970-3900-47df-81ba-15b46aff15fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.584240 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea6970-3900-47df-81ba-15b46aff15fb admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.584632 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea6970-3900-47df-81ba-15b46aff15fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.585034 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea6970-3900-47df-81ba-15b46aff15fb admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.586745 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea6970-3900-47df-81ba-15b46aff15fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:55.587165 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea6970-3900-47df-81ba-15b46aff15fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.588936 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea6970-3900-47df-81ba-15b46aff15fb admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.589106 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 325/654] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:55.590259 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8b281-b748-4266-a9ee-d3359f4005ca admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.601776 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8b281-b748-4266-a9ee-d3359f4005ca admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.608857 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 330/655] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:55.608857 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea6970-3900-47df-81ba-15b46aff15fb admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.612460 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41c5fa-cece-4100-99fe-c908edd9a207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.614450 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41c5fa-cece-4100-99fe-c908edd9a207 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.615067 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41c5fa-cece-4100-99fe-c908edd9a207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.615526 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41c5fa-cece-4100-99fe-c908edd9a207 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.617328 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea6970-3900-47df-81ba-15b46aff15fb admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.622735 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9956ee0-d52b-453e-ac99-05cf1e36099c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.623679 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9956ee0-d52b-453e-ac99-05cf1e36099c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.624086 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9956ee0-d52b-453e-ac99-05cf1e36099c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.624468 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9956ee0-d52b-453e-ac99-05cf1e36099c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.630164 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41c5fa-cece-4100-99fe-c908edd9a207 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.632061 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41c5fa-cece-4100-99fe-c908edd9a207 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.640670 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9956ee0-d52b-453e-ac99-05cf1e36099c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.642696 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9956ee0-d52b-453e-ac99-05cf1e36099c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.657702 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-ff41c5fa-cece-4100-99fe-c908edd9a207 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:55.659342 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-d9956ee0-d52b-453e-ac99-05cf1e36099c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:58:55.660101 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 326/656] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:55.661268 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 331/657] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:55.667341 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41c5fa-cece-4100-99fe-c908edd9a207 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.667545 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9956ee0-d52b-453e-ac99-05cf1e36099c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.678553 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9956ee0-d52b-453e-ac99-05cf1e36099c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.680213 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41c5fa-cece-4100-99fe-c908edd9a207 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.683638 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc5efe-2c0e-47f4-9112-918552a36ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.684520 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc5efe-2c0e-47f4-9112-918552a36ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.684960 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc5efe-2c0e-47f4-9112-918552a36ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.685325 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc5efe-2c0e-47f4-9112-918552a36ed5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.686183 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7300dd6-83f6-4c9f-a0a5-5534609afb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.686312 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc5efe-2c0e-47f4-9112-918552a36ed5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:55.686706 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc5efe-2c0e-47f4-9112-918552a36ed5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.687414 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7300dd6-83f6-4c9f-a0a5-5534609afb0a admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.687834 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7300dd6-83f6-4c9f-a0a5-5534609afb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.688303 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7300dd6-83f6-4c9f-a0a5-5534609afb0a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.688685 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc5efe-2c0e-47f4-9112-918552a36ed5 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.698080 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7300dd6-83f6-4c9f-a0a5-5534609afb0a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.700104 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7300dd6-83f6-4c9f-a0a5-5534609afb0a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.706654 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 332/658] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:55.708682 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc5efe-2c0e-47f4-9112-918552a36ed5 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.717344 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-e7300dd6-83f6-4c9f-a0a5-5534609afb0a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 15:58:55.718576 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 327/659] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/users/swift => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:55.719337 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7300dd6-83f6-4c9f-a0a5-5534609afb0a admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.720338 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc5efe-2c0e-47f4-9112-918552a36ed5 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.725670 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e34b07-1bcd-4345-9cc0-c08c66179be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.727150 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e34b07-1bcd-4345-9cc0-c08c66179be9 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.727901 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e34b07-1bcd-4345-9cc0-c08c66179be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.728374 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e34b07-1bcd-4345-9cc0-c08c66179be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.729362 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e34b07-1bcd-4345-9cc0-c08c66179be9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:55.729872 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7300dd6-83f6-4c9f-a0a5-5534609afb0a admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.730077 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e34b07-1bcd-4345-9cc0-c08c66179be9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.732318 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e34b07-1bcd-4345-9cc0-c08c66179be9 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.734358 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b74e2-f868-418f-8d0d-463bf322b217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.735140 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b74e2-f868-418f-8d0d-463bf322b217 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.735392 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b74e2-f868-418f-8d0d-463bf322b217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.735667 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b74e2-f868-418f-8d0d-463bf322b217 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.744325 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b74e2-f868-418f-8d0d-463bf322b217 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.746409 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b74e2-f868-418f-8d0d-463bf322b217 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.747312 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 333/660] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:55.748040 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e34b07-1bcd-4345-9cc0-c08c66179be9 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.758351 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e34b07-1bcd-4345-9cc0-c08c66179be9 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.763168 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-cd1b74e2-f868-418f-8d0d-463bf322b217 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 15 15:58:55.763821 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51824f-9c33-4a14-8690-417742724e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.764359 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 328/661] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/users/neutron => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:55.764994 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51824f-9c33-4a14-8690-417742724e47 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.765108 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b74e2-f868-418f-8d0d-463bf322b217 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.765574 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51824f-9c33-4a14-8690-417742724e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.765965 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51824f-9c33-4a14-8690-417742724e47 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.766900 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51824f-9c33-4a14-8690-417742724e47 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:55.767363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51824f-9c33-4a14-8690-417742724e47 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.769307 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51824f-9c33-4a14-8690-417742724e47 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.779524 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b74e2-f868-418f-8d0d-463bf322b217 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.785750 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54130e94-c2a3-4b28-beb5-9010afa3b97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.786678 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54130e94-c2a3-4b28-beb5-9010afa3b97d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.787069 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54130e94-c2a3-4b28-beb5-9010afa3b97d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.787432 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54130e94-c2a3-4b28-beb5-9010afa3b97d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.788376 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54130e94-c2a3-4b28-beb5-9010afa3b97d admin admin] RBAC: Adding query filter params (role.id=17e6533ce814487c9a8fb0ee2acaad32, scope.project.id=bc314fbc91c54810b27f9fcad7129c64, user.id=9072bd35fdf046669c196133f485d334) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:55.788797 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54130e94-c2a3-4b28-beb5-9010afa3b97d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.790802 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54130e94-c2a3-4b28-beb5-9010afa3b97d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.792676 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 334/662] 10.222.0.36 () {56 vars in 1156 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:55.793299 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51824f-9c33-4a14-8690-417742724e47 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.797554 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 329/663] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/role_assignments?user.id=9072bd35fdf046669c196133f485d334&scope.project.id=bc314fbc91c54810b27f9fcad7129c64&role.id=17e6533ce814487c9a8fb0ee2acaad32 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:55.802040 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54130e94-c2a3-4b28-beb5-9010afa3b97d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.804175 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51824f-9c33-4a14-8690-417742724e47 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.809439 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420298b-5d19-4a1b-8cf6-1f6329c5be05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.810379 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420298b-5d19-4a1b-8cf6-1f6329c5be05 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.810823 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420298b-5d19-4a1b-8cf6-1f6329c5be05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.811105 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420298b-5d19-4a1b-8cf6-1f6329c5be05 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.811990 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420298b-5d19-4a1b-8cf6-1f6329c5be05 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:55.812306 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420298b-5d19-4a1b-8cf6-1f6329c5be05 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.814334 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420298b-5d19-4a1b-8cf6-1f6329c5be05 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.815271 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54130e94-c2a3-4b28-beb5-9010afa3b97d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.821276 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6499ed-133a-4fef-91e9-10d399e67951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.822144 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6499ed-133a-4fef-91e9-10d399e67951 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.822532 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6499ed-133a-4fef-91e9-10d399e67951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.822811 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6499ed-133a-4fef-91e9-10d399e67951 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.838312 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 335/664] 10.222.0.36 () {56 vars in 1160 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:55.839024 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6499ed-133a-4fef-91e9-10d399e67951 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.840923 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6499ed-133a-4fef-91e9-10d399e67951 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.845468 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420298b-5d19-4a1b-8cf6-1f6329c5be05 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.856799 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420298b-5d19-4a1b-8cf6-1f6329c5be05 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.860636 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-2b6499ed-133a-4fef-91e9-10d399e67951 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:55.861894 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135a92b-48ab-4fe9-a3c4-63cb6565e0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.862208 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 330/665] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:55.868370 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135a92b-48ab-4fe9-a3c4-63cb6565e0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.868700 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135a92b-48ab-4fe9-a3c4-63cb6565e0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.869056 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135a92b-48ab-4fe9-a3c4-63cb6565e0b6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.872466 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6499ed-133a-4fef-91e9-10d399e67951 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.880090 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135a92b-48ab-4fe9-a3c4-63cb6565e0b6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.881923 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135a92b-48ab-4fe9-a3c4-63cb6565e0b6 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.884130 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6499ed-133a-4fef-91e9-10d399e67951 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.889873 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b39ba0-17ea-41c3-9ebf-51aafbb714c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.890852 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b39ba0-17ea-41c3-9ebf-51aafbb714c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.891339 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b39ba0-17ea-41c3-9ebf-51aafbb714c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.891790 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b39ba0-17ea-41c3-9ebf-51aafbb714c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.892724 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b39ba0-17ea-41c3-9ebf-51aafbb714c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:55.893214 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b39ba0-17ea-41c3-9ebf-51aafbb714c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.895045 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 336/666] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 15:58:55.896046 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b39ba0-17ea-41c3-9ebf-51aafbb714c8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.900600 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135a92b-48ab-4fe9-a3c4-63cb6565e0b6 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.910689 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 331/667] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:55.913627 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135a92b-48ab-4fe9-a3c4-63cb6565e0b6 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.917091 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b39ba0-17ea-41c3-9ebf-51aafbb714c8 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.923666 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fbd58-e81e-4af3-8767-2032bd94314e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.924467 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fbd58-e81e-4af3-8767-2032bd94314e admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.924804 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fbd58-e81e-4af3-8767-2032bd94314e admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.925084 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fbd58-e81e-4af3-8767-2032bd94314e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.930583 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b39ba0-17ea-41c3-9ebf-51aafbb714c8 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.935985 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323d155-d10f-4274-8633-414a730d3200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:55.937092 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323d155-d10f-4274-8633-414a730d3200 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:55.937650 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323d155-d10f-4274-8633-414a730d3200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:55.938149 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323d155-d10f-4274-8633-414a730d3200 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:55.943078 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2fbd58-e81e-4af3-8767-2032bd94314e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.948029 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2fbd58-e81e-4af3-8767-2032bd94314e admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.948455 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323d155-d10f-4274-8633-414a730d3200 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:55.950711 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323d155-d10f-4274-8633-414a730d3200 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:55.966665 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-7323d155-d10f-4274-8633-414a730d3200 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:58:55.968054 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-0a2fbd58-e81e-4af3-8767-2032bd94314e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:55.968956 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 332/668] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:55.969878 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 337/669] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:55.980699 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323d155-d10f-4274-8633-414a730d3200 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.981909 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fbd58-e81e-4af3-8767-2032bd94314e admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:55.993053 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323d155-d10f-4274-8633-414a730d3200 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.994987 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fbd58-e81e-4af3-8767-2032bd94314e admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:55.998985 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94623d8d-8279-4416-a998-a9bfdbad3628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:56.000329 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94623d8d-8279-4416-a998-a9bfdbad3628 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:56.000985 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94623d8d-8279-4416-a998-a9bfdbad3628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:56.001633 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94623d8d-8279-4416-a998-a9bfdbad3628 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:56.002838 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94623d8d-8279-4416-a998-a9bfdbad3628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:56.003330 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94623d8d-8279-4416-a998-a9bfdbad3628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:56.006222 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94623d8d-8279-4416-a998-a9bfdbad3628 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:56.007602 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf704185-c5a5-4fc1-8586-3f1de2e495cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:56.008507 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf704185-c5a5-4fc1-8586-3f1de2e495cb admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:56.008787 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf704185-c5a5-4fc1-8586-3f1de2e495cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:56.009162 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf704185-c5a5-4fc1-8586-3f1de2e495cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:56.010415 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf704185-c5a5-4fc1-8586-3f1de2e495cb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:56.010415 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf704185-c5a5-4fc1-8586-3f1de2e495cb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:56.018342 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf704185-c5a5-4fc1-8586-3f1de2e495cb admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:56.026048 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 333/670] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:56.029129 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94623d8d-8279-4416-a998-a9bfdbad3628 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:56.032894 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 338/671] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:58:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:56.041238 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94623d8d-8279-4416-a998-a9bfdbad3628 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:56.051203 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf704185-c5a5-4fc1-8586-3f1de2e495cb admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:56.053153 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d9885-d491-4dad-add6-d0c1a96f2643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:56.056414 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d9885-d491-4dad-add6-d0c1a96f2643 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:56.056860 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d9885-d491-4dad-add6-d0c1a96f2643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:56.057287 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d9885-d491-4dad-add6-d0c1a96f2643 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:56.065589 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d9885-d491-4dad-add6-d0c1a96f2643 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:56.068115 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d9885-d491-4dad-add6-d0c1a96f2643 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:56.068435 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf704185-c5a5-4fc1-8586-3f1de2e495cb admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:56.078134 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec0664-b3ac-49ad-8b88-5a977c24edd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:56.079262 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec0664-b3ac-49ad-8b88-5a977c24edd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:56.079720 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec0664-b3ac-49ad-8b88-5a977c24edd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:56.080143 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec0664-b3ac-49ad-8b88-5a977c24edd7 admin admin] PATH_INFO: `/v3/projects/bc314fbc91c54810b27f9fcad7129c64/users/5e3f652f76424e27a1d4329212d9b66d/roles/17e6533ce814487c9a8fb0ee2acaad32` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:56.084099 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-f97d9885-d491-4dad-add6-d0c1a96f2643 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:58:56.092172 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 334/672] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:56.092172 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d9885-d491-4dad-add6-d0c1a96f2643 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:56.103569 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d9885-d491-4dad-add6-d0c1a96f2643 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:56.106256 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec0664-b3ac-49ad-8b88-5a977c24edd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc314fbc91c54810b27f9fcad7129c64, user_id=5e3f652f76424e27a1d4329212d9b66d, role_id=17e6533ce814487c9a8fb0ee2acaad32)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:56.109491 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec0664-b3ac-49ad-8b88-5a977c24edd7 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:56.110893 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce36f1-b4a5-4298-9236-accdbd580bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:56.111550 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce36f1-b4a5-4298-9236-accdbd580bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:56.111833 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce36f1-b4a5-4298-9236-accdbd580bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:56.112111 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce36f1-b4a5-4298-9236-accdbd580bf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:56.112912 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce36f1-b4a5-4298-9236-accdbd580bf3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:56.113266 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce36f1-b4a5-4298-9236-accdbd580bf3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:56.115260 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce36f1-b4a5-4298-9236-accdbd580bf3 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:56.133566 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 335/673] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:58:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:56.138124 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 339/674] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Dec 15 15:58:56 2021] PUT /identity/v3/projects/bc314fbc91c54810b27f9fcad7129c64/users/5e3f652f76424e27a1d4329212d9b66d/roles/17e6533ce814487c9a8fb0ee2acaad32 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 15:58:56.148752 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce36f1-b4a5-4298-9236-accdbd580bf3 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:56.160656 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce36f1-b4a5-4298-9236-accdbd580bf3 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:56.226348 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a412c-8477-41e5-8c74-5dfd2db4ffd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:56.227395 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a412c-8477-41e5-8c74-5dfd2db4ffd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:56.227825 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a412c-8477-41e5-8c74-5dfd2db4ffd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:56.228285 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a412c-8477-41e5-8c74-5dfd2db4ffd9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:56.229320 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a412c-8477-41e5-8c74-5dfd2db4ffd9 admin admin] RBAC: Adding query filter params (role.id=17e6533ce814487c9a8fb0ee2acaad32, scope.project.id=bc314fbc91c54810b27f9fcad7129c64, user.id=f2f08f47d4e6442a92901fb7d8bed0bf) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:56.229834 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a412c-8477-41e5-8c74-5dfd2db4ffd9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:56.232033 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a412c-8477-41e5-8c74-5dfd2db4ffd9 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:56.240085 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 336/675] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:56 2021] GET /identity/v3/role_assignments?user.id=f2f08f47d4e6442a92901fb7d8bed0bf&scope.project.id=bc314fbc91c54810b27f9fcad7129c64&role.id=17e6533ce814487c9a8fb0ee2acaad32 => generated 608 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:57.610155 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f539d6d-71e7-4650-b946-ed63a98f5ccf None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:57.611196 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f539d6d-71e7-4650-b946-ed63a98f5ccf None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:57.611689 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f539d6d-71e7-4650-b946-ed63a98f5ccf None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:57.614762 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 340/676] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:57 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:57.620316 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485ae19-a88b-4204-ade6-1df6d06d1707 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:57.621128 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485ae19-a88b-4204-ade6-1df6d06d1707 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:57.621632 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485ae19-a88b-4204-ade6-1df6d06d1707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:57.645625 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-d485ae19-a88b-4204-ade6-1df6d06d1707 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:57.647148 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-d485ae19-a88b-4204-ade6-1df6d06d1707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:57.660276 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 337/677] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:57.695948 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f539d6d-71e7-4650-b946-ed63a98f5ccf None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:57.716677 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f539d6d-71e7-4650-b946-ed63a98f5ccf None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:57.724727 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b992f26-803c-4e6c-b98d-b0e3e513262c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:57.725551 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b992f26-803c-4e6c-b98d-b0e3e513262c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:57.725836 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b992f26-803c-4e6c-b98d-b0e3e513262c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:57.726111 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b992f26-803c-4e6c-b98d-b0e3e513262c admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:57.726784 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b992f26-803c-4e6c-b98d-b0e3e513262c admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:57.727790 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING py.warnings [None req-9b992f26-803c-4e6c-b98d-b0e3e513262c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:58:57.727790 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: warnings.warn(msg) Dec 15 15:58:57.727790 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: Dec 15 15:58:57.728664 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b992f26-803c-4e6c-b98d-b0e3e513262c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:57.746766 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-9b992f26-803c-4e6c-b98d-b0e3e513262c admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 15 15:58:57.748121 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 341/678] 10.222.0.36 () {56 vars in 1150 bytes} [Wed Dec 15 15:58:57 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:57.755192 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485ae19-a88b-4204-ade6-1df6d06d1707 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:57.772368 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485ae19-a88b-4204-ade6-1df6d06d1707 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:57.781614 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780d21d-86f1-45cf-86c7-16d1e930d2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:57.782277 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780d21d-86f1-45cf-86c7-16d1e930d2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:57.782554 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780d21d-86f1-45cf-86c7-16d1e930d2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:57.782826 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780d21d-86f1-45cf-86c7-16d1e930d2f3 admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:57.783544 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780d21d-86f1-45cf-86c7-16d1e930d2f3 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:57.783844 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780d21d-86f1-45cf-86c7-16d1e930d2f3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:57.785789 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING py.warnings [None req-3780d21d-86f1-45cf-86c7-16d1e930d2f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:58:57.785789 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: warnings.warn(msg) Dec 15 15:58:57.785789 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: Dec 15 15:58:57.786673 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780d21d-86f1-45cf-86c7-16d1e930d2f3 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:57.797603 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 338/679] 10.222.0.36 () {56 vars in 1145 bytes} [Wed Dec 15 15:58:57 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:57.804022 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b992f26-803c-4e6c-b98d-b0e3e513262c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:57.818782 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b992f26-803c-4e6c-b98d-b0e3e513262c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:57.829655 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99760818-b2c8-4806-a801-0552d030cd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:57.830321 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99760818-b2c8-4806-a801-0552d030cd4e admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:57.830604 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99760818-b2c8-4806-a801-0552d030cd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:57.830879 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99760818-b2c8-4806-a801-0552d030cd4e admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:57.831641 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99760818-b2c8-4806-a801-0552d030cd4e admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:57.831960 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99760818-b2c8-4806-a801-0552d030cd4e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:57.833155 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING py.warnings [None req-99760818-b2c8-4806-a801-0552d030cd4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:58:57.833155 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: warnings.warn(msg) Dec 15 15:58:57.833155 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: Dec 15 15:58:57.834091 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99760818-b2c8-4806-a801-0552d030cd4e admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:57.846530 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 342/680] 10.222.0.36 () {56 vars in 1145 bytes} [Wed Dec 15 15:58:57 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:58.623649 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49be54-49b5-4c70-b37c-806850bb7626 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:58.624182 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49be54-49b5-4c70-b37c-806850bb7626 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:58.624182 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49be54-49b5-4c70-b37c-806850bb7626 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:58.626355 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 339/681] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:58.633036 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c86f90-b575-4cf5-bb46-bbb09529a4aa None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:58.633568 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c86f90-b575-4cf5-bb46-bbb09529a4aa None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:58.633642 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c86f90-b575-4cf5-bb46-bbb09529a4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:58.658465 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-13c86f90-b575-4cf5-bb46-bbb09529a4aa None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:58.660497 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-13c86f90-b575-4cf5-bb46-bbb09529a4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:58.668810 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 343/682] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:58.718305 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49be54-49b5-4c70-b37c-806850bb7626 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:58.731415 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49be54-49b5-4c70-b37c-806850bb7626 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:58.742226 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde8777-8624-4ec3-9e3b-9af6b3e626d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:58.743017 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde8777-8624-4ec3-9e3b-9af6b3e626d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:58.743300 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde8777-8624-4ec3-9e3b-9af6b3e626d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:58.743575 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde8777-8624-4ec3-9e3b-9af6b3e626d3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:58.759842 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde8777-8624-4ec3-9e3b-9af6b3e626d3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:58.766681 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-cdde8777-8624-4ec3-9e3b-9af6b3e626d3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 15:58:58.768175 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 340/683] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:58:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:58.774610 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c86f90-b575-4cf5-bb46-bbb09529a4aa None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:58.783496 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c86f90-b575-4cf5-bb46-bbb09529a4aa None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:58.788918 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6edb52e-44e5-46f4-9410-b09258260385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:58.789596 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edb52e-44e5-46f4-9410-b09258260385 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:58.789875 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edb52e-44e5-46f4-9410-b09258260385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:58.790153 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edb52e-44e5-46f4-9410-b09258260385 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:58.790916 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6edb52e-44e5-46f4-9410-b09258260385 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:58.791226 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6edb52e-44e5-46f4-9410-b09258260385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:58.792811 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6edb52e-44e5-46f4-9410-b09258260385 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:58.802095 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 344/684] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:58:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:58.810519 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde8777-8624-4ec3-9e3b-9af6b3e626d3 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:58.826372 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde8777-8624-4ec3-9e3b-9af6b3e626d3 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:58.831071 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfc651-1c2a-4bf3-afc1-6cf62a481677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:58.831960 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfc651-1c2a-4bf3-afc1-6cf62a481677 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:58.832249 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfc651-1c2a-4bf3-afc1-6cf62a481677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:58.832525 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfc651-1c2a-4bf3-afc1-6cf62a481677 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:58.848659 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdfc651-1c2a-4bf3-afc1-6cf62a481677 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:58.850554 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdfc651-1c2a-4bf3-afc1-6cf62a481677 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:58.871597 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-2cdfc651-1c2a-4bf3-afc1-6cf62a481677 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:58.873128 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 341/685] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:58.879308 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6edb52e-44e5-46f4-9410-b09258260385 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:58.889066 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6edb52e-44e5-46f4-9410-b09258260385 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:58.898239 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d52450-cad1-4427-bf61-f187dc26448a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:58.898899 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d52450-cad1-4427-bf61-f187dc26448a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:58.899187 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d52450-cad1-4427-bf61-f187dc26448a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:58.899466 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d52450-cad1-4427-bf61-f187dc26448a admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:58.900232 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d52450-cad1-4427-bf61-f187dc26448a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:58.900518 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d52450-cad1-4427-bf61-f187dc26448a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:58.902163 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d52450-cad1-4427-bf61-f187dc26448a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:58.917573 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 345/686] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:58.923619 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfc651-1c2a-4bf3-afc1-6cf62a481677 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:58.938547 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfc651-1c2a-4bf3-afc1-6cf62a481677 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:58.945825 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a388abc-cde3-4d62-bb5d-905ec391f1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:58.946604 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a388abc-cde3-4d62-bb5d-905ec391f1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:58.946884 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a388abc-cde3-4d62-bb5d-905ec391f1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:58.947152 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a388abc-cde3-4d62-bb5d-905ec391f1e2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:58.961760 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a388abc-cde3-4d62-bb5d-905ec391f1e2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:58.963769 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a388abc-cde3-4d62-bb5d-905ec391f1e2 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:58.982903 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-1a388abc-cde3-4d62-bb5d-905ec391f1e2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 15:58:58.984175 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 342/687] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Dec 15 15:58:58 2021] GET /identity/v3/users/nova => generated 82 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:58.991421 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d52450-cad1-4427-bf61-f187dc26448a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:59.010152 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d52450-cad1-4427-bf61-f187dc26448a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:59.012952 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c26824-e8b5-48bc-ba16-8ff395e12832 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.013254 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c26824-e8b5-48bc-ba16-8ff395e12832 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.013638 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c26824-e8b5-48bc-ba16-8ff395e12832 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.015864 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 343/688] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:59.016672 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467d8e9-2a69-4ee0-90bb-697864e65c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:59.017379 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467d8e9-2a69-4ee0-90bb-697864e65c6f admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.017685 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467d8e9-2a69-4ee0-90bb-697864e65c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.017960 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467d8e9-2a69-4ee0-90bb-697864e65c6f admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.018815 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467d8e9-2a69-4ee0-90bb-697864e65c6f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:59.019176 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467d8e9-2a69-4ee0-90bb-697864e65c6f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:59.021057 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467d8e9-2a69-4ee0-90bb-697864e65c6f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:59.023275 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c579e-32f7-4092-8db3-cd1f93062ed1 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.023799 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c579e-32f7-4092-8db3-cd1f93062ed1 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.024321 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c579e-32f7-4092-8db3-cd1f93062ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.061421 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-571c579e-32f7-4092-8db3-cd1f93062ed1 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:59.061421 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-571c579e-32f7-4092-8db3-cd1f93062ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:59.062425 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 346/689] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Dec 15 15:58:58 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:59.069366 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467d8e9-2a69-4ee0-90bb-697864e65c6f admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:59.080642 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467d8e9-2a69-4ee0-90bb-697864e65c6f admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:59.082414 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 344/690] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:58:59.087262 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66447f-19ae-4acc-998a-7ea607654bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:59.088004 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66447f-19ae-4acc-998a-7ea607654bcb admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.088287 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66447f-19ae-4acc-998a-7ea607654bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.088558 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66447f-19ae-4acc-998a-7ea607654bcb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.097288 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66447f-19ae-4acc-998a-7ea607654bcb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:59.099259 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66447f-19ae-4acc-998a-7ea607654bcb admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:59.109956 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 347/691] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:59 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:59.116688 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c579e-32f7-4092-8db3-cd1f93062ed1 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:59.123466 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66447f-19ae-4acc-998a-7ea607654bcb admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:59.128965 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c579e-32f7-4092-8db3-cd1f93062ed1 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:59.137793 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457eb4b-d9de-4934-88a5-cb5238061756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:59.138577 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457eb4b-d9de-4934-88a5-cb5238061756 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.138855 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457eb4b-d9de-4934-88a5-cb5238061756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.139125 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457eb4b-d9de-4934-88a5-cb5238061756 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.143606 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66447f-19ae-4acc-998a-7ea607654bcb admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:59.155223 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f69d3-ab01-4763-a33c-579a935a8546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:59.156024 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f69d3-ab01-4763-a33c-579a935a8546 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.156305 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f69d3-ab01-4763-a33c-579a935a8546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.156585 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f69d3-ab01-4763-a33c-579a935a8546 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.157022 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457eb4b-d9de-4934-88a5-cb5238061756 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:59.159493 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457eb4b-d9de-4934-88a5-cb5238061756 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:59.168069 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f69d3-ab01-4763-a33c-579a935a8546 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:59.170229 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f69d3-ab01-4763-a33c-579a935a8546 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:59.180580 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-c457eb4b-d9de-4934-88a5-cb5238061756 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:59.182271 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 345/692] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:59.188060 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dca83-cb29-4a50-8921-23d83b92220d None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.188060 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dca83-cb29-4a50-8921-23d83b92220d None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.188060 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dca83-cb29-4a50-8921-23d83b92220d None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.190561 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 346/693] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:58:59.192323 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205dca83-cb29-4a50-8921-23d83b92220d None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:59.195145 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-0c0f69d3-ab01-4763-a33c-579a935a8546 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:59.196938 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 348/694] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:59.198410 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3124f-df3b-4cce-8a84-5202fa302ca4 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.198911 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3124f-df3b-4cce-8a84-5202fa302ca4 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.199383 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3124f-df3b-4cce-8a84-5202fa302ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.205634 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205dca83-cb29-4a50-8921-23d83b92220d None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:59.211372 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4146be4-d1e2-4f47-bce2-584a9eb7c8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:59.212073 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4146be4-d1e2-4f47-bce2-584a9eb7c8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.212354 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4146be4-d1e2-4f47-bce2-584a9eb7c8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.212627 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4146be4-d1e2-4f47-bce2-584a9eb7c8f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.213449 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4146be4-d1e2-4f47-bce2-584a9eb7c8f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:59.213849 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4146be4-d1e2-4f47-bce2-584a9eb7c8f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:59.215617 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4146be4-d1e2-4f47-bce2-584a9eb7c8f2 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:59.219487 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-25b3124f-df3b-4cce-8a84-5202fa302ca4 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:59.220902 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-25b3124f-df3b-4cce-8a84-5202fa302ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:59.228772 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 347/695] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:59.229083 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 349/696] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:58:59.234734 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4146be4-d1e2-4f47-bce2-584a9eb7c8f2 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:59.235261 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3124f-df3b-4cce-8a84-5202fa302ca4 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:59.246234 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3124f-df3b-4cce-8a84-5202fa302ca4 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:59.250680 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4146be4-d1e2-4f47-bce2-584a9eb7c8f2 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:59.256714 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae9ac2-ef3e-43aa-b373-56fa897016ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:59.258763 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae9ac2-ef3e-43aa-b373-56fa897016ea admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.259608 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae9ac2-ef3e-43aa-b373-56fa897016ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.260565 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae9ac2-ef3e-43aa-b373-56fa897016ea admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.261312 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46332988-f8a4-43fb-a5e6-f64dbc23dff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:59.262978 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46332988-f8a4-43fb-a5e6-f64dbc23dff0 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.263259 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46332988-f8a4-43fb-a5e6-f64dbc23dff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.263532 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46332988-f8a4-43fb-a5e6-f64dbc23dff0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.265594 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46332988-f8a4-43fb-a5e6-f64dbc23dff0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:59.265908 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46332988-f8a4-43fb-a5e6-f64dbc23dff0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:59.267526 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46332988-f8a4-43fb-a5e6-f64dbc23dff0 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:59.272663 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae9ac2-ef3e-43aa-b373-56fa897016ea admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:59.276461 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae9ac2-ef3e-43aa-b373-56fa897016ea admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:59.280652 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 348/697] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:59.281267 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46332988-f8a4-43fb-a5e6-f64dbc23dff0 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:59.291123 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46332988-f8a4-43fb-a5e6-f64dbc23dff0 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:59.292585 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-c8ae9ac2-ef3e-43aa-b373-56fa897016ea admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:58:59.294608 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 350/698] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:59.295720 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae9ac2-ef3e-43aa-b373-56fa897016ea admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:59.298046 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220695f1-8abb-4659-9189-a29b91514d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:59.299088 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220695f1-8abb-4659-9189-a29b91514d62 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.299585 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220695f1-8abb-4659-9189-a29b91514d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.301878 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220695f1-8abb-4659-9189-a29b91514d62 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.311049 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae9ac2-ef3e-43aa-b373-56fa897016ea admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:59.313270 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220695f1-8abb-4659-9189-a29b91514d62 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:58:59.317216 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73ae07-7ced-4a82-b546-8cd6d76de8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:59.318190 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73ae07-7ced-4a82-b546-8cd6d76de8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.318673 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73ae07-7ced-4a82-b546-8cd6d76de8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.319148 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73ae07-7ced-4a82-b546-8cd6d76de8a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.320138 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73ae07-7ced-4a82-b546-8cd6d76de8a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:59.321239 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-220695f1-8abb-4659-9189-a29b91514d62 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 15:58:59.327672 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73ae07-7ced-4a82-b546-8cd6d76de8a9 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:59.327794 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 349/699] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Dec 15 15:58:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:59.327794 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220695f1-8abb-4659-9189-a29b91514d62 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:59.337242 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220695f1-8abb-4659-9189-a29b91514d62 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:59.342482 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d476172-cc21-4f51-9aaf-08b9c400fa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:59.343128 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d476172-cc21-4f51-9aaf-08b9c400fa5b admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.343408 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d476172-cc21-4f51-9aaf-08b9c400fa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.343684 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d476172-cc21-4f51-9aaf-08b9c400fa5b admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.344478 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d476172-cc21-4f51-9aaf-08b9c400fa5b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:59.344788 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d476172-cc21-4f51-9aaf-08b9c400fa5b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:59.346919 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d476172-cc21-4f51-9aaf-08b9c400fa5b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:59.352934 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 351/700] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Dec 15 15:58:59 2021] POST /identity/v3/users => generated 254 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:58:59.354269 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73ae07-7ced-4a82-b546-8cd6d76de8a9 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:59.361430 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 350/701] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:58:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:59.368224 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d476172-cc21-4f51-9aaf-08b9c400fa5b admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:59.369504 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73ae07-7ced-4a82-b546-8cd6d76de8a9 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:59.375454 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e237c0-8865-4f7f-8ef3-e06ce4d2f6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:59.376369 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e237c0-8865-4f7f-8ef3-e06ce4d2f6fc admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.376771 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e237c0-8865-4f7f-8ef3-e06ce4d2f6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.377508 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e237c0-8865-4f7f-8ef3-e06ce4d2f6fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.379660 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e237c0-8865-4f7f-8ef3-e06ce4d2f6fc admin admin] RBAC: Adding query filter params (name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:59.380218 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e237c0-8865-4f7f-8ef3-e06ce4d2f6fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:59.381232 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d476172-cc21-4f51-9aaf-08b9c400fa5b admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:59.382471 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e237c0-8865-4f7f-8ef3-e06ce4d2f6fc admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:59.386884 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e4765-437e-47d9-8e4c-9e7b2e7d2229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:59.387783 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e4765-437e-47d9-8e4c-9e7b2e7d2229 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.388314 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e4765-437e-47d9-8e4c-9e7b2e7d2229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.388825 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e4765-437e-47d9-8e4c-9e7b2e7d2229 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.389885 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e4765-437e-47d9-8e4c-9e7b2e7d2229 admin admin] RBAC: Adding query filter params (role.id=bc362f875c6d4cee83ba65b8d134462d, scope.project.id=bc314fbc91c54810b27f9fcad7129c64, user.id=bc13934328e742f9a1a85d1c84ab83dd) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:59.390354 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e4765-437e-47d9-8e4c-9e7b2e7d2229 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:59.392516 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e4765-437e-47d9-8e4c-9e7b2e7d2229 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:59.397486 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 352/702] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Dec 15 15:58:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:59.401957 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e237c0-8865-4f7f-8ef3-e06ce4d2f6fc admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:59.405169 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 351/703] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:59 2021] GET /identity/v3/role_assignments?user.id=bc13934328e742f9a1a85d1c84ab83dd&scope.project.id=bc314fbc91c54810b27f9fcad7129c64&role.id=bc362f875c6d4cee83ba65b8d134462d => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:59.414767 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e237c0-8865-4f7f-8ef3-e06ce4d2f6fc admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:59.420268 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbc124-47e0-494e-aba8-64b79aff6d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:59.421306 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbc124-47e0-494e-aba8-64b79aff6d9c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.421717 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbc124-47e0-494e-aba8-64b79aff6d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.422097 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbc124-47e0-494e-aba8-64b79aff6d9c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.436424 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcbc124-47e0-494e-aba8-64b79aff6d9c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:59.438724 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcbc124-47e0-494e-aba8-64b79aff6d9c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:59.459127 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-7fcbc124-47e0-494e-aba8-64b79aff6d9c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:59.464152 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 353/704] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:59.470593 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e4765-437e-47d9-8e4c-9e7b2e7d2229 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:59.492184 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e4765-437e-47d9-8e4c-9e7b2e7d2229 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:59.508172 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146e7d6-2fb5-42b8-9b63-97d212eb3958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:59.508860 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146e7d6-2fb5-42b8-9b63-97d212eb3958 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.509147 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146e7d6-2fb5-42b8-9b63-97d212eb3958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.509443 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146e7d6-2fb5-42b8-9b63-97d212eb3958 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.510199 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146e7d6-2fb5-42b8-9b63-97d212eb3958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:59.510506 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146e7d6-2fb5-42b8-9b63-97d212eb3958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:59.512168 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146e7d6-2fb5-42b8-9b63-97d212eb3958 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:59.531971 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 352/705] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:59.539959 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbc124-47e0-494e-aba8-64b79aff6d9c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:59.560299 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbc124-47e0-494e-aba8-64b79aff6d9c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:59.565922 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b0814-d128-4735-ae3e-c9b14b977ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:59.567503 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b0814-d128-4735-ae3e-c9b14b977ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.567999 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b0814-d128-4735-ae3e-c9b14b977ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.568616 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b0814-d128-4735-ae3e-c9b14b977ec6 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.570415 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d361a57-5628-4f61-8cc8-4e87311f96d5 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.570707 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d361a57-5628-4f61-8cc8-4e87311f96d5 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.570984 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d361a57-5628-4f61-8cc8-4e87311f96d5 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.573286 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 353/706] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:58:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:58:59.579059 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b11d4d-6bd4-4f18-b0d2-a2d37157e4a7 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.579420 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b11d4d-6bd4-4f18-b0d2-a2d37157e4a7 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.579605 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b11d4d-6bd4-4f18-b0d2-a2d37157e4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.580318 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b0814-d128-4735-ae3e-c9b14b977ec6 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:59.583278 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b0814-d128-4735-ae3e-c9b14b977ec6 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:59.601206 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-916b0814-d128-4735-ae3e-c9b14b977ec6 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 15:58:59.607522 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 354/707] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:58:59 2021] GET /identity/v3/users/swift => generated 83 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:59.611192 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b0814-d128-4735-ae3e-c9b14b977ec6 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:59.620605 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-b0b11d4d-6bd4-4f18-b0d2-a2d37157e4a7 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:58:59.621849 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-b0b11d4d-6bd4-4f18-b0d2-a2d37157e4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:58:59.629434 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b0814-d128-4735-ae3e-c9b14b977ec6 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:59.640501 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76705ba4-c1a1-430f-b1f6-4e8010bc72ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:59.641995 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 354/708] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:58:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 15:58:59.643122 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76705ba4-c1a1-430f-b1f6-4e8010bc72ef admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.643599 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76705ba4-c1a1-430f-b1f6-4e8010bc72ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.644651 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76705ba4-c1a1-430f-b1f6-4e8010bc72ef admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.645842 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76705ba4-c1a1-430f-b1f6-4e8010bc72ef admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:59.646327 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76705ba4-c1a1-430f-b1f6-4e8010bc72ef admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:59.648534 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76705ba4-c1a1-430f-b1f6-4e8010bc72ef admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:59.669131 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b11d4d-6bd4-4f18-b0d2-a2d37157e4a7 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:59.677265 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 355/709] 10.222.0.36 () {56 vars in 1156 bytes} [Wed Dec 15 15:58:59 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:58:59.678573 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b11d4d-6bd4-4f18-b0d2-a2d37157e4a7 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:59.683308 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09ec6b-7ac6-449c-b902-be0a2dc41917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:59.683893 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76705ba4-c1a1-430f-b1f6-4e8010bc72ef admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:59.684117 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09ec6b-7ac6-449c-b902-be0a2dc41917 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.684396 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09ec6b-7ac6-449c-b902-be0a2dc41917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.684669 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09ec6b-7ac6-449c-b902-be0a2dc41917 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.685341 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09ec6b-7ac6-449c-b902-be0a2dc41917 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:59.686464 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING py.warnings [None req-0b09ec6b-7ac6-449c-b902-be0a2dc41917 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:58:59.686464 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: warnings.warn(msg) Dec 15 15:58:59.686464 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: Dec 15 15:58:59.687365 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09ec6b-7ac6-449c-b902-be0a2dc41917 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:59.706161 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-0b09ec6b-7ac6-449c-b902-be0a2dc41917 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 15 15:58:59.708198 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 355/710] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:59 2021] GET /identity/v3/services/network => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:58:59.709056 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76705ba4-c1a1-430f-b1f6-4e8010bc72ef admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:59.716272 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09ec6b-7ac6-449c-b902-be0a2dc41917 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:59.716713 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d2a6e-ab2d-4111-8cee-d7c6b0374aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:59.717666 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d2a6e-ab2d-4111-8cee-d7c6b0374aba admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.718381 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d2a6e-ab2d-4111-8cee-d7c6b0374aba admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.719460 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d2a6e-ab2d-4111-8cee-d7c6b0374aba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.729367 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09ec6b-7ac6-449c-b902-be0a2dc41917 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:59.733128 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d2a6e-ab2d-4111-8cee-d7c6b0374aba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:59.735353 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d2a6e-ab2d-4111-8cee-d7c6b0374aba admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:59.735578 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181f78f-5672-4c59-8d0f-0478c4845165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:59.736297 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181f78f-5672-4c59-8d0f-0478c4845165 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.736584 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181f78f-5672-4c59-8d0f-0478c4845165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.736859 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181f78f-5672-4c59-8d0f-0478c4845165 admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.737715 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181f78f-5672-4c59-8d0f-0478c4845165 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:59.738078 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181f78f-5672-4c59-8d0f-0478c4845165 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:59.740132 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181f78f-5672-4c59-8d0f-0478c4845165 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:59.745122 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 356/711] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:58:59 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 15:58:59.749824 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 356/712] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Dec 15 15:58:59 2021] GET /identity/v3/services?name=network => generated 124 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:59.754971 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d2a6e-ab2d-4111-8cee-d7c6b0374aba admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:59.755316 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181f78f-5672-4c59-8d0f-0478c4845165 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:59.765603 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d2a6e-ab2d-4111-8cee-d7c6b0374aba admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:59.767743 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181f78f-5672-4c59-8d0f-0478c4845165 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:59.770908 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a63a83-36ef-422e-8144-1217feef50e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:59.771831 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a63a83-36ef-422e-8144-1217feef50e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.772202 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a63a83-36ef-422e-8144-1217feef50e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.772577 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a63a83-36ef-422e-8144-1217feef50e9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.773443 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86170e6b-8076-41dc-9ee8-a78aab6d4c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:59.774200 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86170e6b-8076-41dc-9ee8-a78aab6d4c3f admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.774651 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86170e6b-8076-41dc-9ee8-a78aab6d4c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.774933 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86170e6b-8076-41dc-9ee8-a78aab6d4c3f admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.776305 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86170e6b-8076-41dc-9ee8-a78aab6d4c3f admin admin] RBAC: Adding query filter params (type=network) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:59.776666 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86170e6b-8076-41dc-9ee8-a78aab6d4c3f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:59.778401 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86170e6b-8076-41dc-9ee8-a78aab6d4c3f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:59.784078 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a63a83-36ef-422e-8144-1217feef50e9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:59.786845 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a63a83-36ef-422e-8144-1217feef50e9 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:59.787223 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 357/713] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Dec 15 15:58:59 2021] GET /identity/v3/services?type=network => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:59.808329 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-02a63a83-36ef-422e-8144-1217feef50e9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:58:59.813587 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 357/714] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:58:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:59.816995 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86170e6b-8076-41dc-9ee8-a78aab6d4c3f admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:59.828120 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86170e6b-8076-41dc-9ee8-a78aab6d4c3f admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:59.835149 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88d416-8cc8-41a2-8114-743768de3161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:59.835888 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88d416-8cc8-41a2-8114-743768de3161 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.836172 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88d416-8cc8-41a2-8114-743768de3161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.836450 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88d416-8cc8-41a2-8114-743768de3161 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.837283 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88d416-8cc8-41a2-8114-743768de3161 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:59.837619 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88d416-8cc8-41a2-8114-743768de3161 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:59.839319 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88d416-8cc8-41a2-8114-743768de3161 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:59.860287 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 358/715] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:58:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:59.861771 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a63a83-36ef-422e-8144-1217feef50e9 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:59.873003 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a63a83-36ef-422e-8144-1217feef50e9 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:59.878097 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc0369-f7db-4f57-9ac6-1308280acb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:59.879478 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc0369-f7db-4f57-9ac6-1308280acb2e admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.879786 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc0369-f7db-4f57-9ac6-1308280acb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.880120 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc0369-f7db-4f57-9ac6-1308280acb2e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.888525 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc0369-f7db-4f57-9ac6-1308280acb2e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:59.890689 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc0369-f7db-4f57-9ac6-1308280acb2e admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:59.906203 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-b4cc0369-f7db-4f57-9ac6-1308280acb2e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:58:59.913541 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 358/716] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:58:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:58:59.915595 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88d416-8cc8-41a2-8114-743768de3161 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:59.927572 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88d416-8cc8-41a2-8114-743768de3161 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:59.933564 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07aacd-ee7d-4d1f-98f4-3ac75f942c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:59.934309 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07aacd-ee7d-4d1f-98f4-3ac75f942c3d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.934598 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07aacd-ee7d-4d1f-98f4-3ac75f942c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.934882 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07aacd-ee7d-4d1f-98f4-3ac75f942c3d admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.935749 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07aacd-ee7d-4d1f-98f4-3ac75f942c3d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:59.936065 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07aacd-ee7d-4d1f-98f4-3ac75f942c3d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:59.938140 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07aacd-ee7d-4d1f-98f4-3ac75f942c3d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:59.952736 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 359/717] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:58:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:58:59.959797 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc0369-f7db-4f57-9ac6-1308280acb2e admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:58:59.971785 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc0369-f7db-4f57-9ac6-1308280acb2e admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:58:59.977214 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a512f-892a-4e63-a551-fd6a66fb0e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:58:59.977909 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a512f-892a-4e63-a551-fd6a66fb0e0d admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:58:59.978194 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a512f-892a-4e63-a551-fd6a66fb0e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:58:59.978541 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a512f-892a-4e63-a551-fd6a66fb0e0d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:58:59.979384 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a512f-892a-4e63-a551-fd6a66fb0e0d admin admin] RBAC: Adding query filter params (role.id=17e6533ce814487c9a8fb0ee2acaad32, scope.project.id=bc314fbc91c54810b27f9fcad7129c64, user.id=5e3f652f76424e27a1d4329212d9b66d) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:58:59.979747 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a512f-892a-4e63-a551-fd6a66fb0e0d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:58:59.981767 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a512f-892a-4e63-a551-fd6a66fb0e0d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:58:59.991965 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 359/718] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:58:59 2021] GET /identity/v3/role_assignments?user.id=5e3f652f76424e27a1d4329212d9b66d&scope.project.id=bc314fbc91c54810b27f9fcad7129c64&role.id=17e6533ce814487c9a8fb0ee2acaad32 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:00.832741 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b511b-35b4-44b2-995e-d7d52a169867 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:00.833517 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b511b-35b4-44b2-995e-d7d52a169867 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:00.833517 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b511b-35b4-44b2-995e-d7d52a169867 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:00.835520 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 360/719] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:00.841251 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d0dba-da5b-46f6-a4e9-9b8928be3dcd None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:00.841788 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d0dba-da5b-46f6-a4e9-9b8928be3dcd None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:00.841948 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d0dba-da5b-46f6-a4e9-9b8928be3dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:00.860579 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-1d8d0dba-da5b-46f6-a4e9-9b8928be3dcd None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:00.866151 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-1d8d0dba-da5b-46f6-a4e9-9b8928be3dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:00.882687 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 360/720] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 15:59:00.915838 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b511b-35b4-44b2-995e-d7d52a169867 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:00.934123 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b511b-35b4-44b2-995e-d7d52a169867 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:00.938689 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0233ce-2ece-43ed-80d1-bbddb77c4557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:00.939350 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0233ce-2ece-43ed-80d1-bbddb77c4557 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:00.939636 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0233ce-2ece-43ed-80d1-bbddb77c4557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:00.939916 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0233ce-2ece-43ed-80d1-bbddb77c4557 admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:00.940725 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0233ce-2ece-43ed-80d1-bbddb77c4557 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:00.942168 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING py.warnings [None req-ac0233ce-2ece-43ed-80d1-bbddb77c4557 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:59:00.942168 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: warnings.warn(msg) Dec 15 15:59:00.942168 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: Dec 15 15:59:00.943068 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0233ce-2ece-43ed-80d1-bbddb77c4557 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:00.959802 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 361/721] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Dec 15 15:59:00 2021] POST /identity/v3/services => generated 251 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:59:02.239293 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1de3ba-03ad-4e75-b9c0-3709227b5c1f None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:02.240129 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1de3ba-03ad-4e75-b9c0-3709227b5c1f None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:02.240129 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1de3ba-03ad-4e75-b9c0-3709227b5c1f None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:02.241787 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 361/722] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:02.249334 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f4d7e-d90d-4889-a90b-117d0e780fa6 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:02.249334 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f4d7e-d90d-4889-a90b-117d0e780fa6 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:02.249334 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f4d7e-d90d-4889-a90b-117d0e780fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:02.273494 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-6d7f4d7e-d90d-4889-a90b-117d0e780fa6 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:02.275087 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-6d7f4d7e-d90d-4889-a90b-117d0e780fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:02.302243 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 362/723] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:02 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:02.336339 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1de3ba-03ad-4e75-b9c0-3709227b5c1f None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:02.354975 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1de3ba-03ad-4e75-b9c0-3709227b5c1f None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:02.363136 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752a224-5d15-426f-83dd-840daf4e1ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:02.364192 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752a224-5d15-426f-83dd-840daf4e1ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:02.364486 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752a224-5d15-426f-83dd-840daf4e1ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:02.364767 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752a224-5d15-426f-83dd-840daf4e1ea1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:02.375772 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752a224-5d15-426f-83dd-840daf4e1ea1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:59:02.383802 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-a752a224-5d15-426f-83dd-840daf4e1ea1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 15:59:02.389500 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 362/724] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:59:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:02.391665 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f4d7e-d90d-4889-a90b-117d0e780fa6 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:02.395984 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1388e7d-3493-440f-8c61-199220dd6101 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:02.396269 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1388e7d-3493-440f-8c61-199220dd6101 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:02.396542 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1388e7d-3493-440f-8c61-199220dd6101 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:02.401407 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 363/725] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:59:02.403852 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090c711-e7a3-471d-8a9f-59676489050a None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:02.404133 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090c711-e7a3-471d-8a9f-59676489050a None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:02.404405 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090c711-e7a3-471d-8a9f-59676489050a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:02.412251 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f4d7e-d90d-4889-a90b-117d0e780fa6 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:02.422712 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-f090c711-e7a3-471d-8a9f-59676489050a None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:02.424184 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f090c711-e7a3-471d-8a9f-59676489050a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:02.426126 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554daf42-247d-4f1d-8512-e2af944c0c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:02.426865 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554daf42-247d-4f1d-8512-e2af944c0c0a admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:02.427233 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554daf42-247d-4f1d-8512-e2af944c0c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:02.427561 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554daf42-247d-4f1d-8512-e2af944c0c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:02.428383 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554daf42-247d-4f1d-8512-e2af944c0c0a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:02.428757 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554daf42-247d-4f1d-8512-e2af944c0c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:02.430462 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554daf42-247d-4f1d-8512-e2af944c0c0a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:02.434530 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 364/726] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:02 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 15:59:02.447006 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 363/727] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:59:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:02.452862 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090c711-e7a3-471d-8a9f-59676489050a None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:02.467741 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090c711-e7a3-471d-8a9f-59676489050a None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:02.471581 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554daf42-247d-4f1d-8512-e2af944c0c0a admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:02.474866 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e67035-bb79-475d-bf97-d5f0a1c86c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:02.475869 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e67035-bb79-475d-bf97-d5f0a1c86c33 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:02.476330 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e67035-bb79-475d-bf97-d5f0a1c86c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:02.476796 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e67035-bb79-475d-bf97-d5f0a1c86c33 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:02.488433 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e67035-bb79-475d-bf97-d5f0a1c86c33 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:02.490816 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e67035-bb79-475d-bf97-d5f0a1c86c33 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:02.493105 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554daf42-247d-4f1d-8512-e2af944c0c0a admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:02.499824 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c8d05-ffd5-46fb-b6df-3bb338096e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:02.501127 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c8d05-ffd5-46fb-b6df-3bb338096e61 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:02.501687 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c8d05-ffd5-46fb-b6df-3bb338096e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:02.501982 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c8d05-ffd5-46fb-b6df-3bb338096e61 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:02.510192 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-f4e67035-bb79-475d-bf97-d5f0a1c86c33 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:02.512212 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 365/728] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:02.519468 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e67035-bb79-475d-bf97-d5f0a1c86c33 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:02.528290 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c8d05-ffd5-46fb-b6df-3bb338096e61 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:59:02.539175 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-508c8d05-ffd5-46fb-b6df-3bb338096e61 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 15:59:02.540391 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 364/729] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Dec 15 15:59:02 2021] GET /identity/v3/roles/service => generated 85 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:02.542961 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e67035-bb79-475d-bf97-d5f0a1c86c33 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:02.548901 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75802e31-2f52-4a5e-858a-6567be10ca10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:02.550615 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75802e31-2f52-4a5e-858a-6567be10ca10 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:02.551124 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75802e31-2f52-4a5e-858a-6567be10ca10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:02.551578 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75802e31-2f52-4a5e-858a-6567be10ca10 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:02.552566 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75802e31-2f52-4a5e-858a-6567be10ca10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:02.553057 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75802e31-2f52-4a5e-858a-6567be10ca10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:02.554363 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c8d05-ffd5-46fb-b6df-3bb338096e61 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:02.555233 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75802e31-2f52-4a5e-858a-6567be10ca10 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:02.577737 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c8d05-ffd5-46fb-b6df-3bb338096e61 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:02.580801 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 366/730] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:02.589565 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679352a4-f4e1-4333-86a8-0813a553ac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:02.590240 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679352a4-f4e1-4333-86a8-0813a553ac4c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:02.590524 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679352a4-f4e1-4333-86a8-0813a553ac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:02.590800 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679352a4-f4e1-4333-86a8-0813a553ac4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:02.591565 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679352a4-f4e1-4333-86a8-0813a553ac4c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:02.591881 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679352a4-f4e1-4333-86a8-0813a553ac4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:02.593508 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679352a4-f4e1-4333-86a8-0813a553ac4c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:02.598942 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75802e31-2f52-4a5e-858a-6567be10ca10 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:02.608644 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75802e31-2f52-4a5e-858a-6567be10ca10 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:02.617686 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 365/731] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Dec 15 15:59:02 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:02.620300 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bd966-caaa-445f-a4e8-bcc479b2385a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:02.621082 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bd966-caaa-445f-a4e8-bcc479b2385a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:02.621365 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bd966-caaa-445f-a4e8-bcc479b2385a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:02.621673 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bd966-caaa-445f-a4e8-bcc479b2385a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:02.625070 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679352a4-f4e1-4333-86a8-0813a553ac4c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:02.638395 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721bd966-caaa-445f-a4e8-bcc479b2385a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:02.640445 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721bd966-caaa-445f-a4e8-bcc479b2385a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:02.646086 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679352a4-f4e1-4333-86a8-0813a553ac4c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:02.652174 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf0e34-3d95-4267-85b7-b5d2cd644ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:02.654228 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf0e34-3d95-4267-85b7-b5d2cd644ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:02.654228 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf0e34-3d95-4267-85b7-b5d2cd644ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:02.654228 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf0e34-3d95-4267-85b7-b5d2cd644ff0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:02.666687 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf0e34-3d95-4267-85b7-b5d2cd644ff0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:02.667059 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-721bd966-caaa-445f-a4e8-bcc479b2385a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 15:59:02.668780 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 367/732] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Dec 15 15:59:02 2021] GET /identity/v3/users/nova => generated 82 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:02.673590 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf0e34-3d95-4267-85b7-b5d2cd644ff0 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:02.676118 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bd966-caaa-445f-a4e8-bcc479b2385a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:02.694865 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bd966-caaa-445f-a4e8-bcc479b2385a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:02.696503 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-dbdf0e34-3d95-4267-85b7-b5d2cd644ff0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:02.697765 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 366/733] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:02.698983 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c3e2d-d522-487d-8b44-8373dbd7d646 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:02.704155 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c3e2d-d522-487d-8b44-8373dbd7d646 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:02.704155 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c3e2d-d522-487d-8b44-8373dbd7d646 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:02.704155 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 367/734] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:02.706371 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c3e2d-d522-487d-8b44-8373dbd7d646 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:02.706750 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6881de-10fe-40a5-b690-da2e0a0eeb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:02.707703 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6881de-10fe-40a5-b690-da2e0a0eeb04 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:02.708263 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6881de-10fe-40a5-b690-da2e0a0eeb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:02.708766 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6881de-10fe-40a5-b690-da2e0a0eeb04 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:02.710076 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6881de-10fe-40a5-b690-da2e0a0eeb04 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:02.710547 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6881de-10fe-40a5-b690-da2e0a0eeb04 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:02.712667 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6881de-10fe-40a5-b690-da2e0a0eeb04 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:02.718677 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c3e2d-d522-487d-8b44-8373dbd7d646 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:02.723218 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f13894-8e60-4293-a00e-f5a4a65c1ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:02.723876 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f13894-8e60-4293-a00e-f5a4a65c1ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:02.724148 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f13894-8e60-4293-a00e-f5a4a65c1ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:02.724425 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f13894-8e60-4293-a00e-f5a4a65c1ce0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:02.725165 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f13894-8e60-4293-a00e-f5a4a65c1ce0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:02.725510 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f13894-8e60-4293-a00e-f5a4a65c1ce0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:02.727120 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f13894-8e60-4293-a00e-f5a4a65c1ce0 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:02.733112 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 368/735] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Dec 15 15:59:02 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:02.734706 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53bd62-f1f2-4255-917c-7f85a28a0869 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:02.735218 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53bd62-f1f2-4255-917c-7f85a28a0869 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:02.735697 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53bd62-f1f2-4255-917c-7f85a28a0869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:02.740056 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 368/736] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:02.740890 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f13894-8e60-4293-a00e-f5a4a65c1ce0 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:02.750395 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f13894-8e60-4293-a00e-f5a4a65c1ce0 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:02.755743 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f5a49-21a2-404c-b598-ef75bbc704ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:02.756569 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f5a49-21a2-404c-b598-ef75bbc704ee admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:02.756889 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f5a49-21a2-404c-b598-ef75bbc704ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:02.757174 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f5a49-21a2-404c-b598-ef75bbc704ee admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:02.762096 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-cb53bd62-f1f2-4255-917c-7f85a28a0869 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:02.763473 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-cb53bd62-f1f2-4255-917c-7f85a28a0869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:02.768710 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f5a49-21a2-404c-b598-ef75bbc704ee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:02.771226 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f5a49-21a2-404c-b598-ef75bbc704ee admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:02.772198 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 369/737] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:02 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:02.773170 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53bd62-f1f2-4255-917c-7f85a28a0869 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:02.782357 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53bd62-f1f2-4255-917c-7f85a28a0869 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:02.787443 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a0228-5725-4725-b681-670d6b655da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:02.788451 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a0228-5725-4725-b681-670d6b655da3 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:02.788910 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a0228-5725-4725-b681-670d6b655da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:02.789373 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a0228-5725-4725-b681-670d6b655da3 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:02.796820 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a0228-5725-4725-b681-670d6b655da3 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:02.799174 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a0228-5725-4725-b681-670d6b655da3 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:02.802981 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-a42f5a49-21a2-404c-b598-ef75bbc704ee admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:02.804491 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 369/738] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:02.810218 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f5a49-21a2-404c-b598-ef75bbc704ee admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:02.815213 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-5a1a0228-5725-4725-b681-670d6b655da3 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 15:59:02.817935 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 370/739] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Dec 15 15:59:02 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:02.822887 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f5a49-21a2-404c-b598-ef75bbc704ee admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:02.823929 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a0228-5725-4725-b681-670d6b655da3 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:02.831691 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab572963-9247-4b58-803a-c03d77f2fa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:02.832415 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab572963-9247-4b58-803a-c03d77f2fa55 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:02.832733 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab572963-9247-4b58-803a-c03d77f2fa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:02.833036 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab572963-9247-4b58-803a-c03d77f2fa55 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:02.833826 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab572963-9247-4b58-803a-c03d77f2fa55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:02.834191 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab572963-9247-4b58-803a-c03d77f2fa55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:02.835612 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a0228-5725-4725-b681-670d6b655da3 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:02.835865 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab572963-9247-4b58-803a-c03d77f2fa55 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:02.840423 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599c569-4b09-4295-9b02-e38d06aebbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:02.841274 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599c569-4b09-4295-9b02-e38d06aebbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:02.841846 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599c569-4b09-4295-9b02-e38d06aebbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:02.842291 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599c569-4b09-4295-9b02-e38d06aebbe2 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:02.843300 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599c569-4b09-4295-9b02-e38d06aebbe2 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:02.843788 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599c569-4b09-4295-9b02-e38d06aebbe2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:02.845827 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599c569-4b09-4295-9b02-e38d06aebbe2 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:02.852766 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 370/740] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:02.852766 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab572963-9247-4b58-803a-c03d77f2fa55 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:02.863349 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab572963-9247-4b58-803a-c03d77f2fa55 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:02.868588 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59b42b-4ffc-4803-9a8e-0172e551bec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:02.869931 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59b42b-4ffc-4803-9a8e-0172e551bec9 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:02.870418 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59b42b-4ffc-4803-9a8e-0172e551bec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:02.870876 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59b42b-4ffc-4803-9a8e-0172e551bec9 admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:02.871099 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 371/741] 10.222.0.36 () {56 vars in 1170 bytes} [Wed Dec 15 15:59:02 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:02.876624 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599c569-4b09-4295-9b02-e38d06aebbe2 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:02.876756 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59b42b-4ffc-4803-9a8e-0172e551bec9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:02.876756 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59b42b-4ffc-4803-9a8e-0172e551bec9 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:02.889109 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599c569-4b09-4295-9b02-e38d06aebbe2 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:02.894375 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa58ab-03c6-4374-a0e9-3300a28fc33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:02.895698 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa58ab-03c6-4374-a0e9-3300a28fc33a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:02.896198 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa58ab-03c6-4374-a0e9-3300a28fc33a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:02.896514 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 371/742] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Dec 15 15:59:02 2021] POST /identity/v3/services => generated 240 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:59:02.896872 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa58ab-03c6-4374-a0e9-3300a28fc33a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:02.901842 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59b42b-4ffc-4803-9a8e-0172e551bec9 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:02.913478 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa58ab-03c6-4374-a0e9-3300a28fc33a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:02.918251 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa58ab-03c6-4374-a0e9-3300a28fc33a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:02.945548 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59b42b-4ffc-4803-9a8e-0172e551bec9 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:02.951102 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-65aa58ab-03c6-4374-a0e9-3300a28fc33a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:59:02.952134 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d0cd1-73d2-4522-8d22-5810065fd4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:02.953693 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 372/743] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:59:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:02.954740 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d0cd1-73d2-4522-8d22-5810065fd4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:02.955245 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d0cd1-73d2-4522-8d22-5810065fd4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:02.955715 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d0cd1-73d2-4522-8d22-5810065fd4a5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:02.963993 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa58ab-03c6-4374-a0e9-3300a28fc33a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:02.977588 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa58ab-03c6-4374-a0e9-3300a28fc33a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:02.979480 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d0cd1-73d2-4522-8d22-5810065fd4a5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:02.981321 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d0cd1-73d2-4522-8d22-5810065fd4a5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:02.991328 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ff12b-0ad9-4ed7-bb10-c3e27e2c1d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:02.992060 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ff12b-0ad9-4ed7-bb10-c3e27e2c1d38 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:02.992346 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ff12b-0ad9-4ed7-bb10-c3e27e2c1d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:02.993108 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ff12b-0ad9-4ed7-bb10-c3e27e2c1d38 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:02.995089 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ff12b-0ad9-4ed7-bb10-c3e27e2c1d38 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:02.995477 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ff12b-0ad9-4ed7-bb10-c3e27e2c1d38 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:02.998871 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ff12b-0ad9-4ed7-bb10-c3e27e2c1d38 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:03.006092 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 372/744] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:59:02 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 15:59:03.010576 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d0cd1-73d2-4522-8d22-5810065fd4a5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:03.024138 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d0cd1-73d2-4522-8d22-5810065fd4a5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:03.033182 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 373/745] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:59:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:03.036376 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ff12b-0ad9-4ed7-bb10-c3e27e2c1d38 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:03.058310 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52471b67-953c-4c80-9f74-d26c666a9817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:03.059144 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52471b67-953c-4c80-9f74-d26c666a9817 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:03.059435 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52471b67-953c-4c80-9f74-d26c666a9817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:03.059717 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52471b67-953c-4c80-9f74-d26c666a9817 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:03.069709 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ff12b-0ad9-4ed7-bb10-c3e27e2c1d38 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:03.074864 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7dc899-3742-42a1-85d7-e0dfb44105ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:03.075897 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dc899-3742-42a1-85d7-e0dfb44105ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:03.076158 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dc899-3742-42a1-85d7-e0dfb44105ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:03.076441 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7dc899-3742-42a1-85d7-e0dfb44105ab admin admin] PATH_INFO: `/v3/projects/bc314fbc91c54810b27f9fcad7129c64/users/bc13934328e742f9a1a85d1c84ab83dd/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:03.079134 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7dc899-3742-42a1-85d7-e0dfb44105ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc314fbc91c54810b27f9fcad7129c64, user_id=bc13934328e742f9a1a85d1c84ab83dd, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:03.080666 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52471b67-953c-4c80-9f74-d26c666a9817 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:03.082699 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52471b67-953c-4c80-9f74-d26c666a9817 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:03.083054 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7dc899-3742-42a1-85d7-e0dfb44105ab admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:03.107040 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 374/746] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Dec 15 15:59:03 2021] PUT /identity/v3/projects/bc314fbc91c54810b27f9fcad7129c64/users/bc13934328e742f9a1a85d1c84ab83dd/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 15:59:03.124891 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-52471b67-953c-4c80-9f74-d26c666a9817 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:03.126491 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 373/747] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:03.133733 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7dc899-3742-42a1-85d7-e0dfb44105ab admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:03.205821 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7dc899-3742-42a1-85d7-e0dfb44105ab admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:03.211234 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d4bed-a83e-441c-b77c-93f3289e7645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:03.211965 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d4bed-a83e-441c-b77c-93f3289e7645 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:03.212328 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d4bed-a83e-441c-b77c-93f3289e7645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:03.212615 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d4bed-a83e-441c-b77c-93f3289e7645 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:03.213440 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d4bed-a83e-441c-b77c-93f3289e7645 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:03.213757 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d4bed-a83e-441c-b77c-93f3289e7645 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:03.215432 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d4bed-a83e-441c-b77c-93f3289e7645 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:03.230027 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 375/748] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:03.236199 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52471b67-953c-4c80-9f74-d26c666a9817 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:03.247867 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52471b67-953c-4c80-9f74-d26c666a9817 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:03.252787 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49305f29-f037-4e97-91c1-32ee193554f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:03.254564 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49305f29-f037-4e97-91c1-32ee193554f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:03.254925 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49305f29-f037-4e97-91c1-32ee193554f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:03.255205 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49305f29-f037-4e97-91c1-32ee193554f9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:03.263181 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49305f29-f037-4e97-91c1-32ee193554f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:03.265462 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49305f29-f037-4e97-91c1-32ee193554f9 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:03.280720 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-49305f29-f037-4e97-91c1-32ee193554f9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:59:03.285473 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 374/749] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:59:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:03.290190 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d4bed-a83e-441c-b77c-93f3289e7645 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:03.301706 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d4bed-a83e-441c-b77c-93f3289e7645 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:03.306583 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27d80d-6aaa-49bc-9751-ccd79d749627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:03.307314 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27d80d-6aaa-49bc-9751-ccd79d749627 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:03.307601 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27d80d-6aaa-49bc-9751-ccd79d749627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:03.307925 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27d80d-6aaa-49bc-9751-ccd79d749627 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:03.308820 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27d80d-6aaa-49bc-9751-ccd79d749627 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:03.309119 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27d80d-6aaa-49bc-9751-ccd79d749627 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:03.311172 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27d80d-6aaa-49bc-9751-ccd79d749627 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:03.326141 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 376/750] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:59:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:03.332987 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49305f29-f037-4e97-91c1-32ee193554f9 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:03.344238 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49305f29-f037-4e97-91c1-32ee193554f9 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:03.351988 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751dc85-a284-4ace-8268-bf89142d5ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:03.352661 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751dc85-a284-4ace-8268-bf89142d5ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:03.352947 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751dc85-a284-4ace-8268-bf89142d5ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:03.353223 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751dc85-a284-4ace-8268-bf89142d5ec5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:03.354111 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751dc85-a284-4ace-8268-bf89142d5ec5 admin admin] RBAC: Adding query filter params (role.id=17e6533ce814487c9a8fb0ee2acaad32, scope.project.id=bc314fbc91c54810b27f9fcad7129c64, user.id=b2f47cbf62d44a6ba7e6a6f0f2305630) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:03.354421 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751dc85-a284-4ace-8268-bf89142d5ec5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:03.356305 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751dc85-a284-4ace-8268-bf89142d5ec5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:03.364613 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 375/751] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:59:03 2021] GET /identity/v3/role_assignments?user.id=b2f47cbf62d44a6ba7e6a6f0f2305630&scope.project.id=bc314fbc91c54810b27f9fcad7129c64&role.id=17e6533ce814487c9a8fb0ee2acaad32 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:03.432016 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc5abe-10f9-45e9-83cf-351cf2129226 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:03.432016 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc5abe-10f9-45e9-83cf-351cf2129226 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:03.432016 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc5abe-10f9-45e9-83cf-351cf2129226 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:03.432620 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 377/752] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:03.439255 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae321870-434e-43ab-9669-92bfa45bd9b7 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:03.439687 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae321870-434e-43ab-9669-92bfa45bd9b7 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:03.440063 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae321870-434e-43ab-9669-92bfa45bd9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:03.468290 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-ae321870-434e-43ab-9669-92bfa45bd9b7 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:03.469709 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-ae321870-434e-43ab-9669-92bfa45bd9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:03.481369 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 376/753] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:03 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:03.518206 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc5abe-10f9-45e9-83cf-351cf2129226 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:03.542358 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc5abe-10f9-45e9-83cf-351cf2129226 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:03.547362 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756be706-3b8a-40a3-a898-e27e73a7692b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:03.548399 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756be706-3b8a-40a3-a898-e27e73a7692b admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:03.548826 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756be706-3b8a-40a3-a898-e27e73a7692b admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:03.549242 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756be706-3b8a-40a3-a898-e27e73a7692b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:03.569219 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756be706-3b8a-40a3-a898-e27e73a7692b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:59:03.576533 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-756be706-3b8a-40a3-a898-e27e73a7692b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 15:59:03.578363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 378/754] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:59:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:03.585658 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae321870-434e-43ab-9669-92bfa45bd9b7 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:03.595973 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae321870-434e-43ab-9669-92bfa45bd9b7 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:03.601213 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ece0d-8758-4807-90df-8ad8aa3e8aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:03.602068 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ece0d-8758-4807-90df-8ad8aa3e8aff admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:03.602515 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ece0d-8758-4807-90df-8ad8aa3e8aff admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:03.602929 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ece0d-8758-4807-90df-8ad8aa3e8aff admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:03.603830 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ece0d-8758-4807-90df-8ad8aa3e8aff admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:03.604281 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ece0d-8758-4807-90df-8ad8aa3e8aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:03.606101 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ece0d-8758-4807-90df-8ad8aa3e8aff admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:03.616072 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 377/755] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:59:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:03.622363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756be706-3b8a-40a3-a898-e27e73a7692b admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:03.632611 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756be706-3b8a-40a3-a898-e27e73a7692b admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:03.637487 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3508448-2e1f-4e1c-86de-bd8998f3827c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:03.638469 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3508448-2e1f-4e1c-86de-bd8998f3827c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:03.638965 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3508448-2e1f-4e1c-86de-bd8998f3827c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:03.639378 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3508448-2e1f-4e1c-86de-bd8998f3827c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:03.652790 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3508448-2e1f-4e1c-86de-bd8998f3827c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:03.654907 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3508448-2e1f-4e1c-86de-bd8998f3827c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:03.673309 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-e3508448-2e1f-4e1c-86de-bd8998f3827c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:03.675289 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 379/756] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:03.681680 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ece0d-8758-4807-90df-8ad8aa3e8aff admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:03.692022 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ece0d-8758-4807-90df-8ad8aa3e8aff admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:03.698244 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8597c72-445f-4e8f-9463-8b9df831dab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:03.699116 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8597c72-445f-4e8f-9463-8b9df831dab5 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:03.699565 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8597c72-445f-4e8f-9463-8b9df831dab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:03.700021 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8597c72-445f-4e8f-9463-8b9df831dab5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:03.700982 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8597c72-445f-4e8f-9463-8b9df831dab5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:03.701453 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8597c72-445f-4e8f-9463-8b9df831dab5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:03.703273 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8597c72-445f-4e8f-9463-8b9df831dab5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:03.720922 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 378/757] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:03.726957 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3508448-2e1f-4e1c-86de-bd8998f3827c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:03.742604 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3508448-2e1f-4e1c-86de-bd8998f3827c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:03.747576 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87df920-3b7a-47d5-a6b9-362ed88b934d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:03.748629 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87df920-3b7a-47d5-a6b9-362ed88b934d admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:03.749235 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87df920-3b7a-47d5-a6b9-362ed88b934d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:03.751053 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87df920-3b7a-47d5-a6b9-362ed88b934d admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:03.762614 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87df920-3b7a-47d5-a6b9-362ed88b934d admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:03.764998 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87df920-3b7a-47d5-a6b9-362ed88b934d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:03.784318 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-b87df920-3b7a-47d5-a6b9-362ed88b934d admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 15:59:03.786054 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 380/758] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:59:03 2021] GET /identity/v3/users/swift => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:03.792743 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8597c72-445f-4e8f-9463-8b9df831dab5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:03.811786 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8597c72-445f-4e8f-9463-8b9df831dab5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:03.827473 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e13e26-3231-4201-955c-6fa5e42194b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:03.828085 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e13e26-3231-4201-955c-6fa5e42194b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:03.828367 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e13e26-3231-4201-955c-6fa5e42194b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:03.828646 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e13e26-3231-4201-955c-6fa5e42194b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:03.829521 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e13e26-3231-4201-955c-6fa5e42194b8 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:03.829835 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e13e26-3231-4201-955c-6fa5e42194b8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:03.832214 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e13e26-3231-4201-955c-6fa5e42194b8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:03.854263 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 379/759] 10.222.0.36 () {56 vars in 1156 bytes} [Wed Dec 15 15:59:03 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:03.860463 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87df920-3b7a-47d5-a6b9-362ed88b934d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:03.871026 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87df920-3b7a-47d5-a6b9-362ed88b934d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:03.875866 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b51c2-571d-4e6f-9109-c1a195e6ad8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:03.876767 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b51c2-571d-4e6f-9109-c1a195e6ad8f admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:03.877268 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b51c2-571d-4e6f-9109-c1a195e6ad8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:03.877775 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b51c2-571d-4e6f-9109-c1a195e6ad8f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:03.891846 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b51c2-571d-4e6f-9109-c1a195e6ad8f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:03.894057 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b51c2-571d-4e6f-9109-c1a195e6ad8f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:03.906781 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 381/760] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:59:03 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 15:59:03.913656 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e13e26-3231-4201-955c-6fa5e42194b8 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:03.926699 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e13e26-3231-4201-955c-6fa5e42194b8 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:03.935135 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bee15-bd4e-442f-ae4d-377988bdeec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:03.935918 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bee15-bd4e-442f-ae4d-377988bdeec4 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:03.936202 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bee15-bd4e-442f-ae4d-377988bdeec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:03.936475 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bee15-bd4e-442f-ae4d-377988bdeec4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:03.952387 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bee15-bd4e-442f-ae4d-377988bdeec4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:03.954292 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bee15-bd4e-442f-ae4d-377988bdeec4 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:03.979459 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-ef9bee15-bd4e-442f-ae4d-377988bdeec4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:03.980666 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 380/761] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:03.986691 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b51c2-571d-4e6f-9109-c1a195e6ad8f admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:04.000286 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b51c2-571d-4e6f-9109-c1a195e6ad8f admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:04.008898 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725dded8-96c2-4c53-a230-a35c703a7c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:04.009871 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dded8-96c2-4c53-a230-a35c703a7c42 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:04.010359 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dded8-96c2-4c53-a230-a35c703a7c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:04.010851 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dded8-96c2-4c53-a230-a35c703a7c42 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:04.011822 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725dded8-96c2-4c53-a230-a35c703a7c42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:04.012318 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725dded8-96c2-4c53-a230-a35c703a7c42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:04.014204 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725dded8-96c2-4c53-a230-a35c703a7c42 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:04.033005 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 382/762] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:04.040048 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bee15-bd4e-442f-ae4d-377988bdeec4 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:04.055499 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bee15-bd4e-442f-ae4d-377988bdeec4 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:04.067332 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986b678-5162-4c4b-a33d-24b7caa9d927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:04.068274 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986b678-5162-4c4b-a33d-24b7caa9d927 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:04.068563 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986b678-5162-4c4b-a33d-24b7caa9d927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:04.068836 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986b678-5162-4c4b-a33d-24b7caa9d927 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:04.080965 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986b678-5162-4c4b-a33d-24b7caa9d927 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:04.083108 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986b678-5162-4c4b-a33d-24b7caa9d927 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:04.103406 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-9986b678-5162-4c4b-a33d-24b7caa9d927 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:59:04.104592 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 381/763] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:59:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:04.110799 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725dded8-96c2-4c53-a230-a35c703a7c42 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:04.125665 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725dded8-96c2-4c53-a230-a35c703a7c42 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:04.134301 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3154ae-868e-48ad-ae8d-aa540a3cb4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:04.135232 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3154ae-868e-48ad-ae8d-aa540a3cb4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:04.135729 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3154ae-868e-48ad-ae8d-aa540a3cb4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:04.136299 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3154ae-868e-48ad-ae8d-aa540a3cb4c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:04.137312 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3154ae-868e-48ad-ae8d-aa540a3cb4c2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:04.137854 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3154ae-868e-48ad-ae8d-aa540a3cb4c2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:04.139960 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3154ae-868e-48ad-ae8d-aa540a3cb4c2 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:04.157587 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 383/764] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:59:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:04.164431 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986b678-5162-4c4b-a33d-24b7caa9d927 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:04.180130 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986b678-5162-4c4b-a33d-24b7caa9d927 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:04.189650 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7dd34e-9967-4f80-b297-022004c33475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:04.190362 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dd34e-9967-4f80-b297-022004c33475 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:04.190656 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dd34e-9967-4f80-b297-022004c33475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:04.190930 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dd34e-9967-4f80-b297-022004c33475 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:04.191798 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7dd34e-9967-4f80-b297-022004c33475 admin admin] RBAC: Adding query filter params (role.id=bc362f875c6d4cee83ba65b8d134462d, scope.project.id=bc314fbc91c54810b27f9fcad7129c64, user.id=5e3f652f76424e27a1d4329212d9b66d) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:04.192090 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7dd34e-9967-4f80-b297-022004c33475 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:04.193983 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7dd34e-9967-4f80-b297-022004c33475 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:04.204388 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 382/765] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:59:04 2021] GET /identity/v3/role_assignments?user.id=5e3f652f76424e27a1d4329212d9b66d&scope.project.id=bc314fbc91c54810b27f9fcad7129c64&role.id=bc362f875c6d4cee83ba65b8d134462d => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:04.282280 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d847e3b-17fc-4efc-b3a7-6c2c90c55b81 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:04.282639 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d847e3b-17fc-4efc-b3a7-6c2c90c55b81 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:04.282833 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d847e3b-17fc-4efc-b3a7-6c2c90c55b81 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:04.285885 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 384/766] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:04 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:04.292236 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4d8d6-378e-4a69-bb52-849ac3301f11 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:04.292730 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4d8d6-378e-4a69-bb52-849ac3301f11 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:04.292838 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4d8d6-378e-4a69-bb52-849ac3301f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:04.311663 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-7af4d8d6-378e-4a69-bb52-849ac3301f11 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:04.312876 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-7af4d8d6-378e-4a69-bb52-849ac3301f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:04.321227 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 383/767] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:04 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:04.345778 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d847e3b-17fc-4efc-b3a7-6c2c90c55b81 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:04.358603 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d847e3b-17fc-4efc-b3a7-6c2c90c55b81 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:04.363874 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb648fd-8c98-44d3-8fe9-f0980b13c8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:04.364734 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb648fd-8c98-44d3-8fe9-f0980b13c8ca admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:04.365015 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb648fd-8c98-44d3-8fe9-f0980b13c8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:04.365291 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb648fd-8c98-44d3-8fe9-f0980b13c8ca admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:04.366117 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb648fd-8c98-44d3-8fe9-f0980b13c8ca admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:04.367894 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb648fd-8c98-44d3-8fe9-f0980b13c8ca admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:04.380882 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-1fb648fd-8c98-44d3-8fe9-f0980b13c8ca admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 15 15:59:04.382541 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 385/768] 10.222.0.36 () {56 vars in 1150 bytes} [Wed Dec 15 15:59:04 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:04.389182 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4d8d6-378e-4a69-bb52-849ac3301f11 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:04.398897 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4d8d6-378e-4a69-bb52-849ac3301f11 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:04.403674 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5cd83-a1c0-4614-8bf1-702d7b60f174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:04.404405 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5cd83-a1c0-4614-8bf1-702d7b60f174 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:04.404687 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5cd83-a1c0-4614-8bf1-702d7b60f174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:04.404958 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5cd83-a1c0-4614-8bf1-702d7b60f174 admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:04.405782 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5cd83-a1c0-4614-8bf1-702d7b60f174 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:04.406085 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5cd83-a1c0-4614-8bf1-702d7b60f174 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:04.407724 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5cd83-a1c0-4614-8bf1-702d7b60f174 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:04.413646 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 384/769] 10.222.0.36 () {56 vars in 1145 bytes} [Wed Dec 15 15:59:04 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:04.419881 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb648fd-8c98-44d3-8fe9-f0980b13c8ca admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:04.430985 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb648fd-8c98-44d3-8fe9-f0980b13c8ca admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:04.439960 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63535f-9913-4034-82a2-f7aa27af7112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:04.441340 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63535f-9913-4034-82a2-f7aa27af7112 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:04.441644 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63535f-9913-4034-82a2-f7aa27af7112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:04.441911 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63535f-9913-4034-82a2-f7aa27af7112 admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:04.442699 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63535f-9913-4034-82a2-f7aa27af7112 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:04.443007 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63535f-9913-4034-82a2-f7aa27af7112 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:04.444663 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63535f-9913-4034-82a2-f7aa27af7112 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:04.454122 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 386/770] 10.222.0.36 () {56 vars in 1145 bytes} [Wed Dec 15 15:59:04 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:04.459991 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5cd83-a1c0-4614-8bf1-702d7b60f174 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:04.470725 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5cd83-a1c0-4614-8bf1-702d7b60f174 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:04.475967 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcac80c-3a1d-482e-8c04-ba53f067e646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:04.476711 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcac80c-3a1d-482e-8c04-ba53f067e646 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:04.476990 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcac80c-3a1d-482e-8c04-ba53f067e646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:04.477258 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcac80c-3a1d-482e-8c04-ba53f067e646 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:04.478145 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcac80c-3a1d-482e-8c04-ba53f067e646 admin admin] RBAC: Adding query filter params (interface=public, service_id=e895491aa8aa4b9796397c2390ae4a92, region_id=RegionOne) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:04.478451 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcac80c-3a1d-482e-8c04-ba53f067e646 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:04.479523 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING py.warnings [None req-0fcac80c-3a1d-482e-8c04-ba53f067e646 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:59:04.479523 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: warnings.warn(msg) Dec 15 15:59:04.479523 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: Dec 15 15:59:04.480399 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcac80c-3a1d-482e-8c04-ba53f067e646 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:04.489920 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 385/771] 10.222.0.36 () {56 vars in 1272 bytes} [Wed Dec 15 15:59:04 2021] GET /identity/v3/endpoints?service_id=e895491aa8aa4b9796397c2390ae4a92&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:04.495828 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63535f-9913-4034-82a2-f7aa27af7112 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:04.507104 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63535f-9913-4034-82a2-f7aa27af7112 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:04.512575 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00104e2e-05c6-4e89-9601-0f1cb5828b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:04.513339 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00104e2e-05c6-4e89-9601-0f1cb5828b86 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:04.513743 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00104e2e-05c6-4e89-9601-0f1cb5828b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:04.514078 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00104e2e-05c6-4e89-9601-0f1cb5828b86 admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:04.515067 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00104e2e-05c6-4e89-9601-0f1cb5828b86 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:04.517072 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00104e2e-05c6-4e89-9601-0f1cb5828b86 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:04.525754 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 387/772] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Dec 15 15:59:04 2021] GET /identity/v3/services => generated 772 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:06.164217 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ed232-2e7d-416b-8411-68f2ed369916 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.164966 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ed232-2e7d-416b-8411-68f2ed369916 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.164966 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ed232-2e7d-416b-8411-68f2ed369916 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.166886 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 386/773] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:06.173008 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe3c15-7cba-462e-a956-32bb2daf9afd None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.173810 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe3c15-7cba-462e-a956-32bb2daf9afd None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.173810 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe3c15-7cba-462e-a956-32bb2daf9afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.205830 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-4ebe3c15-7cba-462e-a956-32bb2daf9afd None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:06.207096 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-4ebe3c15-7cba-462e-a956-32bb2daf9afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:06.220114 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 388/774] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:06 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:06.246037 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ed232-2e7d-416b-8411-68f2ed369916 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:06.264998 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75ef0c-a20e-4a18-85b7-8c5c39391d49 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.265315 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75ef0c-a20e-4a18-85b7-8c5c39391d49 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.265559 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75ef0c-a20e-4a18-85b7-8c5c39391d49 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.267741 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 389/775] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:59:06.275334 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ed232-2e7d-416b-8411-68f2ed369916 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:06.276981 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50070750-d340-4a48-8e7b-2751ef5eade0 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.277277 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50070750-d340-4a48-8e7b-2751ef5eade0 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.277576 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50070750-d340-4a48-8e7b-2751ef5eade0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.284994 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d06fd6-e425-4cfc-9e3c-37c4df4bc9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:06.286009 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d06fd6-e425-4cfc-9e3c-37c4df4bc9cf admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.286302 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d06fd6-e425-4cfc-9e3c-37c4df4bc9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.286589 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d06fd6-e425-4cfc-9e3c-37c4df4bc9cf admin admin] PATH_INFO: `/v3/services/network` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.287315 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d06fd6-e425-4cfc-9e3c-37c4df4bc9cf admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:06.289266 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d06fd6-e425-4cfc-9e3c-37c4df4bc9cf admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:06.322165 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-50070750-d340-4a48-8e7b-2751ef5eade0 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:06.323729 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-50070750-d340-4a48-8e7b-2751ef5eade0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:06.325638 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-e1d06fd6-e425-4cfc-9e3c-37c4df4bc9cf admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 15 15:59:06.326918 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 387/776] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:59:06 2021] GET /identity/v3/services/network => generated 88 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:06.334303 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d06fd6-e425-4cfc-9e3c-37c4df4bc9cf admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:06.344276 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 390/777] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:06 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 15:59:06.348724 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d06fd6-e425-4cfc-9e3c-37c4df4bc9cf admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:06.361957 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09c67c-b224-4419-96f5-0f84651dfca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:06.362753 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09c67c-b224-4419-96f5-0f84651dfca3 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.363032 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09c67c-b224-4419-96f5-0f84651dfca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.363308 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09c67c-b224-4419-96f5-0f84651dfca3 admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.364038 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09c67c-b224-4419-96f5-0f84651dfca3 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:06.364540 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09c67c-b224-4419-96f5-0f84651dfca3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:06.366039 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09c67c-b224-4419-96f5-0f84651dfca3 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:06.371480 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 388/778] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Dec 15 15:59:06 2021] GET /identity/v3/services?name=network => generated 124 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:06.378610 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50070750-d340-4a48-8e7b-2751ef5eade0 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:06.379021 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09c67c-b224-4419-96f5-0f84651dfca3 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:06.395396 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50070750-d340-4a48-8e7b-2751ef5eade0 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:06.396810 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09c67c-b224-4419-96f5-0f84651dfca3 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:06.404358 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e37eb2-637e-4ca3-8490-dc9591f1c7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:06.405041 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e37eb2-637e-4ca3-8490-dc9591f1c7ce admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.405312 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e37eb2-637e-4ca3-8490-dc9591f1c7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.405617 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e37eb2-637e-4ca3-8490-dc9591f1c7ce admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.406423 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e37eb2-637e-4ca3-8490-dc9591f1c7ce admin admin] RBAC: Adding query filter params (type=network) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:06.406740 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e37eb2-637e-4ca3-8490-dc9591f1c7ce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:06.408416 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e37eb2-637e-4ca3-8490-dc9591f1c7ce admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:06.411179 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bef53-eac9-47d9-a104-958a3e7914fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:06.411988 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bef53-eac9-47d9-a104-958a3e7914fa admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.412269 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bef53-eac9-47d9-a104-958a3e7914fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.412539 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bef53-eac9-47d9-a104-958a3e7914fa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.429099 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 391/779] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Dec 15 15:59:06 2021] GET /identity/v3/services?type=network => generated 350 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:06.429858 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007bef53-eac9-47d9-a104-958a3e7914fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:59:06.441761 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-007bef53-eac9-47d9-a104-958a3e7914fa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 15:59:06.443298 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 389/780] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:59:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:06.450583 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e37eb2-637e-4ca3-8490-dc9591f1c7ce admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:06.457606 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bef53-eac9-47d9-a104-958a3e7914fa admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:06.463884 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e37eb2-637e-4ca3-8490-dc9591f1c7ce admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:06.468817 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bef53-eac9-47d9-a104-958a3e7914fa admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:06.473574 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645609b-ea92-4b9c-a5a2-7885d9dc4050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:06.474270 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645609b-ea92-4b9c-a5a2-7885d9dc4050 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.474558 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645609b-ea92-4b9c-a5a2-7885d9dc4050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.474828 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645609b-ea92-4b9c-a5a2-7885d9dc4050 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.475590 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645609b-ea92-4b9c-a5a2-7885d9dc4050 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:06.475936 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645609b-ea92-4b9c-a5a2-7885d9dc4050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:06.477347 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52603add-62ad-4e7d-80c1-28ab62f1be25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:06.477578 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645609b-ea92-4b9c-a5a2-7885d9dc4050 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:06.478883 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52603add-62ad-4e7d-80c1-28ab62f1be25 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.479604 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52603add-62ad-4e7d-80c1-28ab62f1be25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.480315 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52603add-62ad-4e7d-80c1-28ab62f1be25 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.481999 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52603add-62ad-4e7d-80c1-28ab62f1be25 admin admin] RBAC: Adding query filter params (interface=public, service_id=836ee57abef64e22ae003cad0fe96c57, region_id=RegionOne) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:06.482805 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52603add-62ad-4e7d-80c1-28ab62f1be25 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:06.484752 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING py.warnings [None req-52603add-62ad-4e7d-80c1-28ab62f1be25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:59:06.484752 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: warnings.warn(msg) Dec 15 15:59:06.484752 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: Dec 15 15:59:06.486847 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52603add-62ad-4e7d-80c1-28ab62f1be25 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:06.487537 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 390/781] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:59:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:06.491645 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9d13b-0ddc-40aa-8988-f70ae695b35e None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.491645 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9d13b-0ddc-40aa-8988-f70ae695b35e None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.491645 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9d13b-0ddc-40aa-8988-f70ae695b35e None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.491645 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 391/782] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:06.498960 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556e048-b606-4af2-8f55-a5c76d6f82f8 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.499382 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556e048-b606-4af2-8f55-a5c76d6f82f8 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.500020 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556e048-b606-4af2-8f55-a5c76d6f82f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.509779 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 392/783] 10.222.0.36 () {56 vars in 1272 bytes} [Wed Dec 15 15:59:06 2021] GET /identity/v3/endpoints?service_id=836ee57abef64e22ae003cad0fe96c57&interface=public®ion_id=RegionOne => generated 194 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:06.510833 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52603add-62ad-4e7d-80c1-28ab62f1be25 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:06.525049 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52603add-62ad-4e7d-80c1-28ab62f1be25 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:06.527374 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-8556e048-b606-4af2-8f55-a5c76d6f82f8 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:06.529035 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-8556e048-b606-4af2-8f55-a5c76d6f82f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:06.531064 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a213a-4ca0-4aeb-a694-6fd820ef6de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:06.531858 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a213a-4ca0-4aeb-a694-6fd820ef6de4 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.532152 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a213a-4ca0-4aeb-a694-6fd820ef6de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.532545 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a213a-4ca0-4aeb-a694-6fd820ef6de4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.540843 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 392/784] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:06 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:06.542624 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556e048-b606-4af2-8f55-a5c76d6f82f8 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:06.551392 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a213a-4ca0-4aeb-a694-6fd820ef6de4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:06.553615 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a213a-4ca0-4aeb-a694-6fd820ef6de4 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:06.555029 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556e048-b606-4af2-8f55-a5c76d6f82f8 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:06.560260 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82eed18-0887-4f61-9e59-c293dafbd6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:06.561235 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82eed18-0887-4f61-9e59-c293dafbd6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.561761 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82eed18-0887-4f61-9e59-c293dafbd6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.562232 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82eed18-0887-4f61-9e59-c293dafbd6f1 admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.563194 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82eed18-0887-4f61-9e59-c293dafbd6f1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:06.565168 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82eed18-0887-4f61-9e59-c293dafbd6f1 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:06.571855 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 393/785] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Dec 15 15:59:06 2021] GET /identity/v3/services => generated 772 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:06.578228 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-1e1a213a-4ca0-4aeb-a694-6fd820ef6de4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:06.578228 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 393/786] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:06.583528 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82eed18-0887-4f61-9e59-c293dafbd6f1 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:06.587887 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a213a-4ca0-4aeb-a694-6fd820ef6de4 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:06.596996 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82eed18-0887-4f61-9e59-c293dafbd6f1 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:06.600213 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a213a-4ca0-4aeb-a694-6fd820ef6de4 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:06.603122 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453ace7-a250-44a4-899a-469017af28b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:06.604221 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453ace7-a250-44a4-899a-469017af28b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.604706 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453ace7-a250-44a4-899a-469017af28b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.605178 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453ace7-a250-44a4-899a-469017af28b8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.606534 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ed77b-adcd-421f-a542-d84ef20779d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:06.607224 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ed77b-adcd-421f-a542-d84ef20779d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.607510 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ed77b-adcd-421f-a542-d84ef20779d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.607833 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ed77b-adcd-421f-a542-d84ef20779d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.608590 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ed77b-adcd-421f-a542-d84ef20779d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:06.608952 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ed77b-adcd-421f-a542-d84ef20779d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:06.610676 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ed77b-adcd-421f-a542-d84ef20779d4 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:06.619134 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453ace7-a250-44a4-899a-469017af28b8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:59:06.626662 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-c453ace7-a250-44a4-899a-469017af28b8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 15:59:06.628263 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 394/788] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Dec 15 15:59:06 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:06.633565 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 394/788] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:06.635084 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453ace7-a250-44a4-899a-469017af28b8 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:06.637321 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ed77b-adcd-421f-a542-d84ef20779d4 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:06.647208 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453ace7-a250-44a4-899a-469017af28b8 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:06.658286 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ed77b-adcd-421f-a542-d84ef20779d4 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:06.663466 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91129ba9-2afe-4a9a-afba-1e74ee9ea5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:06.664814 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91129ba9-2afe-4a9a-afba-1e74ee9ea5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.665442 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91129ba9-2afe-4a9a-afba-1e74ee9ea5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.665933 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91129ba9-2afe-4a9a-afba-1e74ee9ea5e0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.669239 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bd7b0-ff46-4e3a-8ca5-80c9b50105a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:06.670655 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bd7b0-ff46-4e3a-8ca5-80c9b50105a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.670878 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bd7b0-ff46-4e3a-8ca5-80c9b50105a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.671099 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bd7b0-ff46-4e3a-8ca5-80c9b50105a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.671921 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28bd7b0-ff46-4e3a-8ca5-80c9b50105a8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:06.672239 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28bd7b0-ff46-4e3a-8ca5-80c9b50105a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:06.673944 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28bd7b0-ff46-4e3a-8ca5-80c9b50105a8 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:06.678166 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91129ba9-2afe-4a9a-afba-1e74ee9ea5e0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:06.680827 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91129ba9-2afe-4a9a-afba-1e74ee9ea5e0 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:06.690829 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 395/789] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Dec 15 15:59:06 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:06.702572 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-91129ba9-2afe-4a9a-afba-1e74ee9ea5e0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 15:59:06.704530 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 395/790] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Dec 15 15:59:06 2021] GET /identity/v3/users/nova => generated 82 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:06.707485 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bd7b0-ff46-4e3a-8ca5-80c9b50105a8 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:06.715666 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91129ba9-2afe-4a9a-afba-1e74ee9ea5e0 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:06.726636 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bd7b0-ff46-4e3a-8ca5-80c9b50105a8 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:06.738832 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91129ba9-2afe-4a9a-afba-1e74ee9ea5e0 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:06.741457 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455692f-a784-4649-acde-238038bb397a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:06.743037 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455692f-a784-4649-acde-238038bb397a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.744072 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455692f-a784-4649-acde-238038bb397a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.745065 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455692f-a784-4649-acde-238038bb397a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.750086 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9fedc-5a0c-4244-8999-4b7bd5475711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:06.751936 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9fedc-5a0c-4244-8999-4b7bd5475711 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.753273 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9fedc-5a0c-4244-8999-4b7bd5475711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.753860 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9fedc-5a0c-4244-8999-4b7bd5475711 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.755058 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9fedc-5a0c-4244-8999-4b7bd5475711 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:06.757136 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9fedc-5a0c-4244-8999-4b7bd5475711 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:06.759442 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9fedc-5a0c-4244-8999-4b7bd5475711 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:06.771903 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455692f-a784-4649-acde-238038bb397a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:06.776828 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455692f-a784-4649-acde-238038bb397a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:06.805026 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 396/791] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Dec 15 15:59:06 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:06.812233 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9fedc-5a0c-4244-8999-4b7bd5475711 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:06.825575 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-e455692f-a784-4649-acde-238038bb397a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:06.828364 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 396/792] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:06.836064 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455692f-a784-4649-acde-238038bb397a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:06.836251 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9fedc-5a0c-4244-8999-4b7bd5475711 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:06.847274 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455692f-a784-4649-acde-238038bb397a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:06.851680 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61caaef-7ce0-4ece-98cf-c9387d118a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:06.852452 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61caaef-7ce0-4ece-98cf-c9387d118a0f admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.852737 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61caaef-7ce0-4ece-98cf-c9387d118a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.853013 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61caaef-7ce0-4ece-98cf-c9387d118a0f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.853633 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbcfe0-02bf-416a-b0d6-1dd464a055b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:06.854655 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbcfe0-02bf-416a-b0d6-1dd464a055b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.855156 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbcfe0-02bf-416a-b0d6-1dd464a055b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.855768 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbcfe0-02bf-416a-b0d6-1dd464a055b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.856776 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbcfe0-02bf-416a-b0d6-1dd464a055b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:06.857286 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbcfe0-02bf-416a-b0d6-1dd464a055b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:06.859271 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbcfe0-02bf-416a-b0d6-1dd464a055b9 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:06.872403 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61caaef-7ce0-4ece-98cf-c9387d118a0f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:06.874599 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61caaef-7ce0-4ece-98cf-c9387d118a0f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:06.878152 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 397/793] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:06.886191 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbcfe0-02bf-416a-b0d6-1dd464a055b9 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:06.888873 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 397/794] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:59:06 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 15:59:06.897560 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61caaef-7ce0-4ece-98cf-c9387d118a0f admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:06.898992 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbcfe0-02bf-416a-b0d6-1dd464a055b9 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:06.903866 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db443f1-1d41-48c1-b0ea-95ab6c8f9423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:06.904902 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db443f1-1d41-48c1-b0ea-95ab6c8f9423 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.905322 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db443f1-1d41-48c1-b0ea-95ab6c8f9423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.906104 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db443f1-1d41-48c1-b0ea-95ab6c8f9423 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.909814 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61caaef-7ce0-4ece-98cf-c9387d118a0f admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:06.915685 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db443f1-1d41-48c1-b0ea-95ab6c8f9423 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:06.918027 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db443f1-1d41-48c1-b0ea-95ab6c8f9423 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:06.920474 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24216fc-097a-41da-9181-0d378fde78bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:06.921360 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24216fc-097a-41da-9181-0d378fde78bf admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.921722 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24216fc-097a-41da-9181-0d378fde78bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.922052 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24216fc-097a-41da-9181-0d378fde78bf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.932889 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-0db443f1-1d41-48c1-b0ea-95ab6c8f9423 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 15:59:06.934464 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 398/795] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Dec 15 15:59:06 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:06.937685 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24216fc-097a-41da-9181-0d378fde78bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:06.940542 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24216fc-097a-41da-9181-0d378fde78bf admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:06.941297 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db443f1-1d41-48c1-b0ea-95ab6c8f9423 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:06.951473 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db443f1-1d41-48c1-b0ea-95ab6c8f9423 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:06.958407 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5da01-d8c1-4b4f-8af9-74d99a48d0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:06.959123 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5da01-d8c1-4b4f-8af9-74d99a48d0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.959407 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5da01-d8c1-4b4f-8af9-74d99a48d0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.959684 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5da01-d8c1-4b4f-8af9-74d99a48d0d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.960589 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5da01-d8c1-4b4f-8af9-74d99a48d0d3 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:06.960899 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5da01-d8c1-4b4f-8af9-74d99a48d0d3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:06.962999 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5da01-d8c1-4b4f-8af9-74d99a48d0d3 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:06.966308 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-e24216fc-097a-41da-9181-0d378fde78bf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:06.968579 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 398/796] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:06.975985 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24216fc-097a-41da-9181-0d378fde78bf admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:06.987295 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24216fc-097a-41da-9181-0d378fde78bf admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:06.991527 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 399/797] 10.222.0.36 () {56 vars in 1170 bytes} [Wed Dec 15 15:59:06 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:06.994106 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff983d-2c2e-4542-a962-0b1db2335b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:06.995001 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff983d-2c2e-4542-a962-0b1db2335b54 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:06.995532 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff983d-2c2e-4542-a962-0b1db2335b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:06.996090 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff983d-2c2e-4542-a962-0b1db2335b54 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:06.997601 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5da01-d8c1-4b4f-8af9-74d99a48d0d3 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:06.998608 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff983d-2c2e-4542-a962-0b1db2335b54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:06.999399 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff983d-2c2e-4542-a962-0b1db2335b54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:07.003777 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff983d-2c2e-4542-a962-0b1db2335b54 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:07.012410 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5da01-d8c1-4b4f-8af9-74d99a48d0d3 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:07.020018 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 399/798] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:07.027026 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8cd10-414f-47a6-89ae-8dc167df765d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:07.028106 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff983d-2c2e-4542-a962-0b1db2335b54 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:07.029772 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8cd10-414f-47a6-89ae-8dc167df765d admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:07.030650 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8cd10-414f-47a6-89ae-8dc167df765d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:07.034598 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8cd10-414f-47a6-89ae-8dc167df765d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:07.049059 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff983d-2c2e-4542-a962-0b1db2335b54 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:07.055247 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8cd10-414f-47a6-89ae-8dc167df765d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:07.057949 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8cd10-414f-47a6-89ae-8dc167df765d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:07.064015 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da6a8a-cfcc-49f4-8da7-9f685eb65336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:07.067210 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da6a8a-cfcc-49f4-8da7-9f685eb65336 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:07.067667 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da6a8a-cfcc-49f4-8da7-9f685eb65336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:07.070014 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da6a8a-cfcc-49f4-8da7-9f685eb65336 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:07.084218 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da6a8a-cfcc-49f4-8da7-9f685eb65336 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:07.090435 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da6a8a-cfcc-49f4-8da7-9f685eb65336 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:07.100567 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-cfe8cd10-414f-47a6-89ae-8dc167df765d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:07.103741 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 400/799] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:07.116569 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-13da6a8a-cfcc-49f4-8da7-9f685eb65336 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:59:07.118322 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 400/800] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:59:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:07.120659 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8cd10-414f-47a6-89ae-8dc167df765d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:07.131479 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da6a8a-cfcc-49f4-8da7-9f685eb65336 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:07.132441 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8cd10-414f-47a6-89ae-8dc167df765d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:07.141429 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52909c0c-a03e-4b27-8805-4ab615cbadbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:07.142892 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52909c0c-a03e-4b27-8805-4ab615cbadbb admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:07.144134 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52909c0c-a03e-4b27-8805-4ab615cbadbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:07.144889 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52909c0c-a03e-4b27-8805-4ab615cbadbb admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:07.146293 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52909c0c-a03e-4b27-8805-4ab615cbadbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:07.147971 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52909c0c-a03e-4b27-8805-4ab615cbadbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:07.153093 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52909c0c-a03e-4b27-8805-4ab615cbadbb admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:07.154882 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da6a8a-cfcc-49f4-8da7-9f685eb65336 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:07.166238 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8fa94-81ef-47e1-8bf9-ccc2f5131ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:07.167917 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8fa94-81ef-47e1-8bf9-ccc2f5131ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:07.169981 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8fa94-81ef-47e1-8bf9-ccc2f5131ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:07.172327 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8fa94-81ef-47e1-8bf9-ccc2f5131ec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:07.173309 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8fa94-81ef-47e1-8bf9-ccc2f5131ec0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:07.173783 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8fa94-81ef-47e1-8bf9-ccc2f5131ec0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:07.179297 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8fa94-81ef-47e1-8bf9-ccc2f5131ec0 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:07.185618 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 401/801] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:07.197932 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 401/802] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:59:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:07.200031 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52909c0c-a03e-4b27-8805-4ab615cbadbb admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:07.211091 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52909c0c-a03e-4b27-8805-4ab615cbadbb admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:07.212302 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8fa94-81ef-47e1-8bf9-ccc2f5131ec0 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:07.216518 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d8300-8ec4-4fbe-9056-f8e15f77e758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:07.217304 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d8300-8ec4-4fbe-9056-f8e15f77e758 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:07.217610 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d8300-8ec4-4fbe-9056-f8e15f77e758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:07.217882 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d8300-8ec4-4fbe-9056-f8e15f77e758 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:07.224101 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8fa94-81ef-47e1-8bf9-ccc2f5131ec0 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:07.226202 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d8300-8ec4-4fbe-9056-f8e15f77e758 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:07.228620 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d8300-8ec4-4fbe-9056-f8e15f77e758 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:07.229600 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308ec27-b12d-40f6-9553-e53ab1489152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:07.230433 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308ec27-b12d-40f6-9553-e53ab1489152 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:07.230925 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308ec27-b12d-40f6-9553-e53ab1489152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:07.231345 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308ec27-b12d-40f6-9553-e53ab1489152 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:07.232421 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308ec27-b12d-40f6-9553-e53ab1489152 admin admin] RBAC: Adding query filter params (role.id=bc362f875c6d4cee83ba65b8d134462d, scope.project.id=bc314fbc91c54810b27f9fcad7129c64, user.id=bc13934328e742f9a1a85d1c84ab83dd) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:07.232890 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308ec27-b12d-40f6-9553-e53ab1489152 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:07.235030 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308ec27-b12d-40f6-9553-e53ab1489152 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:07.242122 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 402/803] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:59:07 2021] GET /identity/v3/role_assignments?user.id=bc13934328e742f9a1a85d1c84ab83dd&scope.project.id=bc314fbc91c54810b27f9fcad7129c64&role.id=bc362f875c6d4cee83ba65b8d134462d => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:07.242964 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-a51d8300-8ec4-4fbe-9056-f8e15f77e758 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:59:07.243718 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746c1a0-d7d8-447c-866d-9abf18915a23 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:07.244223 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746c1a0-d7d8-447c-866d-9abf18915a23 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:07.244334 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 402/804] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:59:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:07.244719 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746c1a0-d7d8-447c-866d-9abf18915a23 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:07.251463 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 403/805] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:07.254778 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d8300-8ec4-4fbe-9056-f8e15f77e758 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:07.260359 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ede2b-9efe-49c7-b0e9-822d1650ad56 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:07.260926 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ede2b-9efe-49c7-b0e9-822d1650ad56 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:07.261347 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ede2b-9efe-49c7-b0e9-822d1650ad56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:07.276942 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d8300-8ec4-4fbe-9056-f8e15f77e758 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:07.282826 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-463ede2b-9efe-49c7-b0e9-822d1650ad56 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:07.285606 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-463ede2b-9efe-49c7-b0e9-822d1650ad56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:07.286109 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c8f6a-1501-46bc-af52-1f9465e8fd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:07.286780 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c8f6a-1501-46bc-af52-1f9465e8fd22 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:07.287099 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c8f6a-1501-46bc-af52-1f9465e8fd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:07.287436 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c8f6a-1501-46bc-af52-1f9465e8fd22 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:07.288253 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c8f6a-1501-46bc-af52-1f9465e8fd22 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:07.288658 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c8f6a-1501-46bc-af52-1f9465e8fd22 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:07.294224 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c8f6a-1501-46bc-af52-1f9465e8fd22 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:07.304368 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 404/806] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:07 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 15:59:07.320893 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 403/807] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:59:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:07.327751 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ede2b-9efe-49c7-b0e9-822d1650ad56 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:07.339298 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ede2b-9efe-49c7-b0e9-822d1650ad56 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:07.348571 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8439db1-572b-4f44-ad8d-2187cc0a99d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:07.349813 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8439db1-572b-4f44-ad8d-2187cc0a99d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:07.350295 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8439db1-572b-4f44-ad8d-2187cc0a99d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:07.350793 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8439db1-572b-4f44-ad8d-2187cc0a99d6 admin admin] PATH_INFO: `/v3/projects/bc314fbc91c54810b27f9fcad7129c64/users/b2f47cbf62d44a6ba7e6a6f0f2305630/roles/17e6533ce814487c9a8fb0ee2acaad32` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:07.371714 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8439db1-572b-4f44-ad8d-2187cc0a99d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc314fbc91c54810b27f9fcad7129c64, user_id=b2f47cbf62d44a6ba7e6a6f0f2305630, role_id=17e6533ce814487c9a8fb0ee2acaad32)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:07.374859 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8439db1-572b-4f44-ad8d-2187cc0a99d6 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:07.377858 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c8f6a-1501-46bc-af52-1f9465e8fd22 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:07.391898 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c8f6a-1501-46bc-af52-1f9465e8fd22 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:07.396327 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 405/808] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Dec 15 15:59:07 2021] PUT /identity/v3/projects/bc314fbc91c54810b27f9fcad7129c64/users/b2f47cbf62d44a6ba7e6a6f0f2305630/roles/17e6533ce814487c9a8fb0ee2acaad32 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 15:59:07.488051 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161331ef-4bd2-4b2f-aa68-4e8d7fc4aade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:07.489123 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161331ef-4bd2-4b2f-aa68-4e8d7fc4aade admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:07.489582 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161331ef-4bd2-4b2f-aa68-4e8d7fc4aade admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:07.490034 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161331ef-4bd2-4b2f-aa68-4e8d7fc4aade admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:07.502139 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161331ef-4bd2-4b2f-aa68-4e8d7fc4aade admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:59:07.510335 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-161331ef-4bd2-4b2f-aa68-4e8d7fc4aade admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 15:59:07.511947 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 404/809] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:59:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 135 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:07.518648 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8439db1-572b-4f44-ad8d-2187cc0a99d6 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:07.536115 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8439db1-572b-4f44-ad8d-2187cc0a99d6 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:07.547049 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360820f-fc01-471f-99fe-5d665753d0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:07.548194 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360820f-fc01-471f-99fe-5d665753d0eb admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:07.548679 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360820f-fc01-471f-99fe-5d665753d0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:07.549150 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360820f-fc01-471f-99fe-5d665753d0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:07.550785 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360820f-fc01-471f-99fe-5d665753d0eb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:07.551339 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360820f-fc01-471f-99fe-5d665753d0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:07.553324 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360820f-fc01-471f-99fe-5d665753d0eb admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:07.564347 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 406/810] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:59:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:07.570569 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161331ef-4bd2-4b2f-aa68-4e8d7fc4aade admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:07.586390 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161331ef-4bd2-4b2f-aa68-4e8d7fc4aade admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:07.593351 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c67c0c-b42b-412d-ba2f-b76f9762efbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:07.594139 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c67c0c-b42b-412d-ba2f-b76f9762efbe admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:07.594422 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c67c0c-b42b-412d-ba2f-b76f9762efbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:07.594696 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c67c0c-b42b-412d-ba2f-b76f9762efbe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:07.611659 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c67c0c-b42b-412d-ba2f-b76f9762efbe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:07.614398 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c67c0c-b42b-412d-ba2f-b76f9762efbe admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:07.637004 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-c1c67c0c-b42b-412d-ba2f-b76f9762efbe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:07.638646 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 405/811] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:07.645039 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360820f-fc01-471f-99fe-5d665753d0eb admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:07.663192 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360820f-fc01-471f-99fe-5d665753d0eb admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:07.669764 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a6a76-bb41-46af-8583-d6be0a32c0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:07.670438 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a6a76-bb41-46af-8583-d6be0a32c0fa admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:07.670718 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a6a76-bb41-46af-8583-d6be0a32c0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:07.670990 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a6a76-bb41-46af-8583-d6be0a32c0fa admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:07.671739 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a6a76-bb41-46af-8583-d6be0a32c0fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:07.672045 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a6a76-bb41-46af-8583-d6be0a32c0fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:07.674140 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a6a76-bb41-46af-8583-d6be0a32c0fa admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:07.697557 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 407/812] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:07.703910 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c67c0c-b42b-412d-ba2f-b76f9762efbe admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:07.715911 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c67c0c-b42b-412d-ba2f-b76f9762efbe admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:07.720626 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4d0ff-fd52-4f11-a4e7-c8654d4697e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:07.722223 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4d0ff-fd52-4f11-a4e7-c8654d4697e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:07.722512 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4d0ff-fd52-4f11-a4e7-c8654d4697e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:07.722794 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4d0ff-fd52-4f11-a4e7-c8654d4697e7 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:07.735666 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4d0ff-fd52-4f11-a4e7-c8654d4697e7 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:07.738496 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4d0ff-fd52-4f11-a4e7-c8654d4697e7 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:07.754256 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-e4d4d0ff-fd52-4f11-a4e7-c8654d4697e7 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 15:59:07.755833 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 406/813] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:59:07 2021] GET /identity/v3/users/swift => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:07.762032 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a6a76-bb41-46af-8583-d6be0a32c0fa admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:07.785606 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a6a76-bb41-46af-8583-d6be0a32c0fa admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:07.798132 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709979f-87d7-40b1-84af-679ed85df55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:07.798861 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709979f-87d7-40b1-84af-679ed85df55c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:07.799145 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709979f-87d7-40b1-84af-679ed85df55c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:07.800055 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709979f-87d7-40b1-84af-679ed85df55c admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:07.800949 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709979f-87d7-40b1-84af-679ed85df55c admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:07.801316 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709979f-87d7-40b1-84af-679ed85df55c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:07.803305 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709979f-87d7-40b1-84af-679ed85df55c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:07.822679 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 408/814] 10.222.0.36 () {56 vars in 1156 bytes} [Wed Dec 15 15:59:07 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:07.829013 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4d0ff-fd52-4f11-a4e7-c8654d4697e7 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:07.860184 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4d0ff-fd52-4f11-a4e7-c8654d4697e7 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:07.869339 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f67943-4d84-4038-9956-c118a594fbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:07.870171 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f67943-4d84-4038-9956-c118a594fbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:07.870452 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f67943-4d84-4038-9956-c118a594fbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:07.870725 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f67943-4d84-4038-9956-c118a594fbe1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:07.884157 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f67943-4d84-4038-9956-c118a594fbe1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:07.886345 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f67943-4d84-4038-9956-c118a594fbe1 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:07.910655 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-a7f67943-4d84-4038-9956-c118a594fbe1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:07.912205 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 407/815] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:07.918522 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709979f-87d7-40b1-84af-679ed85df55c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:07.934789 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709979f-87d7-40b1-84af-679ed85df55c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:07.942846 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d5041-8cdd-403d-aba9-cf216766d9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:07.943809 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d5041-8cdd-403d-aba9-cf216766d9ec admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:07.944352 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d5041-8cdd-403d-aba9-cf216766d9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:07.944816 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d5041-8cdd-403d-aba9-cf216766d9ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:07.945839 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d5041-8cdd-403d-aba9-cf216766d9ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:07.946350 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d5041-8cdd-403d-aba9-cf216766d9ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:07.948271 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d5041-8cdd-403d-aba9-cf216766d9ec admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:07.964894 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 409/816] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:07.971493 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f67943-4d84-4038-9956-c118a594fbe1 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:07.982698 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f67943-4d84-4038-9956-c118a594fbe1 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:07.993743 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395a52f-c7c2-44c1-8600-44954e8a6762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:07.994893 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395a52f-c7c2-44c1-8600-44954e8a6762 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:07.995389 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395a52f-c7c2-44c1-8600-44954e8a6762 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:07.995853 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395a52f-c7c2-44c1-8600-44954e8a6762 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:08.007889 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395a52f-c7c2-44c1-8600-44954e8a6762 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:08.010286 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395a52f-c7c2-44c1-8600-44954e8a6762 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:08.013465 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64ddd7-240a-4ece-b372-d53ead5389e2 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:08.013969 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64ddd7-240a-4ece-b372-d53ead5389e2 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:08.014495 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64ddd7-240a-4ece-b372-d53ead5389e2 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:08.016560 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 410/817] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:59:08.022729 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b23e6-558f-49bc-99d3-da6bedd4c5a0 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:08.023018 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b23e6-558f-49bc-99d3-da6bedd4c5a0 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:08.023302 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b23e6-558f-49bc-99d3-da6bedd4c5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:08.035557 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-e395a52f-c7c2-44c1-8600-44954e8a6762 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:59:08.041740 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 408/818] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:59:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:08.044641 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-1b1b23e6-558f-49bc-99d3-da6bedd4c5a0 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:08.044641 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-1b1b23e6-558f-49bc-99d3-da6bedd4c5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:08.045912 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395a52f-c7c2-44c1-8600-44954e8a6762 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:08.059871 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 411/819] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:08 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 15:59:08.068222 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395a52f-c7c2-44c1-8600-44954e8a6762 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:08.083481 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81270926-c3e4-45a3-8b5d-3698e3bd1754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:08.084145 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81270926-c3e4-45a3-8b5d-3698e3bd1754 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:08.084316 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b23e6-558f-49bc-99d3-da6bedd4c5a0 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:08.084450 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81270926-c3e4-45a3-8b5d-3698e3bd1754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:08.084683 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81270926-c3e4-45a3-8b5d-3698e3bd1754 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:08.085506 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81270926-c3e4-45a3-8b5d-3698e3bd1754 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:08.085818 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81270926-c3e4-45a3-8b5d-3698e3bd1754 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:08.087656 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81270926-c3e4-45a3-8b5d-3698e3bd1754 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:08.093692 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b23e6-558f-49bc-99d3-da6bedd4c5a0 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:08.104974 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20315cdd-d886-4f9e-bfc2-919b4088c7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:08.105819 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20315cdd-d886-4f9e-bfc2-919b4088c7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:08.106107 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20315cdd-d886-4f9e-bfc2-919b4088c7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:08.106383 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20315cdd-d886-4f9e-bfc2-919b4088c7e8 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:08.107057 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20315cdd-d886-4f9e-bfc2-919b4088c7e8 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:08.108683 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20315cdd-d886-4f9e-bfc2-919b4088c7e8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:08.116717 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 409/820] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:59:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:08.122003 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81270926-c3e4-45a3-8b5d-3698e3bd1754 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:08.130930 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-20315cdd-d886-4f9e-bfc2-919b4088c7e8 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 15 15:59:08.132672 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 412/821] 10.222.0.36 () {56 vars in 1150 bytes} [Wed Dec 15 15:59:08 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:08.139438 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81270926-c3e4-45a3-8b5d-3698e3bd1754 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:08.144982 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314422f-6804-4361-844f-26d093a5e78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:08.146197 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314422f-6804-4361-844f-26d093a5e78f admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:08.146673 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314422f-6804-4361-844f-26d093a5e78f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:08.147160 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314422f-6804-4361-844f-26d093a5e78f admin admin] PATH_INFO: `/v3/projects/bc314fbc91c54810b27f9fcad7129c64/users/5e3f652f76424e27a1d4329212d9b66d/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:08.149643 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314422f-6804-4361-844f-26d093a5e78f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc314fbc91c54810b27f9fcad7129c64, user_id=5e3f652f76424e27a1d4329212d9b66d, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:08.153121 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314422f-6804-4361-844f-26d093a5e78f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:08.160729 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20315cdd-d886-4f9e-bfc2-919b4088c7e8 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:08.175368 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20315cdd-d886-4f9e-bfc2-919b4088c7e8 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:08.187777 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43baad7-78f4-460e-b937-1811a3e8db05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:08.188864 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 410/822] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Dec 15 15:59:08 2021] PUT /identity/v3/projects/bc314fbc91c54810b27f9fcad7129c64/users/5e3f652f76424e27a1d4329212d9b66d/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 15:59:08.190792 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43baad7-78f4-460e-b937-1811a3e8db05 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:08.191292 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43baad7-78f4-460e-b937-1811a3e8db05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:08.197427 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43baad7-78f4-460e-b937-1811a3e8db05 admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:08.198797 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43baad7-78f4-460e-b937-1811a3e8db05 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:08.199396 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43baad7-78f4-460e-b937-1811a3e8db05 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:08.201547 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43baad7-78f4-460e-b937-1811a3e8db05 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:08.207892 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 413/823] 10.222.0.36 () {56 vars in 1145 bytes} [Wed Dec 15 15:59:08 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:08.221449 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314422f-6804-4361-844f-26d093a5e78f admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:08.334872 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314422f-6804-4361-844f-26d093a5e78f admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:08.340616 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67854b93-f12e-4a23-8453-b3c8fb080a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:08.341308 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67854b93-f12e-4a23-8453-b3c8fb080a49 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:08.341621 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67854b93-f12e-4a23-8453-b3c8fb080a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:08.341899 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67854b93-f12e-4a23-8453-b3c8fb080a49 admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:08.342652 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67854b93-f12e-4a23-8453-b3c8fb080a49 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:08.342963 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67854b93-f12e-4a23-8453-b3c8fb080a49 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:08.344605 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67854b93-f12e-4a23-8453-b3c8fb080a49 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:08.352026 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 411/824] 10.222.0.36 () {56 vars in 1145 bytes} [Wed Dec 15 15:59:08 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:08.358230 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43baad7-78f4-460e-b937-1811a3e8db05 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:08.375562 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43baad7-78f4-460e-b937-1811a3e8db05 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:08.381771 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5d7e6-af29-449d-906b-939b34d83609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:08.389420 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5d7e6-af29-449d-906b-939b34d83609 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:08.390334 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5d7e6-af29-449d-906b-939b34d83609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:08.390837 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5d7e6-af29-449d-906b-939b34d83609 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:08.391918 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5d7e6-af29-449d-906b-939b34d83609 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:08.393863 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING py.warnings [None req-c9a5d7e6-af29-449d-906b-939b34d83609 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:59:08.393863 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: warnings.warn(msg) Dec 15 15:59:08.393863 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: Dec 15 15:59:08.395279 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5d7e6-af29-449d-906b-939b34d83609 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:08.426478 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 414/825] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Dec 15 15:59:08 2021] POST /identity/v3/endpoints => generated 346 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:59:09.472026 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb66d30-0c92-4ddb-ba7f-7cad12d99b14 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:09.472587 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb66d30-0c92-4ddb-ba7f-7cad12d99b14 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:09.472587 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb66d30-0c92-4ddb-ba7f-7cad12d99b14 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:09.474673 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 412/826] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:09.480383 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff75a4-9fd7-4fbf-b4bf-1b587c1cd569 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:09.480843 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff75a4-9fd7-4fbf-b4bf-1b587c1cd569 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:09.480938 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff75a4-9fd7-4fbf-b4bf-1b587c1cd569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:09.506352 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-11ff75a4-9fd7-4fbf-b4bf-1b587c1cd569 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:09.507557 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-11ff75a4-9fd7-4fbf-b4bf-1b587c1cd569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:09.527302 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 415/827] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:09 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:09.567616 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb66d30-0c92-4ddb-ba7f-7cad12d99b14 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:09.582980 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb66d30-0c92-4ddb-ba7f-7cad12d99b14 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:09.593267 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61189b8b-4691-48be-80b4-a18d35e49055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:09.594093 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61189b8b-4691-48be-80b4-a18d35e49055 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:09.594379 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61189b8b-4691-48be-80b4-a18d35e49055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:09.594656 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61189b8b-4691-48be-80b4-a18d35e49055 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:09.595330 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61189b8b-4691-48be-80b4-a18d35e49055 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:09.597575 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61189b8b-4691-48be-80b4-a18d35e49055 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:09.611588 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-61189b8b-4691-48be-80b4-a18d35e49055 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 15 15:59:09.612781 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 413/828] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:59:09 2021] GET /identity/v3/services/network => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:09.619113 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff75a4-9fd7-4fbf-b4bf-1b587c1cd569 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:09.634384 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff75a4-9fd7-4fbf-b4bf-1b587c1cd569 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:09.642553 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa003c8-6dd2-4c4a-a0c7-bedd7e260166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:09.643780 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa003c8-6dd2-4c4a-a0c7-bedd7e260166 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:09.644060 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa003c8-6dd2-4c4a-a0c7-bedd7e260166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:09.644331 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa003c8-6dd2-4c4a-a0c7-bedd7e260166 admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:09.645059 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa003c8-6dd2-4c4a-a0c7-bedd7e260166 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:09.645362 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa003c8-6dd2-4c4a-a0c7-bedd7e260166 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:09.647006 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa003c8-6dd2-4c4a-a0c7-bedd7e260166 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:09.657722 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 416/829] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Dec 15 15:59:09 2021] GET /identity/v3/services?name=network => generated 124 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:09.664770 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61189b8b-4691-48be-80b4-a18d35e49055 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:09.675363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61189b8b-4691-48be-80b4-a18d35e49055 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:09.685678 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89641dc5-e381-4e7c-bd99-9fd4d7ead286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:09.686342 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89641dc5-e381-4e7c-bd99-9fd4d7ead286 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:09.686625 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89641dc5-e381-4e7c-bd99-9fd4d7ead286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:09.686901 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89641dc5-e381-4e7c-bd99-9fd4d7ead286 admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:09.687627 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89641dc5-e381-4e7c-bd99-9fd4d7ead286 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:09.687931 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89641dc5-e381-4e7c-bd99-9fd4d7ead286 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:09.689549 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89641dc5-e381-4e7c-bd99-9fd4d7ead286 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:09.695025 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 414/830] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Dec 15 15:59:09 2021] GET /identity/v3/services?type=network => generated 350 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:09.701212 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa003c8-6dd2-4c4a-a0c7-bedd7e260166 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:09.714509 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa003c8-6dd2-4c4a-a0c7-bedd7e260166 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:09.722092 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af868ed4-577b-45cf-b62c-62c13ab31554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:09.722774 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af868ed4-577b-45cf-b62c-62c13ab31554 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:09.723056 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af868ed4-577b-45cf-b62c-62c13ab31554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:09.723329 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af868ed4-577b-45cf-b62c-62c13ab31554 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:09.724096 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af868ed4-577b-45cf-b62c-62c13ab31554 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:09.725726 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af868ed4-577b-45cf-b62c-62c13ab31554 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:09.748707 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 417/831] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Dec 15 15:59:09 2021] POST /identity/v3/endpoints => generated 327 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:59:10.301552 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928ede1-a8cc-4b6d-8458-e3aabe00f2ba None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:10.301552 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928ede1-a8cc-4b6d-8458-e3aabe00f2ba None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:10.301552 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928ede1-a8cc-4b6d-8458-e3aabe00f2ba None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:10.302565 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 415/832] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:10 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:10.311238 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebcb0b-26dd-4cf2-8374-68f9d702a762 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:10.311962 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebcb0b-26dd-4cf2-8374-68f9d702a762 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:10.312626 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebcb0b-26dd-4cf2-8374-68f9d702a762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:10.344102 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-e5ebcb0b-26dd-4cf2-8374-68f9d702a762 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:10.347132 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-e5ebcb0b-26dd-4cf2-8374-68f9d702a762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:10.372258 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 418/833] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:10 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:10.407450 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928ede1-a8cc-4b6d-8458-e3aabe00f2ba None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:10.430060 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928ede1-a8cc-4b6d-8458-e3aabe00f2ba None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:10.438037 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663ce1a-5c2d-4d77-8ab8-50bf4573a7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:10.439495 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663ce1a-5c2d-4d77-8ab8-50bf4573a7af admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:10.440203 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663ce1a-5c2d-4d77-8ab8-50bf4573a7af admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:10.440875 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663ce1a-5c2d-4d77-8ab8-50bf4573a7af admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:10.463316 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663ce1a-5c2d-4d77-8ab8-50bf4573a7af admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:59:10.477923 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-0663ce1a-5c2d-4d77-8ab8-50bf4573a7af admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 15:59:10.481001 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 416/834] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Dec 15 15:59:10 2021] GET /identity/v3/roles/service => generated 85 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:10.489980 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ebcb0b-26dd-4cf2-8374-68f9d702a762 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:10.503932 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ebcb0b-26dd-4cf2-8374-68f9d702a762 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:10.510644 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df7cc9-7ed5-4f1e-9e8e-0662acec3b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:10.511938 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df7cc9-7ed5-4f1e-9e8e-0662acec3b91 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:10.512613 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df7cc9-7ed5-4f1e-9e8e-0662acec3b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:10.513302 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df7cc9-7ed5-4f1e-9e8e-0662acec3b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:10.514780 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df7cc9-7ed5-4f1e-9e8e-0662acec3b91 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:10.515484 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df7cc9-7ed5-4f1e-9e8e-0662acec3b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:10.518715 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df7cc9-7ed5-4f1e-9e8e-0662acec3b91 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:10.535258 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 419/835] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Dec 15 15:59:10 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:10.544142 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663ce1a-5c2d-4d77-8ab8-50bf4573a7af admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:10.560059 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663ce1a-5c2d-4d77-8ab8-50bf4573a7af admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:10.566366 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c882446-4d69-406c-9947-2e6a49158e8c None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:10.567225 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c882446-4d69-406c-9947-2e6a49158e8c None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:10.567914 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c882446-4d69-406c-9947-2e6a49158e8c None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:10.568829 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cca1d5-99e9-46aa-948b-6e17148092ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:10.569641 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cca1d5-99e9-46aa-948b-6e17148092ce admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:10.569922 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cca1d5-99e9-46aa-948b-6e17148092ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:10.570199 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cca1d5-99e9-46aa-948b-6e17148092ce admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:10.572095 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 420/836] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:10 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:59:10.585505 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091df3d-df10-4f42-b1c6-57006127af18 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:10.586167 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091df3d-df10-4f42-b1c6-57006127af18 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:10.586664 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091df3d-df10-4f42-b1c6-57006127af18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:10.588895 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cca1d5-99e9-46aa-948b-6e17148092ce admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:10.590828 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cca1d5-99e9-46aa-948b-6e17148092ce admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:10.610759 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-d091df3d-df10-4f42-b1c6-57006127af18 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:10.611402 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-94cca1d5-99e9-46aa-948b-6e17148092ce admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:10.613008 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-d091df3d-df10-4f42-b1c6-57006127af18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:10.613200 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 417/837] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:10.621877 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cca1d5-99e9-46aa-948b-6e17148092ce admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:10.627903 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 421/838] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:10 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:10.642657 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cca1d5-99e9-46aa-948b-6e17148092ce admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:10.649835 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c7832-0bda-4c1f-a5cf-636c0ebef2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:10.652626 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c7832-0bda-4c1f-a5cf-636c0ebef2ec admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:10.653272 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c7832-0bda-4c1f-a5cf-636c0ebef2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:10.653991 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c7832-0bda-4c1f-a5cf-636c0ebef2ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:10.655466 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c7832-0bda-4c1f-a5cf-636c0ebef2ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:10.656031 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c7832-0bda-4c1f-a5cf-636c0ebef2ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:10.656222 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091df3d-df10-4f42-b1c6-57006127af18 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:10.659418 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c7832-0bda-4c1f-a5cf-636c0ebef2ec admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:10.666954 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091df3d-df10-4f42-b1c6-57006127af18 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:10.672310 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de9774-f3eb-44e1-89ea-49a8d68711fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:10.672938 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de9774-f3eb-44e1-89ea-49a8d68711fd admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:10.673329 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de9774-f3eb-44e1-89ea-49a8d68711fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:10.673746 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de9774-f3eb-44e1-89ea-49a8d68711fd admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:10.675197 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de9774-f3eb-44e1-89ea-49a8d68711fd admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:10.676909 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de9774-f3eb-44e1-89ea-49a8d68711fd admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:10.678537 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 418/839] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:10.685310 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c7832-0bda-4c1f-a5cf-636c0ebef2ec admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:10.692702 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-84de9774-f3eb-44e1-89ea-49a8d68711fd admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 15 15:59:10.697126 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c7832-0bda-4c1f-a5cf-636c0ebef2ec admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:10.699526 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 422/840] 10.222.0.36 () {56 vars in 1153 bytes} [Wed Dec 15 15:59:10 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:10.700935 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de9774-f3eb-44e1-89ea-49a8d68711fd admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:10.702754 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94bdaf-b14b-4ab1-b35e-d20ce1094176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:10.703889 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94bdaf-b14b-4ab1-b35e-d20ce1094176 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:10.704463 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94bdaf-b14b-4ab1-b35e-d20ce1094176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:10.704994 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94bdaf-b14b-4ab1-b35e-d20ce1094176 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:10.712373 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de9774-f3eb-44e1-89ea-49a8d68711fd admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:10.716823 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94bdaf-b14b-4ab1-b35e-d20ce1094176 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:10.717440 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d637b-d619-4ac8-a3ce-3b5deadfc0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:10.718263 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d637b-d619-4ac8-a3ce-3b5deadfc0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:10.718691 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d637b-d619-4ac8-a3ce-3b5deadfc0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:10.719119 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d637b-d619-4ac8-a3ce-3b5deadfc0d3 admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:10.719935 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d637b-d619-4ac8-a3ce-3b5deadfc0d3 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:10.720124 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94bdaf-b14b-4ab1-b35e-d20ce1094176 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:10.720479 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d637b-d619-4ac8-a3ce-3b5deadfc0d3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:10.723247 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d637b-d619-4ac8-a3ce-3b5deadfc0d3 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:10.733495 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 423/841] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Dec 15 15:59:10 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:10.734706 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d637b-d619-4ac8-a3ce-3b5deadfc0d3 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:10.738584 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-1d94bdaf-b14b-4ab1-b35e-d20ce1094176 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 15:59:10.740212 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 419/842] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Dec 15 15:59:10 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:10.746263 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d637b-d619-4ac8-a3ce-3b5deadfc0d3 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:10.747503 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94bdaf-b14b-4ab1-b35e-d20ce1094176 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:10.751347 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd149a-b1d5-47d3-ae1c-6a55ce3f9fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:10.752216 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd149a-b1d5-47d3-ae1c-6a55ce3f9fcc admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:10.752725 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd149a-b1d5-47d3-ae1c-6a55ce3f9fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:10.753187 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd149a-b1d5-47d3-ae1c-6a55ce3f9fcc admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:10.754179 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd149a-b1d5-47d3-ae1c-6a55ce3f9fcc admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:10.754613 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd149a-b1d5-47d3-ae1c-6a55ce3f9fcc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:10.756860 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd149a-b1d5-47d3-ae1c-6a55ce3f9fcc admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:10.760687 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94bdaf-b14b-4ab1-b35e-d20ce1094176 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:10.765509 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 424/843] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Dec 15 15:59:10 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:10.772775 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14dabb-bf1e-4d1e-82fe-559ca8730885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:10.773915 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14dabb-bf1e-4d1e-82fe-559ca8730885 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:10.774439 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14dabb-bf1e-4d1e-82fe-559ca8730885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:10.775000 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14dabb-bf1e-4d1e-82fe-559ca8730885 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:10.776316 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14dabb-bf1e-4d1e-82fe-559ca8730885 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:10.777203 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14dabb-bf1e-4d1e-82fe-559ca8730885 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:10.779817 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14dabb-bf1e-4d1e-82fe-559ca8730885 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:10.804075 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 420/844] 10.222.0.36 () {56 vars in 1170 bytes} [Wed Dec 15 15:59:10 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:10.811616 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd149a-b1d5-47d3-ae1c-6a55ce3f9fcc admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:10.822893 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd149a-b1d5-47d3-ae1c-6a55ce3f9fcc admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:10.828206 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aefd17-b066-4a63-a619-f93e08ed27d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:10.829499 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aefd17-b066-4a63-a619-f93e08ed27d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:10.830077 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aefd17-b066-4a63-a619-f93e08ed27d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:10.831101 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aefd17-b066-4a63-a619-f93e08ed27d9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:10.840811 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aefd17-b066-4a63-a619-f93e08ed27d9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:10.842930 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aefd17-b066-4a63-a619-f93e08ed27d9 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:10.856285 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 425/845] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:59:10 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 15:59:10.864564 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14dabb-bf1e-4d1e-82fe-559ca8730885 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:10.875933 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14dabb-bf1e-4d1e-82fe-559ca8730885 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:10.881129 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cae55-042c-48dd-8c49-6dd45153bf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:10.882412 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cae55-042c-48dd-8c49-6dd45153bf68 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:10.883004 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cae55-042c-48dd-8c49-6dd45153bf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:10.883507 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cae55-042c-48dd-8c49-6dd45153bf68 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:10.897649 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214cae55-042c-48dd-8c49-6dd45153bf68 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:10.900074 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214cae55-042c-48dd-8c49-6dd45153bf68 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:10.926005 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-214cae55-042c-48dd-8c49-6dd45153bf68 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:10.929078 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 421/846] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:10.937612 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aefd17-b066-4a63-a619-f93e08ed27d9 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:10.948025 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aefd17-b066-4a63-a619-f93e08ed27d9 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:10.953125 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a551c-c6d4-48e4-9c34-b6eb58d3bec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:10.954365 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a551c-c6d4-48e4-9c34-b6eb58d3bec7 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:10.954971 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a551c-c6d4-48e4-9c34-b6eb58d3bec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:10.955697 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a551c-c6d4-48e4-9c34-b6eb58d3bec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:10.956984 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a551c-c6d4-48e4-9c34-b6eb58d3bec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:10.957655 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a551c-c6d4-48e4-9c34-b6eb58d3bec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:10.959953 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a551c-c6d4-48e4-9c34-b6eb58d3bec7 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:10.975155 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 426/847] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:10.982391 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cae55-042c-48dd-8c49-6dd45153bf68 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:10.994833 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cae55-042c-48dd-8c49-6dd45153bf68 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:11.000399 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b602abb-cf4f-4d41-b047-129bca38c00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:11.001291 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b602abb-cf4f-4d41-b047-129bca38c00c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:11.001667 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b602abb-cf4f-4d41-b047-129bca38c00c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:11.001977 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b602abb-cf4f-4d41-b047-129bca38c00c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:11.011129 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b602abb-cf4f-4d41-b047-129bca38c00c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:11.013349 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b602abb-cf4f-4d41-b047-129bca38c00c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:11.027804 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-6b602abb-cf4f-4d41-b047-129bca38c00c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:59:11.029346 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 422/848] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:59:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:11.036596 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a551c-c6d4-48e4-9c34-b6eb58d3bec7 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:11.050230 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402b9ec-79d7-4942-95de-58f43d81e2ac None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:11.050524 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402b9ec-79d7-4942-95de-58f43d81e2ac None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:11.050806 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402b9ec-79d7-4942-95de-58f43d81e2ac None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:11.053001 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a551c-c6d4-48e4-9c34-b6eb58d3bec7 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:11.053154 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 423/849] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:59:11.061427 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de25dd3-3dea-4743-9a59-b896f90bfdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:11.061427 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de25dd3-3dea-4743-9a59-b896f90bfdf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:11.061427 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de25dd3-3dea-4743-9a59-b896f90bfdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:11.061830 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44830aa-234d-411c-900f-b0f9e9eb44d1 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:11.061915 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de25dd3-3dea-4743-9a59-b896f90bfdf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:11.061992 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44830aa-234d-411c-900f-b0f9e9eb44d1 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:11.061992 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44830aa-234d-411c-900f-b0f9e9eb44d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:11.062114 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de25dd3-3dea-4743-9a59-b896f90bfdf0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:11.062114 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de25dd3-3dea-4743-9a59-b896f90bfdf0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:11.062736 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de25dd3-3dea-4743-9a59-b896f90bfdf0 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:11.080114 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-f44830aa-234d-411c-900f-b0f9e9eb44d1 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:11.080431 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 427/850] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:59:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:11.081705 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f44830aa-234d-411c-900f-b0f9e9eb44d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:11.087730 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de25dd3-3dea-4743-9a59-b896f90bfdf0 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:11.090654 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 424/851] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:11 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 15:59:11.099013 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de25dd3-3dea-4743-9a59-b896f90bfdf0 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:11.104300 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951ca72-c051-4e3e-a484-4d516eee4da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:11.105180 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951ca72-c051-4e3e-a484-4d516eee4da2 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:11.105652 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951ca72-c051-4e3e-a484-4d516eee4da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:11.106090 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951ca72-c051-4e3e-a484-4d516eee4da2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:11.107067 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5951ca72-c051-4e3e-a484-4d516eee4da2 admin admin] RBAC: Adding query filter params (role.id=17e6533ce814487c9a8fb0ee2acaad32, scope.project.id=bc314fbc91c54810b27f9fcad7129c64, user.id=b2f47cbf62d44a6ba7e6a6f0f2305630) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:11.107521 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5951ca72-c051-4e3e-a484-4d516eee4da2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:11.109526 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5951ca72-c051-4e3e-a484-4d516eee4da2 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:11.116219 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44830aa-234d-411c-900f-b0f9e9eb44d1 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:11.117929 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 428/852] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:59:11 2021] GET /identity/v3/role_assignments?user.id=b2f47cbf62d44a6ba7e6a6f0f2305630&scope.project.id=bc314fbc91c54810b27f9fcad7129c64&role.id=17e6533ce814487c9a8fb0ee2acaad32 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:11.125698 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44830aa-234d-411c-900f-b0f9e9eb44d1 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:11.130655 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5bead-af64-44ac-91af-8301ba832634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:11.131564 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5bead-af64-44ac-91af-8301ba832634 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:11.131914 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5bead-af64-44ac-91af-8301ba832634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:11.132276 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5bead-af64-44ac-91af-8301ba832634 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:11.145374 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a5bead-af64-44ac-91af-8301ba832634 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:59:11.152596 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-59a5bead-af64-44ac-91af-8301ba832634 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 15:59:11.154322 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 425/853] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:59:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:11.161679 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951ca72-c051-4e3e-a484-4d516eee4da2 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:11.172036 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951ca72-c051-4e3e-a484-4d516eee4da2 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:11.177199 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a73ed-fe48-4b6e-a6aa-56c050bc2372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:11.177965 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a73ed-fe48-4b6e-a6aa-56c050bc2372 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:11.178248 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a73ed-fe48-4b6e-a6aa-56c050bc2372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:11.178518 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a73ed-fe48-4b6e-a6aa-56c050bc2372 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:11.179355 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a73ed-fe48-4b6e-a6aa-56c050bc2372 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:11.179658 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a73ed-fe48-4b6e-a6aa-56c050bc2372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:11.181437 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a73ed-fe48-4b6e-a6aa-56c050bc2372 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:11.191831 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 429/854] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:59:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:11.198289 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5bead-af64-44ac-91af-8301ba832634 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:11.209478 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5bead-af64-44ac-91af-8301ba832634 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:11.214465 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ca82b-1fc0-4cf1-afcd-7851bf3c131e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:11.215324 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ca82b-1fc0-4cf1-afcd-7851bf3c131e admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:11.215605 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ca82b-1fc0-4cf1-afcd-7851bf3c131e admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:11.215882 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ca82b-1fc0-4cf1-afcd-7851bf3c131e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:11.229042 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ca82b-1fc0-4cf1-afcd-7851bf3c131e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:11.231002 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ca82b-1fc0-4cf1-afcd-7851bf3c131e admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:11.249424 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-cd2ca82b-1fc0-4cf1-afcd-7851bf3c131e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:11.251002 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 426/855] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:11.257981 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a73ed-fe48-4b6e-a6aa-56c050bc2372 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:11.268378 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a73ed-fe48-4b6e-a6aa-56c050bc2372 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:11.273422 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c89942-ccb2-428d-abcf-64ba2054f4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:11.274150 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c89942-ccb2-428d-abcf-64ba2054f4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:11.274434 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c89942-ccb2-428d-abcf-64ba2054f4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:11.274709 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c89942-ccb2-428d-abcf-64ba2054f4d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:11.275515 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c89942-ccb2-428d-abcf-64ba2054f4d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:11.275822 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c89942-ccb2-428d-abcf-64ba2054f4d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:11.277538 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c89942-ccb2-428d-abcf-64ba2054f4d7 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:11.291637 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 430/856] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:11.297894 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ca82b-1fc0-4cf1-afcd-7851bf3c131e admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:11.309354 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ca82b-1fc0-4cf1-afcd-7851bf3c131e admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:11.314368 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a93b56-e91d-4ce0-9464-8c6231670e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:11.315896 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a93b56-e91d-4ce0-9464-8c6231670e54 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:11.316176 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a93b56-e91d-4ce0-9464-8c6231670e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:11.316449 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a93b56-e91d-4ce0-9464-8c6231670e54 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:11.325761 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a93b56-e91d-4ce0-9464-8c6231670e54 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:11.327878 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a93b56-e91d-4ce0-9464-8c6231670e54 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:11.343073 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-c3a93b56-e91d-4ce0-9464-8c6231670e54 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 15:59:11.344664 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 427/857] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:59:11 2021] GET /identity/v3/users/swift => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:11.351204 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c89942-ccb2-428d-abcf-64ba2054f4d7 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:11.362179 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c89942-ccb2-428d-abcf-64ba2054f4d7 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:11.367081 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020dfb4-b1c7-47b9-9cd8-65fab05ab7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:11.367799 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020dfb4-b1c7-47b9-9cd8-65fab05ab7be admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:11.368082 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020dfb4-b1c7-47b9-9cd8-65fab05ab7be admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:11.368388 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020dfb4-b1c7-47b9-9cd8-65fab05ab7be admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:11.369246 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0020dfb4-b1c7-47b9-9cd8-65fab05ab7be admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:11.369621 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0020dfb4-b1c7-47b9-9cd8-65fab05ab7be admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:11.371540 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0020dfb4-b1c7-47b9-9cd8-65fab05ab7be admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:11.391001 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 431/858] 10.222.0.36 () {56 vars in 1156 bytes} [Wed Dec 15 15:59:11 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:11.397645 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a93b56-e91d-4ce0-9464-8c6231670e54 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:11.408857 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a93b56-e91d-4ce0-9464-8c6231670e54 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:11.414857 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806547e7-176f-41b5-8a5b-fbd9bd630e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:11.415728 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806547e7-176f-41b5-8a5b-fbd9bd630e7a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:11.416116 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806547e7-176f-41b5-8a5b-fbd9bd630e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:11.416521 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806547e7-176f-41b5-8a5b-fbd9bd630e7a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:11.425780 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806547e7-176f-41b5-8a5b-fbd9bd630e7a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:11.427597 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806547e7-176f-41b5-8a5b-fbd9bd630e7a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:11.436752 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 428/859] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:59:11 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 15:59:11.443782 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020dfb4-b1c7-47b9-9cd8-65fab05ab7be admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:11.453961 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020dfb4-b1c7-47b9-9cd8-65fab05ab7be admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:11.459384 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270016d6-7444-4658-be30-3344ffb59a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:11.460485 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270016d6-7444-4658-be30-3344ffb59a23 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:11.460992 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270016d6-7444-4658-be30-3344ffb59a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:11.461662 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270016d6-7444-4658-be30-3344ffb59a23 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:11.474224 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270016d6-7444-4658-be30-3344ffb59a23 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:11.476599 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270016d6-7444-4658-be30-3344ffb59a23 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:11.496163 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-270016d6-7444-4658-be30-3344ffb59a23 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:11.498350 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5e5d5-c416-4c42-a040-9fccd42b6cef None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:11.498778 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5e5d5-c416-4c42-a040-9fccd42b6cef None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:11.498872 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5e5d5-c416-4c42-a040-9fccd42b6cef None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:11.499156 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 432/860] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:11.503918 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 429/861] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:59:11.506186 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270016d6-7444-4658-be30-3344ffb59a23 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:11.507218 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11385f52-707b-4991-a1b7-6cc7cff4cc51 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:11.507488 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11385f52-707b-4991-a1b7-6cc7cff4cc51 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:11.507768 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11385f52-707b-4991-a1b7-6cc7cff4cc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:11.519081 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270016d6-7444-4658-be30-3344ffb59a23 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:11.524813 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85831411-3ff1-4f5c-a3bf-24fd828ee34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:11.525916 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85831411-3ff1-4f5c-a3bf-24fd828ee34f admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:11.526124 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-11385f52-707b-4991-a1b7-6cc7cff4cc51 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:11.526664 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85831411-3ff1-4f5c-a3bf-24fd828ee34f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:11.527145 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85831411-3ff1-4f5c-a3bf-24fd828ee34f admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:11.527321 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-11385f52-707b-4991-a1b7-6cc7cff4cc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:11.528381 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85831411-3ff1-4f5c-a3bf-24fd828ee34f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:11.528924 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85831411-3ff1-4f5c-a3bf-24fd828ee34f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:11.531203 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85831411-3ff1-4f5c-a3bf-24fd828ee34f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:11.538929 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 430/862] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:11 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 15:59:11.547195 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 433/863] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:11.552959 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11385f52-707b-4991-a1b7-6cc7cff4cc51 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:11.563372 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85831411-3ff1-4f5c-a3bf-24fd828ee34f admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:11.568057 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11385f52-707b-4991-a1b7-6cc7cff4cc51 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:11.572681 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338a1c7-5ba8-43a0-b9e0-a46f5c5666b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:11.573506 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338a1c7-5ba8-43a0-b9e0-a46f5c5666b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:11.573792 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338a1c7-5ba8-43a0-b9e0-a46f5c5666b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:11.573896 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85831411-3ff1-4f5c-a3bf-24fd828ee34f admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:11.574089 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338a1c7-5ba8-43a0-b9e0-a46f5c5666b1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:11.579113 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b43fdd-20fc-40a9-8a50-02e226a138ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:11.579907 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b43fdd-20fc-40a9-8a50-02e226a138ec admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:11.580276 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b43fdd-20fc-40a9-8a50-02e226a138ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:11.581096 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b43fdd-20fc-40a9-8a50-02e226a138ec admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:11.581806 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b43fdd-20fc-40a9-8a50-02e226a138ec admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:11.583100 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338a1c7-5ba8-43a0-b9e0-a46f5c5666b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:11.583772 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b43fdd-20fc-40a9-8a50-02e226a138ec admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:11.585266 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338a1c7-5ba8-43a0-b9e0-a46f5c5666b1 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:11.598686 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-28b43fdd-20fc-40a9-8a50-02e226a138ec admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 15 15:59:11.599908 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 434/864] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Dec 15 15:59:11 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:11.600508 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-3338a1c7-5ba8-43a0-b9e0-a46f5c5666b1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:59:11.605453 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 431/865] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:59:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:11.608533 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b43fdd-20fc-40a9-8a50-02e226a138ec admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:11.610849 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338a1c7-5ba8-43a0-b9e0-a46f5c5666b1 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:11.620916 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b43fdd-20fc-40a9-8a50-02e226a138ec admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:11.624938 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338a1c7-5ba8-43a0-b9e0-a46f5c5666b1 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:11.629141 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e318e-0df5-4dff-953a-cfaf39006239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:11.630175 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e318e-0df5-4dff-953a-cfaf39006239 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:11.630605 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e318e-0df5-4dff-953a-cfaf39006239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:11.631117 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e318e-0df5-4dff-953a-cfaf39006239 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:11.631970 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55844b8-7989-4868-b3b2-a7d339aa526a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:11.632348 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e318e-0df5-4dff-953a-cfaf39006239 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:11.632820 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e318e-0df5-4dff-953a-cfaf39006239 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:11.633063 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55844b8-7989-4868-b3b2-a7d339aa526a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:11.633504 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55844b8-7989-4868-b3b2-a7d339aa526a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:11.633942 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55844b8-7989-4868-b3b2-a7d339aa526a admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:11.634959 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55844b8-7989-4868-b3b2-a7d339aa526a admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:11.635439 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55844b8-7989-4868-b3b2-a7d339aa526a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:11.635792 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e318e-0df5-4dff-953a-cfaf39006239 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:11.637553 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55844b8-7989-4868-b3b2-a7d339aa526a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:11.649128 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 432/866] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Dec 15 15:59:11 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:11.652027 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55844b8-7989-4868-b3b2-a7d339aa526a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:11.652452 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 435/867] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:59:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:11.659440 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e318e-0df5-4dff-953a-cfaf39006239 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:11.669362 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e318e-0df5-4dff-953a-cfaf39006239 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:11.669818 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55844b8-7989-4868-b3b2-a7d339aa526a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:11.675384 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafac83e-4133-42de-9df6-0c80d901e877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:11.676312 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafac83e-4133-42de-9df6-0c80d901e877 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:11.676419 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a4c01-a07f-4f8c-8924-a9ba22f267d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:11.676896 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafac83e-4133-42de-9df6-0c80d901e877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:11.677291 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a4c01-a07f-4f8c-8924-a9ba22f267d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:11.677644 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a4c01-a07f-4f8c-8924-a9ba22f267d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:11.677762 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafac83e-4133-42de-9df6-0c80d901e877 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:11.677955 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a4c01-a07f-4f8c-8924-a9ba22f267d9 admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:11.678887 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a4c01-a07f-4f8c-8924-a9ba22f267d9 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:11.679200 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafac83e-4133-42de-9df6-0c80d901e877 admin admin] RBAC: Adding query filter params (role.id=bc362f875c6d4cee83ba65b8d134462d, scope.project.id=bc314fbc91c54810b27f9fcad7129c64, user.id=5e3f652f76424e27a1d4329212d9b66d) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:11.679309 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a4c01-a07f-4f8c-8924-a9ba22f267d9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:11.679843 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafac83e-4133-42de-9df6-0c80d901e877 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:11.681249 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a4c01-a07f-4f8c-8924-a9ba22f267d9 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:11.682169 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafac83e-4133-42de-9df6-0c80d901e877 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:11.688642 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 436/869] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:59:11 2021] GET /identity/v3/role_assignments?user.id=5e3f652f76424e27a1d4329212d9b66d&scope.project.id=bc314fbc91c54810b27f9fcad7129c64&role.id=bc362f875c6d4cee83ba65b8d134462d => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:11.693641 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 433/869] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Dec 15 15:59:11 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:13.304650 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8867949-3142-4197-acce-602980427f28 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:13.305147 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8867949-3142-4197-acce-602980427f28 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:13.305147 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8867949-3142-4197-acce-602980427f28 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:13.307211 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 437/870] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:13.313165 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e9a3b-fb1e-4866-a9e8-92456a147034 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:13.313600 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e9a3b-fb1e-4866-a9e8-92456a147034 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:13.313831 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e9a3b-fb1e-4866-a9e8-92456a147034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:13.332287 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-b83e9a3b-fb1e-4866-a9e8-92456a147034 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:13.333498 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-b83e9a3b-fb1e-4866-a9e8-92456a147034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:13.341519 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 434/871] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:13 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 15:59:13.365306 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8867949-3142-4197-acce-602980427f28 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:13.378091 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8867949-3142-4197-acce-602980427f28 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:13.382691 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8144b-2d7e-4560-a0ef-2d4cef51f27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:13.383367 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8144b-2d7e-4560-a0ef-2d4cef51f27b admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:13.383648 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8144b-2d7e-4560-a0ef-2d4cef51f27b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:13.383919 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8144b-2d7e-4560-a0ef-2d4cef51f27b admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:13.384686 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8144b-2d7e-4560-a0ef-2d4cef51f27b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:13.386384 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8144b-2d7e-4560-a0ef-2d4cef51f27b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:13.407394 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 438/872] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Dec 15 15:59:13 2021] POST /identity/v3/services => generated 269 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:59:13.859157 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfff83-77a8-45a2-8f0d-141602b0c8e3 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:13.859562 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfff83-77a8-45a2-8f0d-141602b0c8e3 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:13.859779 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfff83-77a8-45a2-8f0d-141602b0c8e3 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:13.862208 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 435/873] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:13.868861 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caa185-6448-4860-99ec-afb73b97b5a5 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:13.869176 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caa185-6448-4860-99ec-afb73b97b5a5 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:13.869536 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caa185-6448-4860-99ec-afb73b97b5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:13.889916 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-c6caa185-6448-4860-99ec-afb73b97b5a5 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:13.891274 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-c6caa185-6448-4860-99ec-afb73b97b5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:13.910548 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 439/874] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:13 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 15:59:13.938747 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfff83-77a8-45a2-8f0d-141602b0c8e3 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:13.952979 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfff83-77a8-45a2-8f0d-141602b0c8e3 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:13.957965 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fe92e-f654-4b90-82cf-9331f980de3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:13.958869 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fe92e-f654-4b90-82cf-9331f980de3a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:13.959195 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fe92e-f654-4b90-82cf-9331f980de3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:13.959470 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fe92e-f654-4b90-82cf-9331f980de3a admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:13.972116 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fe92e-f654-4b90-82cf-9331f980de3a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:59:13.980512 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-8d8fe92e-f654-4b90-82cf-9331f980de3a admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 15:59:13.982321 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 436/875] 10.222.0.36 () {56 vars in 1141 bytes} [Wed Dec 15 15:59:13 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:13.990006 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6caa185-6448-4860-99ec-afb73b97b5a5 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:14.000073 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6caa185-6448-4860-99ec-afb73b97b5a5 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:14.005987 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0c22f-181d-4963-9342-b62809b35974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:14.006688 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0c22f-181d-4963-9342-b62809b35974 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:14.007011 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0c22f-181d-4963-9342-b62809b35974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:14.007354 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0c22f-181d-4963-9342-b62809b35974 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:14.008199 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0c22f-181d-4963-9342-b62809b35974 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:14.008538 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0c22f-181d-4963-9342-b62809b35974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:14.010402 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0c22f-181d-4963-9342-b62809b35974 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:14.020461 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 440/876] 10.222.0.36 () {56 vars in 1136 bytes} [Wed Dec 15 15:59:13 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:14.027236 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fe92e-f654-4b90-82cf-9331f980de3a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:14.038504 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fe92e-f654-4b90-82cf-9331f980de3a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:14.043669 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d2ba0-6ed4-42d1-9337-5621d6031460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:14.044588 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d2ba0-6ed4-42d1-9337-5621d6031460 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:14.044917 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d2ba0-6ed4-42d1-9337-5621d6031460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:14.045197 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d2ba0-6ed4-42d1-9337-5621d6031460 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:14.058527 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d2ba0-6ed4-42d1-9337-5621d6031460 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:14.060626 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d2ba0-6ed4-42d1-9337-5621d6031460 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:14.080910 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-a30d2ba0-6ed4-42d1-9337-5621d6031460 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:14.082690 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 437/877] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:14.089523 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0c22f-181d-4963-9342-b62809b35974 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:14.101707 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0c22f-181d-4963-9342-b62809b35974 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:14.106870 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b08448-8f43-4c3c-8bf6-5458623ff068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:14.107638 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b08448-8f43-4c3c-8bf6-5458623ff068 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:14.107946 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b08448-8f43-4c3c-8bf6-5458623ff068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:14.108288 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b08448-8f43-4c3c-8bf6-5458623ff068 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:14.109223 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b08448-8f43-4c3c-8bf6-5458623ff068 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:14.109538 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b08448-8f43-4c3c-8bf6-5458623ff068 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:14.111472 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b08448-8f43-4c3c-8bf6-5458623ff068 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:14.126388 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 441/878] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:14.133045 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d2ba0-6ed4-42d1-9337-5621d6031460 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:14.144731 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d2ba0-6ed4-42d1-9337-5621d6031460 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:14.149843 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03014e8-befb-4a06-a8ce-94ba025ccc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:14.150751 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03014e8-befb-4a06-a8ce-94ba025ccc44 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:14.151062 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03014e8-befb-4a06-a8ce-94ba025ccc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:14.151373 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03014e8-befb-4a06-a8ce-94ba025ccc44 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:14.161600 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03014e8-befb-4a06-a8ce-94ba025ccc44 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:14.164052 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03014e8-befb-4a06-a8ce-94ba025ccc44 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:14.180640 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-e03014e8-befb-4a06-a8ce-94ba025ccc44 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 15:59:14.182454 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 438/879] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Dec 15 15:59:14 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:14.185116 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18e972-20e1-48b3-9e6c-f8dc53f1bc5b None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:14.185413 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18e972-20e1-48b3-9e6c-f8dc53f1bc5b None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:14.185742 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18e972-20e1-48b3-9e6c-f8dc53f1bc5b None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:14.188057 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 442/880] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:14.188977 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03014e8-befb-4a06-a8ce-94ba025ccc44 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:14.193485 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82c38d-7d2b-4611-b0d4-d219030c5c2f None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:14.193768 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82c38d-7d2b-4611-b0d4-d219030c5c2f None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:14.194044 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82c38d-7d2b-4611-b0d4-d219030c5c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:14.200904 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03014e8-befb-4a06-a8ce-94ba025ccc44 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:14.206685 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73f89e-9a2e-4df0-8c87-488b3e7ec274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:14.207410 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73f89e-9a2e-4df0-8c87-488b3e7ec274 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:14.207726 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73f89e-9a2e-4df0-8c87-488b3e7ec274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:14.208127 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73f89e-9a2e-4df0-8c87-488b3e7ec274 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:14.209144 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73f89e-9a2e-4df0-8c87-488b3e7ec274 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:14.209606 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73f89e-9a2e-4df0-8c87-488b3e7ec274 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:14.211830 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73f89e-9a2e-4df0-8c87-488b3e7ec274 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:14.214581 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-4e82c38d-7d2b-4611-b0d4-d219030c5c2f None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:14.216756 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-4e82c38d-7d2b-4611-b0d4-d219030c5c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:14.226776 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 443/881] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:14 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 15:59:14.238709 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 439/882] 10.222.0.36 () {56 vars in 1170 bytes} [Wed Dec 15 15:59:14 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:14.245444 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82c38d-7d2b-4611-b0d4-d219030c5c2f None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:14.254518 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73f89e-9a2e-4df0-8c87-488b3e7ec274 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:14.256602 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82c38d-7d2b-4611-b0d4-d219030c5c2f None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:14.261555 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9aeb9c-e37d-4f75-a909-b7c74cdd05cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:14.262548 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9aeb9c-e37d-4f75-a909-b7c74cdd05cf admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:14.263044 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9aeb9c-e37d-4f75-a909-b7c74cdd05cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:14.263542 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9aeb9c-e37d-4f75-a909-b7c74cdd05cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:14.266267 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73f89e-9a2e-4df0-8c87-488b3e7ec274 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:14.272102 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b83499-bda3-4918-982f-635c965e8f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:14.272856 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b83499-bda3-4918-982f-635c965e8f35 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:14.273158 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b83499-bda3-4918-982f-635c965e8f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:14.273797 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b83499-bda3-4918-982f-635c965e8f35 admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:14.274673 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b83499-bda3-4918-982f-635c965e8f35 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:14.275018 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9aeb9c-e37d-4f75-a909-b7c74cdd05cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:14.275843 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING py.warnings [None req-d7b83499-bda3-4918-982f-635c965e8f35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:59:14.275843 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: warnings.warn(msg) Dec 15 15:59:14.275843 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: Dec 15 15:59:14.276783 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9aeb9c-e37d-4f75-a909-b7c74cdd05cf admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:14.276938 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b83499-bda3-4918-982f-635c965e8f35 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:14.289451 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 444/883] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:59:14 2021] GET /identity/v3/auth/tokens => generated 1562 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 15:59:14.289451 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d25be1-12cf-440e-a39d-2641e5ede08e None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:14.289451 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d25be1-12cf-440e-a39d-2641e5ede08e None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:14.289451 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d25be1-12cf-440e-a39d-2641e5ede08e None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:14.291349 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 445/884] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:14.296588 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d25be1-12cf-440e-a39d-2641e5ede08e None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:14.297264 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 440/885] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Dec 15 15:59:14 2021] POST /identity/v3/services => generated 251 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 15:59:14.298988 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a9406-3c16-46c6-bc87-56c15169e1d2 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:14.299292 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a9406-3c16-46c6-bc87-56c15169e1d2 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:14.299732 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a9406-3c16-46c6-bc87-56c15169e1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:14.322227 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d25be1-12cf-440e-a39d-2641e5ede08e None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:14.324795 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-398a9406-3c16-46c6-bc87-56c15169e1d2 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:14.326251 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-398a9406-3c16-46c6-bc87-56c15169e1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:14.327325 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd2787-3250-414b-af79-ea627a824555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:14.328218 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd2787-3250-414b-af79-ea627a824555 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:14.328633 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd2787-3250-414b-af79-ea627a824555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:14.328996 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd2787-3250-414b-af79-ea627a824555 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:14.336719 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 441/886] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:14 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:14.350699 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd2787-3250-414b-af79-ea627a824555 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:14.353220 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd2787-3250-414b-af79-ea627a824555 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:14.362161 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a9406-3c16-46c6-bc87-56c15169e1d2 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:14.374946 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a9406-3c16-46c6-bc87-56c15169e1d2 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:14.376443 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-30cd2787-3250-414b-af79-ea627a824555 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:14.378313 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 446/887] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:14.380400 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f92968-b2bc-45b1-8f6a-0c06ea8d8974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:14.381403 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f92968-b2bc-45b1-8f6a-0c06ea8d8974 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:14.381732 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f92968-b2bc-45b1-8f6a-0c06ea8d8974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:14.382050 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f92968-b2bc-45b1-8f6a-0c06ea8d8974 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:14.382879 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f92968-b2bc-45b1-8f6a-0c06ea8d8974 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:14.384175 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd2787-3250-414b-af79-ea627a824555 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:14.384916 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f92968-b2bc-45b1-8f6a-0c06ea8d8974 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:14.396206 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd2787-3250-414b-af79-ea627a824555 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:14.400847 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-99f92968-b2bc-45b1-8f6a-0c06ea8d8974 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 15:59:14.401793 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae649697-b2f6-4d20-82ad-8fe5ca2f32f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:14.408952 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae649697-b2f6-4d20-82ad-8fe5ca2f32f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:14.409139 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 442/888] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Dec 15 15:59:14 2021] GET /identity/v3/services/object-store => generated 93 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:14.409249 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae649697-b2f6-4d20-82ad-8fe5ca2f32f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:14.409249 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae649697-b2f6-4d20-82ad-8fe5ca2f32f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:14.409249 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae649697-b2f6-4d20-82ad-8fe5ca2f32f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:14.409249 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae649697-b2f6-4d20-82ad-8fe5ca2f32f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:14.410358 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f92968-b2bc-45b1-8f6a-0c06ea8d8974 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:14.412284 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae649697-b2f6-4d20-82ad-8fe5ca2f32f3 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:14.423762 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f92968-b2bc-45b1-8f6a-0c06ea8d8974 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:14.427765 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 447/889] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:14.429905 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114a993-9bf6-4582-aa01-c6d732890f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:14.430724 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114a993-9bf6-4582-aa01-c6d732890f41 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:14.431162 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114a993-9bf6-4582-aa01-c6d732890f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:14.431583 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114a993-9bf6-4582-aa01-c6d732890f41 admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:14.432523 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114a993-9bf6-4582-aa01-c6d732890f41 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:14.432959 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114a993-9bf6-4582-aa01-c6d732890f41 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:14.433376 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae649697-b2f6-4d20-82ad-8fe5ca2f32f3 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:14.434933 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114a993-9bf6-4582-aa01-c6d732890f41 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:14.445562 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 443/890] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Dec 15 15:59:14 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:14.446654 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114a993-9bf6-4582-aa01-c6d732890f41 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:14.449310 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae649697-b2f6-4d20-82ad-8fe5ca2f32f3 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:14.456216 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7874d03-40f5-4e08-8181-47ecbf4d3d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:14.457369 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114a993-9bf6-4582-aa01-c6d732890f41 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:14.457685 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7874d03-40f5-4e08-8181-47ecbf4d3d6b admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:14.458260 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7874d03-40f5-4e08-8181-47ecbf4d3d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:14.458742 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7874d03-40f5-4e08-8181-47ecbf4d3d6b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:14.464587 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f4caa-5529-465f-bf33-5f0ea7fa250a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:14.465863 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f4caa-5529-465f-bf33-5f0ea7fa250a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:14.466270 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f4caa-5529-465f-bf33-5f0ea7fa250a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:14.466660 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f4caa-5529-465f-bf33-5f0ea7fa250a admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:14.467522 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f4caa-5529-465f-bf33-5f0ea7fa250a admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:14.467938 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f4caa-5529-465f-bf33-5f0ea7fa250a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:14.468412 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7874d03-40f5-4e08-8181-47ecbf4d3d6b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:14.469952 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f4caa-5529-465f-bf33-5f0ea7fa250a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:14.471559 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7874d03-40f5-4e08-8181-47ecbf4d3d6b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:14.481675 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 444/891] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Dec 15 15:59:14 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:14.494279 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-b7874d03-40f5-4e08-8181-47ecbf4d3d6b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:59:14.496019 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 448/892] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:59:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:14.502423 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f4caa-5529-465f-bf33-5f0ea7fa250a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:14.513090 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f4caa-5529-465f-bf33-5f0ea7fa250a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:14.518593 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f21245-fa28-4573-a57b-5b16c66b41b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:14.519324 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f21245-fa28-4573-a57b-5b16c66b41b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:14.519606 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f21245-fa28-4573-a57b-5b16c66b41b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:14.519877 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f21245-fa28-4573-a57b-5b16c66b41b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:14.520757 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f21245-fa28-4573-a57b-5b16c66b41b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:14.521069 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f21245-fa28-4573-a57b-5b16c66b41b2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:14.523110 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f21245-fa28-4573-a57b-5b16c66b41b2 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:14.538493 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 445/893] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:59:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:14.545023 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7874d03-40f5-4e08-8181-47ecbf4d3d6b admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:14.556881 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7874d03-40f5-4e08-8181-47ecbf4d3d6b admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:14.562364 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c36ef8-d51d-45a4-b909-fe2daf27b996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:14.563399 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c36ef8-d51d-45a4-b909-fe2daf27b996 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:14.563937 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c36ef8-d51d-45a4-b909-fe2daf27b996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:14.565128 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c36ef8-d51d-45a4-b909-fe2daf27b996 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:14.566697 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c36ef8-d51d-45a4-b909-fe2daf27b996 admin admin] RBAC: Adding query filter params (role.id=2c90a3a6a076416a94ab31da2efd66cc, scope.project.id=bc314fbc91c54810b27f9fcad7129c64, user.id=b2f47cbf62d44a6ba7e6a6f0f2305630) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:14.569792 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c36ef8-d51d-45a4-b909-fe2daf27b996 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:14.573090 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c36ef8-d51d-45a4-b909-fe2daf27b996 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:14.581232 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 449/894] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:59:14 2021] GET /identity/v3/role_assignments?user.id=b2f47cbf62d44a6ba7e6a6f0f2305630&scope.project.id=bc314fbc91c54810b27f9fcad7129c64&role.id=2c90a3a6a076416a94ab31da2efd66cc => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:16.055998 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02c2d9-79cb-41e9-85be-e89f987decf7 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:16.056471 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02c2d9-79cb-41e9-85be-e89f987decf7 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:16.056703 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02c2d9-79cb-41e9-85be-e89f987decf7 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:16.058439 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 446/895] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:16 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:59:16.064994 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c525f6-1685-442b-8f42-68c6c756a7ea None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:16.065680 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c525f6-1685-442b-8f42-68c6c756a7ea None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:16.065680 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c525f6-1685-442b-8f42-68c6c756a7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:16.085972 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-c6c525f6-1685-442b-8f42-68c6c756a7ea None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:16.087375 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-c6c525f6-1685-442b-8f42-68c6c756a7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:16.096485 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 450/896] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:16 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 15:59:16.120289 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02c2d9-79cb-41e9-85be-e89f987decf7 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:16.133616 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02c2d9-79cb-41e9-85be-e89f987decf7 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:16.138068 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b1a00-257f-4b67-8a61-c0a2192ef862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:16.138862 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b1a00-257f-4b67-8a61-c0a2192ef862 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:16.139143 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b1a00-257f-4b67-8a61-c0a2192ef862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:16.139419 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b1a00-257f-4b67-8a61-c0a2192ef862 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:16.140087 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b1a00-257f-4b67-8a61-c0a2192ef862 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:16.141697 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b1a00-257f-4b67-8a61-c0a2192ef862 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:16.153798 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-ff6b1a00-257f-4b67-8a61-c0a2192ef862 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 15 15:59:16.160670 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 447/897] 10.222.0.36 () {56 vars in 1153 bytes} [Wed Dec 15 15:59:16 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:16.162068 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c525f6-1685-442b-8f42-68c6c756a7ea None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:16.171366 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c525f6-1685-442b-8f42-68c6c756a7ea None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:16.176565 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed547764-ccf9-4a29-af1a-d68e4fefbf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:16.177218 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed547764-ccf9-4a29-af1a-d68e4fefbf52 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:16.177530 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed547764-ccf9-4a29-af1a-d68e4fefbf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:16.177803 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed547764-ccf9-4a29-af1a-d68e4fefbf52 admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:16.178519 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed547764-ccf9-4a29-af1a-d68e4fefbf52 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:16.178822 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed547764-ccf9-4a29-af1a-d68e4fefbf52 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:16.180416 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed547764-ccf9-4a29-af1a-d68e4fefbf52 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:16.189827 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 451/898] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Dec 15 15:59:16 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:16.192242 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b1a00-257f-4b67-8a61-c0a2192ef862 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:16.202021 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b1a00-257f-4b67-8a61-c0a2192ef862 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:16.206951 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f2b19-8174-4da2-89e6-7aa3021daff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:16.207597 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f2b19-8174-4da2-89e6-7aa3021daff8 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:16.207881 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f2b19-8174-4da2-89e6-7aa3021daff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:16.208158 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f2b19-8174-4da2-89e6-7aa3021daff8 admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:16.208883 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f2b19-8174-4da2-89e6-7aa3021daff8 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:16.209188 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f2b19-8174-4da2-89e6-7aa3021daff8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:16.210885 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f2b19-8174-4da2-89e6-7aa3021daff8 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:16.221307 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 448/899] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Dec 15 15:59:16 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:16.222651 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed547764-ccf9-4a29-af1a-d68e4fefbf52 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:16.232411 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed547764-ccf9-4a29-af1a-d68e4fefbf52 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:16.237744 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299db04-95dd-455c-bf4e-df5b53383e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:16.238380 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299db04-95dd-455c-bf4e-df5b53383e1a admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:16.238661 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299db04-95dd-455c-bf4e-df5b53383e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:16.238932 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299db04-95dd-455c-bf4e-df5b53383e1a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:16.239726 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299db04-95dd-455c-bf4e-df5b53383e1a admin admin] RBAC: Adding query filter params (interface=public, service_id=142b2b4b06724d1c9a955fd5a02fa902, region_id=RegionOne) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:16.240033 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299db04-95dd-455c-bf4e-df5b53383e1a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:16.241657 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299db04-95dd-455c-bf4e-df5b53383e1a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:16.252456 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 452/900] 10.222.0.36 () {56 vars in 1272 bytes} [Wed Dec 15 15:59:16 2021] GET /identity/v3/endpoints?service_id=142b2b4b06724d1c9a955fd5a02fa902&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:16.253881 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f2b19-8174-4da2-89e6-7aa3021daff8 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:16.263688 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f2b19-8174-4da2-89e6-7aa3021daff8 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:16.268936 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e55fd3-0d9d-4347-9e9c-080b8ceb05ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:16.269625 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e55fd3-0d9d-4347-9e9c-080b8ceb05ff admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:16.269908 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e55fd3-0d9d-4347-9e9c-080b8ceb05ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:16.270181 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e55fd3-0d9d-4347-9e9c-080b8ceb05ff admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:16.270873 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e55fd3-0d9d-4347-9e9c-080b8ceb05ff admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:16.272470 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e55fd3-0d9d-4347-9e9c-080b8ceb05ff admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:16.285557 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 449/901] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Dec 15 15:59:16 2021] GET /identity/v3/services => generated 1268 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 15:59:16.898642 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a40b50-4e63-4c10-9369-cb646e0c88c7 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:16.898642 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a40b50-4e63-4c10-9369-cb646e0c88c7 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:16.898642 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a40b50-4e63-4c10-9369-cb646e0c88c7 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:16.899593 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 453/902] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:16.908625 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1bea0-adac-4a00-8f74-ce0fdf6569ff None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:16.908625 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1bea0-adac-4a00-8f74-ce0fdf6569ff None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:16.908625 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1bea0-adac-4a00-8f74-ce0fdf6569ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:16.926798 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-98e1bea0-adac-4a00-8f74-ce0fdf6569ff None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:16.928343 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-98e1bea0-adac-4a00-8f74-ce0fdf6569ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:16.930816 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20564372-c5e3-43a2-ad52-debeafefbe2f None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:16.931103 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20564372-c5e3-43a2-ad52-debeafefbe2f None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:16.931378 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20564372-c5e3-43a2-ad52-debeafefbe2f None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:16.933411 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 454/903] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:59:16.937927 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 450/904] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:16 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:16.941113 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605bf48-ce68-4f16-b798-1161239323f3 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:16.941113 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605bf48-ce68-4f16-b798-1161239323f3 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:16.941113 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605bf48-ce68-4f16-b798-1161239323f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:16.957978 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-0605bf48-ce68-4f16-b798-1161239323f3 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:16.959605 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-0605bf48-ce68-4f16-b798-1161239323f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:16.963595 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1bea0-adac-4a00-8f74-ce0fdf6569ff None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:16.968444 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 455/905] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:16 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 15:59:16.973496 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1bea0-adac-4a00-8f74-ce0fdf6569ff None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:16.978140 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02570b4-c687-454a-a7b9-bcf425e56f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:16.978937 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02570b4-c687-454a-a7b9-bcf425e56f38 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:16.979228 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02570b4-c687-454a-a7b9-bcf425e56f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:16.979507 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02570b4-c687-454a-a7b9-bcf425e56f38 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:16.980183 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02570b4-c687-454a-a7b9-bcf425e56f38 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:16.981841 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02570b4-c687-454a-a7b9-bcf425e56f38 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:16.994093 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-c02570b4-c687-454a-a7b9-bcf425e56f38 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 15 15:59:16.994638 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605bf48-ce68-4f16-b798-1161239323f3 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:16.995558 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 451/906] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Dec 15 15:59:16 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:17.002209 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02570b4-c687-454a-a7b9-bcf425e56f38 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:17.005430 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605bf48-ce68-4f16-b798-1161239323f3 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:17.010305 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab22aa-c617-40bf-8db5-6ddeca699d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:17.011247 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab22aa-c617-40bf-8db5-6ddeca699d06 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:17.011729 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab22aa-c617-40bf-8db5-6ddeca699d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:17.012201 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab22aa-c617-40bf-8db5-6ddeca699d06 admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:17.012600 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02570b4-c687-454a-a7b9-bcf425e56f38 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:17.013360 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab22aa-c617-40bf-8db5-6ddeca699d06 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:17.015183 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab22aa-c617-40bf-8db5-6ddeca699d06 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:17.017580 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627671c-6b49-4f77-8416-6cdd1de82fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:17.018428 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627671c-6b49-4f77-8416-6cdd1de82fca admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:17.018718 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627671c-6b49-4f77-8416-6cdd1de82fca admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:17.019004 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627671c-6b49-4f77-8416-6cdd1de82fca admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:17.019729 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627671c-6b49-4f77-8416-6cdd1de82fca admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:17.020042 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627671c-6b49-4f77-8416-6cdd1de82fca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:17.021676 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627671c-6b49-4f77-8416-6cdd1de82fca admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:17.027800 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 452/907] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Dec 15 15:59:17 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:17.034626 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627671c-6b49-4f77-8416-6cdd1de82fca admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:17.037822 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 456/908] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Dec 15 15:59:16 2021] POST /identity/v3/services => generated 241 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:59:17.048247 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627671c-6b49-4f77-8416-6cdd1de82fca admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:17.075309 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39301d-8d77-4465-8b28-3f93a9d8fa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:17.076103 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39301d-8d77-4465-8b28-3f93a9d8fa3f admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:17.076379 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39301d-8d77-4465-8b28-3f93a9d8fa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:17.076665 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39301d-8d77-4465-8b28-3f93a9d8fa3f admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:17.077492 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39301d-8d77-4465-8b28-3f93a9d8fa3f admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:17.077806 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39301d-8d77-4465-8b28-3f93a9d8fa3f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:17.079455 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39301d-8d77-4465-8b28-3f93a9d8fa3f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:17.086045 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 453/909] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Dec 15 15:59:17 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:17.092566 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab22aa-c617-40bf-8db5-6ddeca699d06 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:17.104365 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab22aa-c617-40bf-8db5-6ddeca699d06 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:17.109376 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cc260-16ad-41ea-8f33-757e4f0d29fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:17.110201 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cc260-16ad-41ea-8f33-757e4f0d29fd admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:17.110490 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cc260-16ad-41ea-8f33-757e4f0d29fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:17.110767 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cc260-16ad-41ea-8f33-757e4f0d29fd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:17.112630 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12cc260-16ad-41ea-8f33-757e4f0d29fd admin admin] RBAC: Adding query filter params (interface=public, service_id=197e212adc244b84942070c6c1907531, region_id=RegionOne) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:17.112955 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12cc260-16ad-41ea-8f33-757e4f0d29fd admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:17.114788 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12cc260-16ad-41ea-8f33-757e4f0d29fd admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:17.121812 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 457/910] 10.222.0.36 () {56 vars in 1272 bytes} [Wed Dec 15 15:59:17 2021] GET /identity/v3/endpoints?service_id=197e212adc244b84942070c6c1907531&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:17.128932 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39301d-8d77-4465-8b28-3f93a9d8fa3f admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:17.139916 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39301d-8d77-4465-8b28-3f93a9d8fa3f admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:17.147220 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc73823-557a-49e1-80c0-355103b8fd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:17.147956 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc73823-557a-49e1-80c0-355103b8fd3a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:17.148243 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc73823-557a-49e1-80c0-355103b8fd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:17.148523 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc73823-557a-49e1-80c0-355103b8fd3a admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:17.149468 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc73823-557a-49e1-80c0-355103b8fd3a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:17.151169 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc73823-557a-49e1-80c0-355103b8fd3a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:17.159068 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 454/911] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Dec 15 15:59:17 2021] GET /identity/v3/services => generated 1497 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 15:59:17.374464 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd556392-533b-469a-814c-e7e989698737 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:17.374847 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd556392-533b-469a-814c-e7e989698737 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:17.375143 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd556392-533b-469a-814c-e7e989698737 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:17.378250 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 458/912] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:17.383985 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146dd65-c1a8-4ac2-832f-14ad30469d4f None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:17.384272 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146dd65-c1a8-4ac2-832f-14ad30469d4f None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:17.384549 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146dd65-c1a8-4ac2-832f-14ad30469d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:17.405788 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-e146dd65-c1a8-4ac2-832f-14ad30469d4f None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:17.406922 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-e146dd65-c1a8-4ac2-832f-14ad30469d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:17.415572 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 455/913] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:17 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:17.441051 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd556392-533b-469a-814c-e7e989698737 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:17.453853 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd556392-533b-469a-814c-e7e989698737 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:17.459299 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca55e5-66a8-4e64-ae7a-874c687071da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:17.460110 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca55e5-66a8-4e64-ae7a-874c687071da admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:17.460394 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca55e5-66a8-4e64-ae7a-874c687071da admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:17.460668 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca55e5-66a8-4e64-ae7a-874c687071da admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:17.474291 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca55e5-66a8-4e64-ae7a-874c687071da admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:59:17.481934 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-82ca55e5-66a8-4e64-ae7a-874c687071da admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 15:59:17.483491 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 459/914] 10.222.0.36 () {56 vars in 1141 bytes} [Wed Dec 15 15:59:17 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:17.490861 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146dd65-c1a8-4ac2-832f-14ad30469d4f None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:17.500022 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146dd65-c1a8-4ac2-832f-14ad30469d4f None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:17.504925 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2973918-582c-433d-a970-80f60893031c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:17.505645 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2973918-582c-433d-a970-80f60893031c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:17.505925 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2973918-582c-433d-a970-80f60893031c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:17.506196 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2973918-582c-433d-a970-80f60893031c admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:17.506956 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2973918-582c-433d-a970-80f60893031c admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:17.507256 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2973918-582c-433d-a970-80f60893031c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:17.508906 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2973918-582c-433d-a970-80f60893031c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:17.517983 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 456/915] 10.222.0.36 () {56 vars in 1136 bytes} [Wed Dec 15 15:59:17 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:17.524096 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca55e5-66a8-4e64-ae7a-874c687071da admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:17.536249 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca55e5-66a8-4e64-ae7a-874c687071da admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:17.541296 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9bb83-3a4a-4f1c-b8c1-486340a1e86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:17.542331 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9bb83-3a4a-4f1c-b8c1-486340a1e86f admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:17.542794 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9bb83-3a4a-4f1c-b8c1-486340a1e86f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:17.543273 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9bb83-3a4a-4f1c-b8c1-486340a1e86f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:17.555664 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9bb83-3a4a-4f1c-b8c1-486340a1e86f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:17.557865 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9bb83-3a4a-4f1c-b8c1-486340a1e86f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:17.576819 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-25d9bb83-3a4a-4f1c-b8c1-486340a1e86f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:17.578598 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 460/916] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:17.585742 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2973918-582c-433d-a970-80f60893031c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:17.597024 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2973918-582c-433d-a970-80f60893031c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:17.601960 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd45c2-a4f7-4070-8d81-0626e3ffd2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:17.602874 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd45c2-a4f7-4070-8d81-0626e3ffd2af admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:17.603340 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd45c2-a4f7-4070-8d81-0626e3ffd2af admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:17.603848 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd45c2-a4f7-4070-8d81-0626e3ffd2af admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:17.604864 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd45c2-a4f7-4070-8d81-0626e3ffd2af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:17.605350 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd45c2-a4f7-4070-8d81-0626e3ffd2af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:17.607223 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd45c2-a4f7-4070-8d81-0626e3ffd2af admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:17.625433 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 457/917] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:17.628197 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9bb83-3a4a-4f1c-b8c1-486340a1e86f admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:17.638734 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9bb83-3a4a-4f1c-b8c1-486340a1e86f admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:17.644665 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65032dc4-0b7a-403c-a833-ebb14ed2c947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:17.645751 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65032dc4-0b7a-403c-a833-ebb14ed2c947 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:17.646217 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65032dc4-0b7a-403c-a833-ebb14ed2c947 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:17.646730 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65032dc4-0b7a-403c-a833-ebb14ed2c947 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:17.654874 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65032dc4-0b7a-403c-a833-ebb14ed2c947 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:17.657288 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65032dc4-0b7a-403c-a833-ebb14ed2c947 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:17.673908 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-65032dc4-0b7a-403c-a833-ebb14ed2c947 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 15:59:17.675779 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 461/918] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Dec 15 15:59:17 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:17.682161 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd45c2-a4f7-4070-8d81-0626e3ffd2af admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:17.693238 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd45c2-a4f7-4070-8d81-0626e3ffd2af admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:17.698193 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c2f59-0902-435b-a24c-f166249f5f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:17.699124 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c2f59-0902-435b-a24c-f166249f5f8d admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:17.699588 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c2f59-0902-435b-a24c-f166249f5f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:17.700063 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c2f59-0902-435b-a24c-f166249f5f8d admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:17.701125 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c2f59-0902-435b-a24c-f166249f5f8d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:17.701672 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c2f59-0902-435b-a24c-f166249f5f8d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:17.703870 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c2f59-0902-435b-a24c-f166249f5f8d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:17.724507 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 458/919] 10.222.0.36 () {56 vars in 1170 bytes} [Wed Dec 15 15:59:17 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:17.730689 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65032dc4-0b7a-403c-a833-ebb14ed2c947 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:17.741525 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65032dc4-0b7a-403c-a833-ebb14ed2c947 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:17.746531 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9030682-f8e1-4855-9850-f65261cf88a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:17.747555 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9030682-f8e1-4855-9850-f65261cf88a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:17.748040 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9030682-f8e1-4855-9850-f65261cf88a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:17.748494 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9030682-f8e1-4855-9850-f65261cf88a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:17.760030 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9030682-f8e1-4855-9850-f65261cf88a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:17.762108 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9030682-f8e1-4855-9850-f65261cf88a8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:17.780691 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-e9030682-f8e1-4855-9850-f65261cf88a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:17.782452 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 462/920] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:17.789873 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c2f59-0902-435b-a24c-f166249f5f8d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:17.800561 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c2f59-0902-435b-a24c-f166249f5f8d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:17.805636 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b3cf4-4798-4d36-be5f-eed23f6e7b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:17.806651 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b3cf4-4798-4d36-be5f-eed23f6e7b09 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:17.807159 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b3cf4-4798-4d36-be5f-eed23f6e7b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:17.807692 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b3cf4-4798-4d36-be5f-eed23f6e7b09 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:17.808638 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b3cf4-4798-4d36-be5f-eed23f6e7b09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:17.809199 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b3cf4-4798-4d36-be5f-eed23f6e7b09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:17.811123 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b3cf4-4798-4d36-be5f-eed23f6e7b09 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:17.824151 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 459/921] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:17.831324 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9030682-f8e1-4855-9850-f65261cf88a8 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:17.842019 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9030682-f8e1-4855-9850-f65261cf88a8 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:17.847855 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad6360-fad2-45a4-846c-e4da1d98061c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:17.848918 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad6360-fad2-45a4-846c-e4da1d98061c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:17.849445 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad6360-fad2-45a4-846c-e4da1d98061c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:17.849988 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad6360-fad2-45a4-846c-e4da1d98061c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:17.857644 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad6360-fad2-45a4-846c-e4da1d98061c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:17.859894 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad6360-fad2-45a4-846c-e4da1d98061c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:17.875298 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-f2ad6360-fad2-45a4-846c-e4da1d98061c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:59:17.881491 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 463/922] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:59:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:17.883954 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b3cf4-4798-4d36-be5f-eed23f6e7b09 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:17.895256 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b3cf4-4798-4d36-be5f-eed23f6e7b09 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:17.900239 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595d4fe-4f14-4f5a-86fe-37ccf3e15fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:17.901142 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595d4fe-4f14-4f5a-86fe-37ccf3e15fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:17.901736 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595d4fe-4f14-4f5a-86fe-37ccf3e15fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:17.902240 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595d4fe-4f14-4f5a-86fe-37ccf3e15fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:17.903300 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595d4fe-4f14-4f5a-86fe-37ccf3e15fe4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:17.903813 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595d4fe-4f14-4f5a-86fe-37ccf3e15fe4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:17.906055 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595d4fe-4f14-4f5a-86fe-37ccf3e15fe4 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:17.920785 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 460/923] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:59:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:17.928618 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad6360-fad2-45a4-846c-e4da1d98061c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:17.940023 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad6360-fad2-45a4-846c-e4da1d98061c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:17.944831 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4e643-f1d8-47cf-b8dc-3ac67bf71bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:17.945975 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4e643-f1d8-47cf-b8dc-3ac67bf71bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:17.946484 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4e643-f1d8-47cf-b8dc-3ac67bf71bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:17.946960 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4e643-f1d8-47cf-b8dc-3ac67bf71bfb admin admin] PATH_INFO: `/v3/projects/bc314fbc91c54810b27f9fcad7129c64/users/b2f47cbf62d44a6ba7e6a6f0f2305630/roles/2c90a3a6a076416a94ab31da2efd66cc` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:17.949423 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4e643-f1d8-47cf-b8dc-3ac67bf71bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc314fbc91c54810b27f9fcad7129c64, user_id=b2f47cbf62d44a6ba7e6a6f0f2305630, role_id=2c90a3a6a076416a94ab31da2efd66cc)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:17.952323 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4e643-f1d8-47cf-b8dc-3ac67bf71bfb admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:17.969711 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 464/924] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Dec 15 15:59:17 2021] PUT /identity/v3/projects/bc314fbc91c54810b27f9fcad7129c64/users/b2f47cbf62d44a6ba7e6a6f0f2305630/roles/2c90a3a6a076416a94ab31da2efd66cc => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 15:59:18.721749 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce17b0-9755-42f2-a8a0-f7998f261ea4 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:18.722264 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce17b0-9755-42f2-a8a0-f7998f261ea4 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:18.722264 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce17b0-9755-42f2-a8a0-f7998f261ea4 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:18.724417 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 461/925] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:18.730317 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7809c8-bd14-4609-81ee-8c5ecf26a559 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:18.730732 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7809c8-bd14-4609-81ee-8c5ecf26a559 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:18.730845 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7809c8-bd14-4609-81ee-8c5ecf26a559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:18.748983 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-1c7809c8-bd14-4609-81ee-8c5ecf26a559 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:18.750203 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-1c7809c8-bd14-4609-81ee-8c5ecf26a559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:18.817528 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 465/926] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:18 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:18.835024 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce17b0-9755-42f2-a8a0-f7998f261ea4 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:18.848171 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce17b0-9755-42f2-a8a0-f7998f261ea4 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:18.852737 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2613d-8c4f-463d-b5a5-06a566a1b1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:18.853551 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2613d-8c4f-463d-b5a5-06a566a1b1cb admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:18.853832 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2613d-8c4f-463d-b5a5-06a566a1b1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:18.854107 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2613d-8c4f-463d-b5a5-06a566a1b1cb admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:18.854774 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2613d-8c4f-463d-b5a5-06a566a1b1cb admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:18.856360 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2613d-8c4f-463d-b5a5-06a566a1b1cb admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:18.868371 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-82c2613d-8c4f-463d-b5a5-06a566a1b1cb admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 15 15:59:18.873493 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 462/927] 10.222.0.36 () {56 vars in 1153 bytes} [Wed Dec 15 15:59:18 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:18.876376 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7809c8-bd14-4609-81ee-8c5ecf26a559 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:18.885687 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7809c8-bd14-4609-81ee-8c5ecf26a559 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:18.890435 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60068306-2d18-4dd3-afa1-09a87639f5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:18.891093 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60068306-2d18-4dd3-afa1-09a87639f5ca admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:18.891380 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60068306-2d18-4dd3-afa1-09a87639f5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:18.891652 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60068306-2d18-4dd3-afa1-09a87639f5ca admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:18.892443 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60068306-2d18-4dd3-afa1-09a87639f5ca admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:18.892745 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60068306-2d18-4dd3-afa1-09a87639f5ca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:18.894380 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60068306-2d18-4dd3-afa1-09a87639f5ca admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:18.904611 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 466/928] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Dec 15 15:59:18 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:18.906145 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2613d-8c4f-463d-b5a5-06a566a1b1cb admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:18.918454 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2613d-8c4f-463d-b5a5-06a566a1b1cb admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:18.924468 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e62b0-d2e8-4e46-bb2c-9cf5d718ed6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:18.925273 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e62b0-d2e8-4e46-bb2c-9cf5d718ed6b admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:18.925641 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e62b0-d2e8-4e46-bb2c-9cf5d718ed6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:18.925974 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e62b0-d2e8-4e46-bb2c-9cf5d718ed6b admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:18.926895 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e62b0-d2e8-4e46-bb2c-9cf5d718ed6b admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:18.927276 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e62b0-d2e8-4e46-bb2c-9cf5d718ed6b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:18.929286 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e62b0-d2e8-4e46-bb2c-9cf5d718ed6b admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:18.935668 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 463/929] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Dec 15 15:59:18 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:18.941704 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60068306-2d18-4dd3-afa1-09a87639f5ca admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:18.951355 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60068306-2d18-4dd3-afa1-09a87639f5ca admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:18.956208 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b459a5-a750-4e7b-8c36-a865741c78ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:18.956895 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b459a5-a750-4e7b-8c36-a865741c78ee admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:18.957179 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b459a5-a750-4e7b-8c36-a865741c78ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:18.957473 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b459a5-a750-4e7b-8c36-a865741c78ee admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:18.958281 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b459a5-a750-4e7b-8c36-a865741c78ee admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:18.959929 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b459a5-a750-4e7b-8c36-a865741c78ee admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:18.985700 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 467/930] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Dec 15 15:59:18 2021] POST /identity/v3/endpoints => generated 347 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:59:19.519204 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718b939-bb8a-4a3e-a7a3-b5deb92340ee None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:19.519600 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718b939-bb8a-4a3e-a7a3-b5deb92340ee None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:19.519774 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718b939-bb8a-4a3e-a7a3-b5deb92340ee None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:19.521888 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 464/931] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:19.528087 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dd815-3c01-4eb6-a7f2-4ce971a12405 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:19.528379 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dd815-3c01-4eb6-a7f2-4ce971a12405 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:19.528656 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dd815-3c01-4eb6-a7f2-4ce971a12405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:19.547075 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-518dd815-3c01-4eb6-a7f2-4ce971a12405 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:19.548300 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-518dd815-3c01-4eb6-a7f2-4ce971a12405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:19.566033 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 468/932] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:19 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:19.589418 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718b939-bb8a-4a3e-a7a3-b5deb92340ee None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:19.602318 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718b939-bb8a-4a3e-a7a3-b5deb92340ee None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:19.606801 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8117014-d387-4d97-a67c-1e4450fe52e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:19.607579 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8117014-d387-4d97-a67c-1e4450fe52e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:19.607903 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8117014-d387-4d97-a67c-1e4450fe52e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:19.608180 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8117014-d387-4d97-a67c-1e4450fe52e0 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:19.608842 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8117014-d387-4d97-a67c-1e4450fe52e0 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:19.610455 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8117014-d387-4d97-a67c-1e4450fe52e0 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:19.622359 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-c8117014-d387-4d97-a67c-1e4450fe52e0 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 15:59:19.623815 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 465/933] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Dec 15 15:59:19 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:19.630243 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dd815-3c01-4eb6-a7f2-4ce971a12405 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:19.639239 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dd815-3c01-4eb6-a7f2-4ce971a12405 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:19.643959 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22c8fe-49ce-4736-993a-3e8d58d9418b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:19.644612 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22c8fe-49ce-4736-993a-3e8d58d9418b admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:19.644893 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22c8fe-49ce-4736-993a-3e8d58d9418b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:19.645170 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22c8fe-49ce-4736-993a-3e8d58d9418b admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:19.645922 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed22c8fe-49ce-4736-993a-3e8d58d9418b admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:19.646227 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed22c8fe-49ce-4736-993a-3e8d58d9418b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:19.647830 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed22c8fe-49ce-4736-993a-3e8d58d9418b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:19.652844 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 469/934] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Dec 15 15:59:19 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:19.659881 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8117014-d387-4d97-a67c-1e4450fe52e0 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:19.669989 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8117014-d387-4d97-a67c-1e4450fe52e0 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:19.674680 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc00f2-c4c3-4c6f-9712-58726aa9766e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:19.675316 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc00f2-c4c3-4c6f-9712-58726aa9766e admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:19.675768 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc00f2-c4c3-4c6f-9712-58726aa9766e admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:19.676226 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc00f2-c4c3-4c6f-9712-58726aa9766e admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:19.677560 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc00f2-c4c3-4c6f-9712-58726aa9766e admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:19.678118 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc00f2-c4c3-4c6f-9712-58726aa9766e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:19.680986 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc00f2-c4c3-4c6f-9712-58726aa9766e admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:19.687187 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 466/935] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Dec 15 15:59:19 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:19.694096 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22c8fe-49ce-4736-993a-3e8d58d9418b admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:19.703773 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22c8fe-49ce-4736-993a-3e8d58d9418b admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:19.709123 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bef45-fc94-4e95-bca3-d8cd3a3aaf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:19.709813 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bef45-fc94-4e95-bca3-d8cd3a3aaf79 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:19.710097 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bef45-fc94-4e95-bca3-d8cd3a3aaf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:19.710374 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bef45-fc94-4e95-bca3-d8cd3a3aaf79 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:19.711174 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bef45-fc94-4e95-bca3-d8cd3a3aaf79 admin admin] RBAC: Adding query filter params (interface=public, service_id=e95ded32cf9a4ecc8373dc22608c1193, region_id=RegionOne) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:19.711482 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bef45-fc94-4e95-bca3-d8cd3a3aaf79 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:19.713140 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bef45-fc94-4e95-bca3-d8cd3a3aaf79 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:19.718973 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 470/936] 10.222.0.36 () {56 vars in 1272 bytes} [Wed Dec 15 15:59:19 2021] GET /identity/v3/endpoints?service_id=e95ded32cf9a4ecc8373dc22608c1193&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:19.724903 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc00f2-c4c3-4c6f-9712-58726aa9766e admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:19.734654 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc00f2-c4c3-4c6f-9712-58726aa9766e admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:19.739463 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4a8f1-97a2-4ded-bc55-0c7479435183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:19.740117 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4a8f1-97a2-4ded-bc55-0c7479435183 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:19.740397 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4a8f1-97a2-4ded-bc55-0c7479435183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:19.740671 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4a8f1-97a2-4ded-bc55-0c7479435183 admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:19.741434 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4a8f1-97a2-4ded-bc55-0c7479435183 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:19.743089 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4a8f1-97a2-4ded-bc55-0c7479435183 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:19.749538 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 467/937] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Dec 15 15:59:19 2021] GET /identity/v3/services => generated 1497 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 15:59:19.963896 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21265e2a-8b7c-4a24-a8a6-ff930138dce9 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:19.964592 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21265e2a-8b7c-4a24-a8a6-ff930138dce9 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:19.964592 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21265e2a-8b7c-4a24-a8a6-ff930138dce9 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:19.966726 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 471/938] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:19.973419 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e89a68-af23-4ada-bdd1-7b1fb6db2b94 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:19.973731 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e89a68-af23-4ada-bdd1-7b1fb6db2b94 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:19.973977 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e89a68-af23-4ada-bdd1-7b1fb6db2b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:19.995773 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-15e89a68-af23-4ada-bdd1-7b1fb6db2b94 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:19.997720 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-15e89a68-af23-4ada-bdd1-7b1fb6db2b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:20.009580 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 468/939] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:19 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:20.034971 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21265e2a-8b7c-4a24-a8a6-ff930138dce9 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:20.050578 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21265e2a-8b7c-4a24-a8a6-ff930138dce9 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:20.062805 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9ccca-4459-4fd1-a662-542648a20111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:20.064719 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9ccca-4459-4fd1-a662-542648a20111 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:20.065319 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9ccca-4459-4fd1-a662-542648a20111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:20.065810 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9ccca-4459-4fd1-a662-542648a20111 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:20.066708 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9ccca-4459-4fd1-a662-542648a20111 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:20.068540 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9ccca-4459-4fd1-a662-542648a20111 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:20.080520 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-4cd9ccca-4459-4fd1-a662-542648a20111 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 15 15:59:20.082311 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 472/940] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Dec 15 15:59:20 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:20.088800 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e89a68-af23-4ada-bdd1-7b1fb6db2b94 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:20.098780 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e89a68-af23-4ada-bdd1-7b1fb6db2b94 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:20.104112 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf5292-849c-4a73-8354-a16ff4aaad36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:20.105111 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf5292-849c-4a73-8354-a16ff4aaad36 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:20.105650 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf5292-849c-4a73-8354-a16ff4aaad36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:20.106105 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf5292-849c-4a73-8354-a16ff4aaad36 admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:20.107106 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf5292-849c-4a73-8354-a16ff4aaad36 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:20.107600 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf5292-849c-4a73-8354-a16ff4aaad36 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:20.109603 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf5292-849c-4a73-8354-a16ff4aaad36 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:20.116948 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 469/941] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Dec 15 15:59:20 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:20.123677 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9ccca-4459-4fd1-a662-542648a20111 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:20.135166 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9ccca-4459-4fd1-a662-542648a20111 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:20.140292 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583b0d8-7b5a-4a97-a487-0c3b35c3606b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:20.141228 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583b0d8-7b5a-4a97-a487-0c3b35c3606b admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:20.141768 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583b0d8-7b5a-4a97-a487-0c3b35c3606b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:20.142265 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583b0d8-7b5a-4a97-a487-0c3b35c3606b admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:20.143216 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583b0d8-7b5a-4a97-a487-0c3b35c3606b admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:20.143699 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583b0d8-7b5a-4a97-a487-0c3b35c3606b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:20.145577 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583b0d8-7b5a-4a97-a487-0c3b35c3606b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:20.151583 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 473/942] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Dec 15 15:59:20 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:20.158152 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf5292-849c-4a73-8354-a16ff4aaad36 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:20.168969 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf5292-849c-4a73-8354-a16ff4aaad36 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:20.174743 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9381d65-b475-483b-84e0-72c028b09a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:20.175656 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9381d65-b475-483b-84e0-72c028b09a21 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:20.176189 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9381d65-b475-483b-84e0-72c028b09a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:20.176651 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9381d65-b475-483b-84e0-72c028b09a21 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:20.177664 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9381d65-b475-483b-84e0-72c028b09a21 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:20.178909 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING py.warnings [None req-d9381d65-b475-483b-84e0-72c028b09a21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:59:20.178909 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: warnings.warn(msg) Dec 15 15:59:20.178909 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: Dec 15 15:59:20.180100 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9381d65-b475-483b-84e0-72c028b09a21 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:20.202256 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 470/943] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Dec 15 15:59:20 2021] POST /identity/v3/endpoints => generated 346 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 15:59:20.528803 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341729d1-2c0d-492e-8387-b6eb2e927ada None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:20.529181 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341729d1-2c0d-492e-8387-b6eb2e927ada None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:20.529353 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341729d1-2c0d-492e-8387-b6eb2e927ada None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:20.531381 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 474/944] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:20.538070 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79ce7a-8a13-488e-88c8-886339939643 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:20.538364 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79ce7a-8a13-488e-88c8-886339939643 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:20.538693 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79ce7a-8a13-488e-88c8-886339939643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:20.557286 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-1e79ce7a-8a13-488e-88c8-886339939643 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:20.558512 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-1e79ce7a-8a13-488e-88c8-886339939643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:20.575725 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 471/945] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:20 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:20.600539 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341729d1-2c0d-492e-8387-b6eb2e927ada None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:20.613765 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341729d1-2c0d-492e-8387-b6eb2e927ada None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:20.618358 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ae741-f9de-4569-bd9d-966630367240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:20.619256 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ae741-f9de-4569-bd9d-966630367240 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:20.619539 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ae741-f9de-4569-bd9d-966630367240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:20.619813 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ae741-f9de-4569-bd9d-966630367240 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:20.632084 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ae741-f9de-4569-bd9d-966630367240 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:59:20.639511 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-a80ae741-f9de-4569-bd9d-966630367240 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 15:59:20.640993 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 475/946] 10.222.0.36 () {56 vars in 1141 bytes} [Wed Dec 15 15:59:20 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:20.648109 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79ce7a-8a13-488e-88c8-886339939643 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:20.657643 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79ce7a-8a13-488e-88c8-886339939643 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:20.662324 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e97af5-ac71-4b44-a49b-614c9e417fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:20.663033 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e97af5-ac71-4b44-a49b-614c9e417fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:20.663319 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e97af5-ac71-4b44-a49b-614c9e417fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:20.663598 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e97af5-ac71-4b44-a49b-614c9e417fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:20.664548 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e97af5-ac71-4b44-a49b-614c9e417fb3 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:20.664858 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e97af5-ac71-4b44-a49b-614c9e417fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:20.666710 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e97af5-ac71-4b44-a49b-614c9e417fb3 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:20.676640 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 472/947] 10.222.0.36 () {56 vars in 1136 bytes} [Wed Dec 15 15:59:20 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:20.682798 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ae741-f9de-4569-bd9d-966630367240 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:20.693683 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ae741-f9de-4569-bd9d-966630367240 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:20.698434 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00e5f6-14b0-48f6-82c3-e33459feaa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:20.699266 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00e5f6-14b0-48f6-82c3-e33459feaa0e admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:20.699546 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00e5f6-14b0-48f6-82c3-e33459feaa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:20.699814 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00e5f6-14b0-48f6-82c3-e33459feaa0e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:20.711234 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00e5f6-14b0-48f6-82c3-e33459feaa0e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:20.713147 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00e5f6-14b0-48f6-82c3-e33459feaa0e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:20.731943 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-dd00e5f6-14b0-48f6-82c3-e33459feaa0e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:20.734511 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 476/948] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:20.743737 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e97af5-ac71-4b44-a49b-614c9e417fb3 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:20.752777 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e97af5-ac71-4b44-a49b-614c9e417fb3 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:20.757541 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca0a37-acf1-42e5-aa1b-a952fc8a0d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:20.758252 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca0a37-acf1-42e5-aa1b-a952fc8a0d2c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:20.758534 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca0a37-acf1-42e5-aa1b-a952fc8a0d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:20.758859 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca0a37-acf1-42e5-aa1b-a952fc8a0d2c admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:20.759593 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca0a37-acf1-42e5-aa1b-a952fc8a0d2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:20.759899 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca0a37-acf1-42e5-aa1b-a952fc8a0d2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:20.761611 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca0a37-acf1-42e5-aa1b-a952fc8a0d2c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:20.776691 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 473/949] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:20.782761 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00e5f6-14b0-48f6-82c3-e33459feaa0e admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:20.793098 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00e5f6-14b0-48f6-82c3-e33459feaa0e admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:20.797709 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1b6ed-d100-4430-a679-d41ad14f115a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:20.798550 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1b6ed-d100-4430-a679-d41ad14f115a admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:20.798837 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1b6ed-d100-4430-a679-d41ad14f115a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:20.799082 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1b6ed-d100-4430-a679-d41ad14f115a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:20.806449 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1b6ed-d100-4430-a679-d41ad14f115a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:20.808464 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1b6ed-d100-4430-a679-d41ad14f115a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:20.823121 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-ccd1b6ed-d100-4430-a679-d41ad14f115a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 15:59:20.824548 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 477/950] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Dec 15 15:59:20 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:20.831387 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca0a37-acf1-42e5-aa1b-a952fc8a0d2c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:20.843017 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca0a37-acf1-42e5-aa1b-a952fc8a0d2c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:20.848589 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd461616-675a-4149-983f-5aea5395076c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:20.849540 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd461616-675a-4149-983f-5aea5395076c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:20.849999 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd461616-675a-4149-983f-5aea5395076c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:20.850464 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd461616-675a-4149-983f-5aea5395076c admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:20.851532 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd461616-675a-4149-983f-5aea5395076c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:20.852065 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd461616-675a-4149-983f-5aea5395076c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:20.854218 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd461616-675a-4149-983f-5aea5395076c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:20.872593 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 474/951] 10.222.0.36 () {56 vars in 1170 bytes} [Wed Dec 15 15:59:20 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:20.879210 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1b6ed-d100-4430-a679-d41ad14f115a admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:20.889509 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1b6ed-d100-4430-a679-d41ad14f115a admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:20.894977 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673ffe6-3afa-4fae-bea0-311a897e39e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:20.895852 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673ffe6-3afa-4fae-bea0-311a897e39e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:20.896310 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673ffe6-3afa-4fae-bea0-311a897e39e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:20.896788 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673ffe6-3afa-4fae-bea0-311a897e39e5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:20.905335 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673ffe6-3afa-4fae-bea0-311a897e39e5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:20.907734 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673ffe6-3afa-4fae-bea0-311a897e39e5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:20.921307 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 478/952] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:59:20 2021] GET /identity/v3/auth/tokens => generated 2138 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 15:59:20.928141 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd461616-675a-4149-983f-5aea5395076c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:20.938542 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd461616-675a-4149-983f-5aea5395076c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:20.943605 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68691c9-b866-455e-8252-220f5135df2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:20.944615 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68691c9-b866-455e-8252-220f5135df2a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:20.945125 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68691c9-b866-455e-8252-220f5135df2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:20.945649 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68691c9-b866-455e-8252-220f5135df2a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:20.956913 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68691c9-b866-455e-8252-220f5135df2a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:20.959079 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68691c9-b866-455e-8252-220f5135df2a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:20.976966 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-c68691c9-b866-455e-8252-220f5135df2a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:20.978969 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 475/953] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:20.985146 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673ffe6-3afa-4fae-bea0-311a897e39e5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:20.995215 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673ffe6-3afa-4fae-bea0-311a897e39e5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:21.000426 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5209004-1efa-4295-8b89-060b1c334ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:21.001583 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5209004-1efa-4295-8b89-060b1c334ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:21.002206 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5209004-1efa-4295-8b89-060b1c334ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:21.002681 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5209004-1efa-4295-8b89-060b1c334ce6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:21.003642 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5209004-1efa-4295-8b89-060b1c334ce6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:21.004155 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5209004-1efa-4295-8b89-060b1c334ce6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:21.006074 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5209004-1efa-4295-8b89-060b1c334ce6 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:21.019556 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 479/954] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:21.025846 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68691c9-b866-455e-8252-220f5135df2a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:21.038283 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68691c9-b866-455e-8252-220f5135df2a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:21.045410 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865b77a-5d0c-4981-955d-61883b56e0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:21.045410 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865b77a-5d0c-4981-955d-61883b56e0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:21.045410 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865b77a-5d0c-4981-955d-61883b56e0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:21.045410 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865b77a-5d0c-4981-955d-61883b56e0d0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:21.052197 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865b77a-5d0c-4981-955d-61883b56e0d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:21.054418 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865b77a-5d0c-4981-955d-61883b56e0d0 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:21.068667 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-2865b77a-5d0c-4981-955d-61883b56e0d0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:59:21.070213 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 476/955] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:59:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:21.076574 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5209004-1efa-4295-8b89-060b1c334ce6 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:21.087843 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5209004-1efa-4295-8b89-060b1c334ce6 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:21.095164 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a9564-e6df-44be-a45c-86525b60bf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:21.096382 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a9564-e6df-44be-a45c-86525b60bf07 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:21.096940 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a9564-e6df-44be-a45c-86525b60bf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:21.097464 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a9564-e6df-44be-a45c-86525b60bf07 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:21.099115 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a9564-e6df-44be-a45c-86525b60bf07 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:21.099688 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a9564-e6df-44be-a45c-86525b60bf07 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:21.102090 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a9564-e6df-44be-a45c-86525b60bf07 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:21.117137 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 480/956] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:59:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:21.123583 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865b77a-5d0c-4981-955d-61883b56e0d0 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:21.134816 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865b77a-5d0c-4981-955d-61883b56e0d0 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:21.139371 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3abb62-5beb-4362-a2de-bb763cc6d696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:21.140015 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3abb62-5beb-4362-a2de-bb763cc6d696 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:21.140296 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3abb62-5beb-4362-a2de-bb763cc6d696 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:21.140571 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3abb62-5beb-4362-a2de-bb763cc6d696 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:21.141458 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3abb62-5beb-4362-a2de-bb763cc6d696 admin admin] RBAC: Adding query filter params (role.id=2c90a3a6a076416a94ab31da2efd66cc, scope.project.id=bc314fbc91c54810b27f9fcad7129c64, user.id=b2f47cbf62d44a6ba7e6a6f0f2305630) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:21.141829 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3abb62-5beb-4362-a2de-bb763cc6d696 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:21.143684 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3abb62-5beb-4362-a2de-bb763cc6d696 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:21.150168 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 477/957] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:59:21 2021] GET /identity/v3/role_assignments?user.id=b2f47cbf62d44a6ba7e6a6f0f2305630&scope.project.id=bc314fbc91c54810b27f9fcad7129c64&role.id=2c90a3a6a076416a94ab31da2efd66cc => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:21.513535 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f3463-b433-4774-9e2f-3fa65bd446fb None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:21.514195 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f3463-b433-4774-9e2f-3fa65bd446fb None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:21.514738 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f3463-b433-4774-9e2f-3fa65bd446fb None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:21.517549 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 481/958] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:21 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:21.523848 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abc41d-4f35-4b69-bc8f-fc00e087182f None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:21.524367 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abc41d-4f35-4b69-bc8f-fc00e087182f None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:21.524853 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abc41d-4f35-4b69-bc8f-fc00e087182f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:21.544178 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-17abc41d-4f35-4b69-bc8f-fc00e087182f None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:21.545398 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-17abc41d-4f35-4b69-bc8f-fc00e087182f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:21.553630 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 478/959] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:21 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 15:59:21.576758 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f3463-b433-4774-9e2f-3fa65bd446fb None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:21.589820 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f3463-b433-4774-9e2f-3fa65bd446fb None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:21.594336 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b00a93-3489-4f2a-8551-f4d611828719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:21.595669 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b00a93-3489-4f2a-8551-f4d611828719 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:21.595945 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b00a93-3489-4f2a-8551-f4d611828719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:21.596221 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b00a93-3489-4f2a-8551-f4d611828719 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:21.596884 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b00a93-3489-4f2a-8551-f4d611828719 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:21.598517 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b00a93-3489-4f2a-8551-f4d611828719 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:21.609564 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-d8b00a93-3489-4f2a-8551-f4d611828719 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 15 15:59:21.611140 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 482/960] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:59:21 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:21.617758 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abc41d-4f35-4b69-bc8f-fc00e087182f None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:21.627212 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abc41d-4f35-4b69-bc8f-fc00e087182f None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:21.632236 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea859d0f-26ee-43f7-bd68-6125bc925651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:21.632899 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea859d0f-26ee-43f7-bd68-6125bc925651 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:21.633184 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea859d0f-26ee-43f7-bd68-6125bc925651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:21.633499 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea859d0f-26ee-43f7-bd68-6125bc925651 admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:21.634232 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea859d0f-26ee-43f7-bd68-6125bc925651 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:21.634538 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea859d0f-26ee-43f7-bd68-6125bc925651 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:21.636144 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea859d0f-26ee-43f7-bd68-6125bc925651 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:21.642425 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 479/961] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Dec 15 15:59:21 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:21.648256 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b00a93-3489-4f2a-8551-f4d611828719 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:21.660528 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b00a93-3489-4f2a-8551-f4d611828719 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:21.665378 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053562a2-5982-4def-94f3-c36b72df033b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:21.666150 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053562a2-5982-4def-94f3-c36b72df033b admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:21.666434 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053562a2-5982-4def-94f3-c36b72df033b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:21.666708 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053562a2-5982-4def-94f3-c36b72df033b admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:21.667482 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053562a2-5982-4def-94f3-c36b72df033b admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:21.667786 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053562a2-5982-4def-94f3-c36b72df033b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:21.669494 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053562a2-5982-4def-94f3-c36b72df033b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:21.674988 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 483/962] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Dec 15 15:59:21 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:22.306703 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af1b37-6a5e-4d49-b81b-62bad56a8e3c None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:22.307675 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af1b37-6a5e-4d49-b81b-62bad56a8e3c None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:22.308184 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af1b37-6a5e-4d49-b81b-62bad56a8e3c None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:22.310494 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 480/963] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:22 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:22.316940 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea69d2-d8ac-45ba-8ff9-415db566bd6b None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:22.317780 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea69d2-d8ac-45ba-8ff9-415db566bd6b None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:22.318257 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea69d2-d8ac-45ba-8ff9-415db566bd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:22.337254 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-79ea69d2-d8ac-45ba-8ff9-415db566bd6b None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:22.338821 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-79ea69d2-d8ac-45ba-8ff9-415db566bd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:22.353583 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 484/964] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:22 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:22.373238 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af1b37-6a5e-4d49-b81b-62bad56a8e3c None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:22.386565 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af1b37-6a5e-4d49-b81b-62bad56a8e3c None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:22.391351 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15351d-bc35-4b65-9a6d-82f987b7dfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:22.393150 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15351d-bc35-4b65-9a6d-82f987b7dfef admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:22.393733 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15351d-bc35-4b65-9a6d-82f987b7dfef admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:22.394212 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15351d-bc35-4b65-9a6d-82f987b7dfef admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:22.395074 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15351d-bc35-4b65-9a6d-82f987b7dfef admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:22.396881 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15351d-bc35-4b65-9a6d-82f987b7dfef admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:22.409458 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-dd15351d-bc35-4b65-9a6d-82f987b7dfef admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 15:59:22.416318 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 481/965] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Dec 15 15:59:22 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:22.417898 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea69d2-d8ac-45ba-8ff9-415db566bd6b None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:22.428067 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea69d2-d8ac-45ba-8ff9-415db566bd6b None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:22.433038 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999b049-fcdf-406f-8739-aa55d689ca19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:22.433967 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999b049-fcdf-406f-8739-aa55d689ca19 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:22.434453 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999b049-fcdf-406f-8739-aa55d689ca19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:22.434940 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999b049-fcdf-406f-8739-aa55d689ca19 admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:22.435851 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999b049-fcdf-406f-8739-aa55d689ca19 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:22.436368 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999b049-fcdf-406f-8739-aa55d689ca19 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:22.438229 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999b049-fcdf-406f-8739-aa55d689ca19 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:22.449322 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 485/966] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Dec 15 15:59:22 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:22.450933 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15351d-bc35-4b65-9a6d-82f987b7dfef admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:22.461086 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15351d-bc35-4b65-9a6d-82f987b7dfef admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:22.466043 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95579c-b464-4a73-92bc-ae2b6467eced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:22.466938 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95579c-b464-4a73-92bc-ae2b6467eced admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:22.467419 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95579c-b464-4a73-92bc-ae2b6467eced admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:22.467896 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95579c-b464-4a73-92bc-ae2b6467eced admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:22.468811 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95579c-b464-4a73-92bc-ae2b6467eced admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:22.469332 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95579c-b464-4a73-92bc-ae2b6467eced admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:22.471194 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95579c-b464-4a73-92bc-ae2b6467eced admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:22.481484 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 482/967] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Dec 15 15:59:22 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:22.483533 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999b049-fcdf-406f-8739-aa55d689ca19 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:22.494249 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999b049-fcdf-406f-8739-aa55d689ca19 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:22.499185 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788e670-a92a-4dbc-a9f1-dab94533604e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:22.500051 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788e670-a92a-4dbc-a9f1-dab94533604e admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:22.500532 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788e670-a92a-4dbc-a9f1-dab94533604e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:22.501051 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788e670-a92a-4dbc-a9f1-dab94533604e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:22.502531 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788e670-a92a-4dbc-a9f1-dab94533604e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:22.504366 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788e670-a92a-4dbc-a9f1-dab94533604e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:22.533116 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 486/968] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Dec 15 15:59:22 2021] POST /identity/v3/endpoints => generated 349 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:59:22.800642 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4853305-bc4e-40d6-85dd-ce24facc5585 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:22.801023 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4853305-bc4e-40d6-85dd-ce24facc5585 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:22.801200 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4853305-bc4e-40d6-85dd-ce24facc5585 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:22.803009 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 483/969] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:22.809288 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec68b60-90e8-459f-be89-4a9a7e8e0ae8 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:22.809602 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec68b60-90e8-459f-be89-4a9a7e8e0ae8 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:22.809882 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec68b60-90e8-459f-be89-4a9a7e8e0ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:22.828375 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-6ec68b60-90e8-459f-be89-4a9a7e8e0ae8 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:22.830155 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-6ec68b60-90e8-459f-be89-4a9a7e8e0ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:22.848895 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 487/970] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:22 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:22.874531 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4853305-bc4e-40d6-85dd-ce24facc5585 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:22.888129 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4853305-bc4e-40d6-85dd-ce24facc5585 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:22.893475 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348990db-bcda-41cb-8e96-b8eeb010d483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:22.894162 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348990db-bcda-41cb-8e96-b8eeb010d483 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:22.894444 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348990db-bcda-41cb-8e96-b8eeb010d483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:22.894715 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348990db-bcda-41cb-8e96-b8eeb010d483 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:22.895523 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348990db-bcda-41cb-8e96-b8eeb010d483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:22.897443 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348990db-bcda-41cb-8e96-b8eeb010d483 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:22.898861 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.common [None req-348990db-bcda-41cb-8e96-b8eeb010d483 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 15 15:59:22.918169 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.sql.core [None req-348990db-bcda-41cb-8e96-b8eeb010d483 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Dec 15 15:59:22.918169 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Dec 15 15:59:22.918169 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [parameters: {'id': 'b22c8a9b017446dcb7b80b13d5992049', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Dec 15 15:59:22.918169 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79289) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 15 15:59:22.935648 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-348990db-bcda-41cb-8e96-b8eeb010d483 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b22c8a9b017446dcb7b80b13d5992049.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b22c8a9b017446dcb7b80b13d5992049. Dec 15 15:59:22.937515 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 484/971] 10.222.0.36 () {60 vars in 1161 bytes} [Wed Dec 15 15:59:22 2021] POST /identity/v3/projects => generated 262 bytes in 63 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:22.944605 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec68b60-90e8-459f-be89-4a9a7e8e0ae8 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:22.954877 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec68b60-90e8-459f-be89-4a9a7e8e0ae8 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:22.959794 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766ddb7-e03b-44a0-a169-a170bde4c71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:22.960575 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766ddb7-e03b-44a0-a169-a170bde4c71b admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:22.960855 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766ddb7-e03b-44a0-a169-a170bde4c71b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:22.961125 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766ddb7-e03b-44a0-a169-a170bde4c71b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:22.968842 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766ddb7-e03b-44a0-a169-a170bde4c71b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:22.971148 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766ddb7-e03b-44a0-a169-a170bde4c71b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:22.985968 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-4766ddb7-e03b-44a0-a169-a170bde4c71b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:59:22.987497 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 488/972] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:59:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:22.994033 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348990db-bcda-41cb-8e96-b8eeb010d483 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:23.004769 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348990db-bcda-41cb-8e96-b8eeb010d483 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:23.009775 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c6640-9964-4a7d-a8da-84a5baad4b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:23.010478 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c6640-9964-4a7d-a8da-84a5baad4b19 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:23.010802 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c6640-9964-4a7d-a8da-84a5baad4b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:23.011082 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c6640-9964-4a7d-a8da-84a5baad4b19 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:23.011965 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c6640-9964-4a7d-a8da-84a5baad4b19 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:23.012265 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c6640-9964-4a7d-a8da-84a5baad4b19 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:23.014459 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c6640-9964-4a7d-a8da-84a5baad4b19 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:23.040694 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 485/973] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Dec 15 15:59:22 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:23.617335 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9ab1e-7c76-4ee8-bb76-f4c146819ecc None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:23.617902 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9ab1e-7c76-4ee8-bb76-f4c146819ecc None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:23.617902 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9ab1e-7c76-4ee8-bb76-f4c146819ecc None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:23.619926 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 489/974] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:23.626484 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd8d25-328d-4ac2-8fc9-be227726a497 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:23.626997 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd8d25-328d-4ac2-8fc9-be227726a497 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:23.627127 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd8d25-328d-4ac2-8fc9-be227726a497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:23.646131 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-f7cd8d25-328d-4ac2-8fc9-be227726a497 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:23.647645 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f7cd8d25-328d-4ac2-8fc9-be227726a497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:23.656146 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 486/975] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:23 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:23.680461 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9ab1e-7c76-4ee8-bb76-f4c146819ecc None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:23.695077 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9ab1e-7c76-4ee8-bb76-f4c146819ecc None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:23.699775 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a830a31-9f2c-4549-8a61-6284731a4db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:23.700583 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a830a31-9f2c-4549-8a61-6284731a4db8 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:23.700861 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a830a31-9f2c-4549-8a61-6284731a4db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:23.701130 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a830a31-9f2c-4549-8a61-6284731a4db8 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:23.701836 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a830a31-9f2c-4549-8a61-6284731a4db8 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:23.703495 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a830a31-9f2c-4549-8a61-6284731a4db8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:23.715155 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-2a830a31-9f2c-4549-8a61-6284731a4db8 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 15 15:59:23.716718 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 490/976] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Dec 15 15:59:23 2021] GET /identity/v3/services/image => generated 86 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:23.723637 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd8d25-328d-4ac2-8fc9-be227726a497 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:23.732661 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd8d25-328d-4ac2-8fc9-be227726a497 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:23.738017 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d225b-153e-463f-a229-e6d4518b65c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:23.738678 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d225b-153e-463f-a229-e6d4518b65c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:23.738959 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d225b-153e-463f-a229-e6d4518b65c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:23.739237 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d225b-153e-463f-a229-e6d4518b65c8 admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:23.739958 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d225b-153e-463f-a229-e6d4518b65c8 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:23.740263 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d225b-153e-463f-a229-e6d4518b65c8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:23.741894 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d225b-153e-463f-a229-e6d4518b65c8 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:23.747311 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 487/977] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:23 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:23.754646 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a830a31-9f2c-4549-8a61-6284731a4db8 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:23.765071 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a830a31-9f2c-4549-8a61-6284731a4db8 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:23.769879 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45054a6b-b8f5-453f-b86d-b4a74bcc7dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:23.770585 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45054a6b-b8f5-453f-b86d-b4a74bcc7dad admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:23.770865 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45054a6b-b8f5-453f-b86d-b4a74bcc7dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:23.771137 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45054a6b-b8f5-453f-b86d-b4a74bcc7dad admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:23.771851 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45054a6b-b8f5-453f-b86d-b4a74bcc7dad admin admin] RBAC: Adding query filter params (type=image) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:23.772154 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45054a6b-b8f5-453f-b86d-b4a74bcc7dad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:23.773859 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45054a6b-b8f5-453f-b86d-b4a74bcc7dad admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:23.779103 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 491/978] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:23 2021] GET /identity/v3/services?type=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:24.140485 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78b11e-b080-4b82-bfbe-7060f9e05873 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:24.140867 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78b11e-b080-4b82-bfbe-7060f9e05873 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:24.141067 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78b11e-b080-4b82-bfbe-7060f9e05873 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:24.143622 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 488/979] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:24.149855 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ea399-3e73-4e3d-9996-cb943a8efb4d None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:24.150144 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ea399-3e73-4e3d-9996-cb943a8efb4d None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:24.150421 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ea399-3e73-4e3d-9996-cb943a8efb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:24.172312 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-5f1ea399-3e73-4e3d-9996-cb943a8efb4d None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:24.174481 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-5f1ea399-3e73-4e3d-9996-cb943a8efb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:24.183518 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 492/980] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:24 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:24.208470 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78b11e-b080-4b82-bfbe-7060f9e05873 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:24.222355 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78b11e-b080-4b82-bfbe-7060f9e05873 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:24.226852 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d70c2c-7189-4eb7-bc64-65b17f7ec17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:24.227511 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d70c2c-7189-4eb7-bc64-65b17f7ec17d admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:24.227796 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d70c2c-7189-4eb7-bc64-65b17f7ec17d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:24.228069 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d70c2c-7189-4eb7-bc64-65b17f7ec17d admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:24.228821 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d70c2c-7189-4eb7-bc64-65b17f7ec17d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:24.230448 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d70c2c-7189-4eb7-bc64-65b17f7ec17d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:24.246263 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 489/981] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Dec 15 15:59:24 2021] POST /identity/v3/services => generated 242 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:59:25.096993 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e1709-5c77-48e3-af17-3e5fe66e7475 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:25.098009 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e1709-5c77-48e3-af17-3e5fe66e7475 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:25.098494 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e1709-5c77-48e3-af17-3e5fe66e7475 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:25.100728 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 493/982] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:25 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:25.110110 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a1608-0ec2-4308-8eb5-73d27a477752 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:25.111312 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a1608-0ec2-4308-8eb5-73d27a477752 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:25.111688 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a1608-0ec2-4308-8eb5-73d27a477752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:25.142940 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-855a1608-0ec2-4308-8eb5-73d27a477752 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:25.144890 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-855a1608-0ec2-4308-8eb5-73d27a477752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:25.181535 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 490/983] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:25 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 15:59:25.216804 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e1709-5c77-48e3-af17-3e5fe66e7475 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:25.238058 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e1709-5c77-48e3-af17-3e5fe66e7475 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:25.245220 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf90f90-e517-48a0-a1d8-597b77301244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:25.246060 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf90f90-e517-48a0-a1d8-597b77301244 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:25.246343 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf90f90-e517-48a0-a1d8-597b77301244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:25.246615 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf90f90-e517-48a0-a1d8-597b77301244 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:25.247288 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf90f90-e517-48a0-a1d8-597b77301244 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:25.248888 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf90f90-e517-48a0-a1d8-597b77301244 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:25.260870 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-2cf90f90-e517-48a0-a1d8-597b77301244 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 15:59:25.262401 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 494/984] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Dec 15 15:59:25 2021] GET /identity/v3/services/object-store => generated 93 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:25.269684 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a1608-0ec2-4308-8eb5-73d27a477752 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:25.279247 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a1608-0ec2-4308-8eb5-73d27a477752 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:25.285328 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd793116-b965-4592-8925-fb39e430f284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:25.286356 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd793116-b965-4592-8925-fb39e430f284 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:25.286884 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd793116-b965-4592-8925-fb39e430f284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:25.287360 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd793116-b965-4592-8925-fb39e430f284 admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:25.288580 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd793116-b965-4592-8925-fb39e430f284 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:25.289173 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd793116-b965-4592-8925-fb39e430f284 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:25.291007 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd793116-b965-4592-8925-fb39e430f284 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:25.305299 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 491/985] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Dec 15 15:59:25 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:25.310472 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf90f90-e517-48a0-a1d8-597b77301244 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:25.320730 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf90f90-e517-48a0-a1d8-597b77301244 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:25.325762 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9a40b-f456-4abf-9b9b-80130a97729e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:25.326709 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9a40b-f456-4abf-9b9b-80130a97729e admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:25.327214 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9a40b-f456-4abf-9b9b-80130a97729e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:25.327735 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9a40b-f456-4abf-9b9b-80130a97729e admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:25.328661 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9a40b-f456-4abf-9b9b-80130a97729e admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:25.329964 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9a40b-f456-4abf-9b9b-80130a97729e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:25.331768 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9a40b-f456-4abf-9b9b-80130a97729e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:25.341507 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 495/986] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Dec 15 15:59:25 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:25.345224 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd793116-b965-4592-8925-fb39e430f284 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:25.355712 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd793116-b965-4592-8925-fb39e430f284 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:25.361321 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c05b16-74a7-4132-8976-04170afa183f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:25.362225 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c05b16-74a7-4132-8976-04170afa183f admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:25.362760 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c05b16-74a7-4132-8976-04170afa183f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:25.363233 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c05b16-74a7-4132-8976-04170afa183f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:25.364298 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c05b16-74a7-4132-8976-04170afa183f admin admin] RBAC: Adding query filter params (interface=admin, service_id=e95ded32cf9a4ecc8373dc22608c1193, region_id=RegionOne) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:25.364809 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c05b16-74a7-4132-8976-04170afa183f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:25.368078 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c05b16-74a7-4132-8976-04170afa183f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:25.380744 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 492/987] 10.222.0.36 () {56 vars in 1270 bytes} [Wed Dec 15 15:59:25 2021] GET /identity/v3/endpoints?service_id=e95ded32cf9a4ecc8373dc22608c1193&interface=admin®ion_id=RegionOne => generated 193 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:25.382440 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9a40b-f456-4abf-9b9b-80130a97729e admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:25.393780 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9a40b-f456-4abf-9b9b-80130a97729e admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:25.398822 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73a49d-cf9d-47ad-b466-4be71b81aec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:25.399739 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73a49d-cf9d-47ad-b466-4be71b81aec7 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:25.400276 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73a49d-cf9d-47ad-b466-4be71b81aec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:25.400762 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73a49d-cf9d-47ad-b466-4be71b81aec7 admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:25.401746 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73a49d-cf9d-47ad-b466-4be71b81aec7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:25.403623 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73a49d-cf9d-47ad-b466-4be71b81aec7 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:25.417554 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 496/988] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Dec 15 15:59:25 2021] GET /identity/v3/services => generated 1727 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 15:59:26.059882 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd7f9e-61e2-43a9-870e-cca4a77a24f2 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:26.060248 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd7f9e-61e2-43a9-870e-cca4a77a24f2 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:26.060579 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd7f9e-61e2-43a9-870e-cca4a77a24f2 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:26.062764 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 493/989] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:26.069173 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e412c-2c42-4642-be26-36802401373c None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:26.069614 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e412c-2c42-4642-be26-36802401373c None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:26.069929 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e412c-2c42-4642-be26-36802401373c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:26.090162 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-c34e412c-2c42-4642-be26-36802401373c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:26.091420 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-c34e412c-2c42-4642-be26-36802401373c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:26.101034 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 497/990] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:26 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:26.126638 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd7f9e-61e2-43a9-870e-cca4a77a24f2 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:26.138761 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd7f9e-61e2-43a9-870e-cca4a77a24f2 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:26.144100 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c1989-2cd4-4016-b405-5fe29bf6ce4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:26.144768 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c1989-2cd4-4016-b405-5fe29bf6ce4b admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:26.145052 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c1989-2cd4-4016-b405-5fe29bf6ce4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:26.145326 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c1989-2cd4-4016-b405-5fe29bf6ce4b admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:26.146142 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c1989-2cd4-4016-b405-5fe29bf6ce4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:26.147987 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c1989-2cd4-4016-b405-5fe29bf6ce4b admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:26.161991 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.sql.core [None req-c67c1989-2cd4-4016-b405-5fe29bf6ce4b admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Dec 15 15:59:26.161991 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Dec 15 15:59:26.161991 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [parameters: {'user_id': '202d4cb13ee1426c815ff86caf573e09', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Dec 15 15:59:26.161991 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79289) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 15 15:59:26.168287 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-c67c1989-2cd4-4016-b405-5fe29bf6ce4b admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Dec 15 15:59:26.169933 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 494/991] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 15:59:26 2021] POST /identity/v3/users => generated 160 bytes in 44 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:26.176151 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e412c-2c42-4642-be26-36802401373c None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:26.185152 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e412c-2c42-4642-be26-36802401373c None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:26.190319 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ca466-6697-4375-8cc3-7d543a59644c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:26.191103 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ca466-6697-4375-8cc3-7d543a59644c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:26.191377 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ca466-6697-4375-8cc3-7d543a59644c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:26.191648 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ca466-6697-4375-8cc3-7d543a59644c admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:26.199300 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ca466-6697-4375-8cc3-7d543a59644c admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:26.201333 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ca466-6697-4375-8cc3-7d543a59644c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:26.219277 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-7b6ca466-6697-4375-8cc3-7d543a59644c admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 15 15:59:26.221617 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 498/992] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:59:26 2021] GET /identity/v3/users/cinder => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:26.229176 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c1989-2cd4-4016-b405-5fe29bf6ce4b admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:26.242016 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c1989-2cd4-4016-b405-5fe29bf6ce4b admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:26.247451 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0083f-284c-4c13-a899-4967385d3129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:26.248192 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0083f-284c-4c13-a899-4967385d3129 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:26.248507 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0083f-284c-4c13-a899-4967385d3129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:26.248876 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0083f-284c-4c13-a899-4967385d3129 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:26.249832 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0083f-284c-4c13-a899-4967385d3129 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:26.250230 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0083f-284c-4c13-a899-4967385d3129 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:26.252765 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0083f-284c-4c13-a899-4967385d3129 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:26.306297 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 495/993] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Dec 15 15:59:26 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:26.450734 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0b11f-0839-4f5e-987f-f6104d586be0 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:26.451137 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0b11f-0839-4f5e-987f-f6104d586be0 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:26.451309 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0b11f-0839-4f5e-987f-f6104d586be0 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:26.453422 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 499/994] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:26.460677 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25a899-cb36-4568-ba20-4e650dc6144a None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:26.460983 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25a899-cb36-4568-ba20-4e650dc6144a None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:26.461229 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25a899-cb36-4568-ba20-4e650dc6144a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:26.480706 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-ae25a899-cb36-4568-ba20-4e650dc6144a None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:26.482321 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-ae25a899-cb36-4568-ba20-4e650dc6144a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:26.490909 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 496/995] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:26 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:26.515526 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0b11f-0839-4f5e-987f-f6104d586be0 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:26.529475 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0b11f-0839-4f5e-987f-f6104d586be0 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:26.534591 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcb3df-21c6-42ee-b692-5fe6d66e4984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:26.535276 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcb3df-21c6-42ee-b692-5fe6d66e4984 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:26.535558 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcb3df-21c6-42ee-b692-5fe6d66e4984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:26.535833 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcb3df-21c6-42ee-b692-5fe6d66e4984 admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:26.536606 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcb3df-21c6-42ee-b692-5fe6d66e4984 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:26.538271 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcb3df-21c6-42ee-b692-5fe6d66e4984 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:26.554408 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 500/996] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Dec 15 15:59:26 2021] POST /identity/v3/services => generated 242 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:59:26.938827 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca87c27-ec53-42ad-aceb-3e62fe6bd562 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:26.939229 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca87c27-ec53-42ad-aceb-3e62fe6bd562 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:26.939804 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca87c27-ec53-42ad-aceb-3e62fe6bd562 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:26.941188 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 497/997] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:26.946863 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c824c4-5f96-47d2-aa1e-76aad23bee05 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:26.947157 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c824c4-5f96-47d2-aa1e-76aad23bee05 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:26.947438 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c824c4-5f96-47d2-aa1e-76aad23bee05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:26.967296 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-27c824c4-5f96-47d2-aa1e-76aad23bee05 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:26.968543 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-27c824c4-5f96-47d2-aa1e-76aad23bee05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:26.986840 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 501/998] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:26 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:27.013712 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca87c27-ec53-42ad-aceb-3e62fe6bd562 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:27.026505 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca87c27-ec53-42ad-aceb-3e62fe6bd562 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:27.030968 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043a479-018f-4bc3-9527-095e8412b0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:27.031729 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043a479-018f-4bc3-9527-095e8412b0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:27.032836 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043a479-018f-4bc3-9527-095e8412b0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:27.033120 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043a479-018f-4bc3-9527-095e8412b0a3 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:27.033892 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043a479-018f-4bc3-9527-095e8412b0a3 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:27.035478 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043a479-018f-4bc3-9527-095e8412b0a3 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:27.049236 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-a043a479-018f-4bc3-9527-095e8412b0a3 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 15 15:59:27.050626 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 498/999] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:59:27 2021] GET /identity/v3/services/compute => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:27.056773 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c824c4-5f96-47d2-aa1e-76aad23bee05 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:27.066405 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c824c4-5f96-47d2-aa1e-76aad23bee05 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:27.070971 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17fe30-56ca-4464-8237-12e4982039e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:27.071612 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17fe30-56ca-4464-8237-12e4982039e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:27.071895 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17fe30-56ca-4464-8237-12e4982039e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:27.072167 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17fe30-56ca-4464-8237-12e4982039e0 admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:27.072877 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17fe30-56ca-4464-8237-12e4982039e0 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:27.073177 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17fe30-56ca-4464-8237-12e4982039e0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:27.074798 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17fe30-56ca-4464-8237-12e4982039e0 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:27.080401 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 502/1000] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Dec 15 15:59:27 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:27.086153 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043a479-018f-4bc3-9527-095e8412b0a3 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:27.095774 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043a479-018f-4bc3-9527-095e8412b0a3 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:27.100417 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb0170-f654-486b-be26-789bb91e55fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:27.101049 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb0170-f654-486b-be26-789bb91e55fa admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:27.101329 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb0170-f654-486b-be26-789bb91e55fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:27.101635 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb0170-f654-486b-be26-789bb91e55fa admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:27.102342 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb0170-f654-486b-be26-789bb91e55fa admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:27.102649 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb0170-f654-486b-be26-789bb91e55fa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:27.104224 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb0170-f654-486b-be26-789bb91e55fa admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:27.109343 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 499/1001] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Dec 15 15:59:27 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:27.115281 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17fe30-56ca-4464-8237-12e4982039e0 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:27.124980 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17fe30-56ca-4464-8237-12e4982039e0 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:27.130163 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d9f2c-eaa1-41fa-9c4e-3d5da9dbd222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:27.130860 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d9f2c-eaa1-41fa-9c4e-3d5da9dbd222 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:27.131231 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d9f2c-eaa1-41fa-9c4e-3d5da9dbd222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:27.131571 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d9f2c-eaa1-41fa-9c4e-3d5da9dbd222 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:27.132420 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d9f2c-eaa1-41fa-9c4e-3d5da9dbd222 admin admin] RBAC: Adding query filter params (interface=public, service_id=a38cdc7714d14f5781c596776fcbde5c, region_id=RegionOne) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:27.132796 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d9f2c-eaa1-41fa-9c4e-3d5da9dbd222 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:27.134480 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d9f2c-eaa1-41fa-9c4e-3d5da9dbd222 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:27.139542 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 503/1002] 10.222.0.36 () {56 vars in 1272 bytes} [Wed Dec 15 15:59:27 2021] GET /identity/v3/endpoints?service_id=a38cdc7714d14f5781c596776fcbde5c&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:27.145778 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb0170-f654-486b-be26-789bb91e55fa admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:27.155375 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb0170-f654-486b-be26-789bb91e55fa admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:27.160482 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6f1aa-e1ad-44b9-9f46-a19f2f104c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:27.161210 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6f1aa-e1ad-44b9-9f46-a19f2f104c94 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:27.161589 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6f1aa-e1ad-44b9-9f46-a19f2f104c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:27.161961 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6f1aa-e1ad-44b9-9f46-a19f2f104c94 admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:27.162691 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6f1aa-e1ad-44b9-9f46-a19f2f104c94 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:27.164343 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6f1aa-e1ad-44b9-9f46-a19f2f104c94 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:27.171173 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 500/1003] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Dec 15 15:59:27 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 15:59:27.935417 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdcb4a-72c5-42d7-b13a-3d68923cfa83 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:27.935814 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdcb4a-72c5-42d7-b13a-3d68923cfa83 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:27.935991 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdcb4a-72c5-42d7-b13a-3d68923cfa83 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:27.937906 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 504/1004] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:59:27.944701 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a53bb3-1f8f-42ad-8207-bb70f942deee None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:27.944988 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a53bb3-1f8f-42ad-8207-bb70f942deee None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:27.945264 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a53bb3-1f8f-42ad-8207-bb70f942deee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:27.965701 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-25a53bb3-1f8f-42ad-8207-bb70f942deee None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:27.967041 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-25a53bb3-1f8f-42ad-8207-bb70f942deee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:27.976204 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 501/1005] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:27 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:28.013487 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdcb4a-72c5-42d7-b13a-3d68923cfa83 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:28.029985 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdcb4a-72c5-42d7-b13a-3d68923cfa83 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:28.039115 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0652768-1f48-45af-815b-0912215a62f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:28.039115 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0652768-1f48-45af-815b-0912215a62f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:28.039115 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0652768-1f48-45af-815b-0912215a62f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:28.039115 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0652768-1f48-45af-815b-0912215a62f6 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:28.039974 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0652768-1f48-45af-815b-0912215a62f6 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:28.041561 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0652768-1f48-45af-815b-0912215a62f6 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:28.056416 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-a0652768-1f48-45af-815b-0912215a62f6 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 15:59:28.061445 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 505/1006] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Dec 15 15:59:28 2021] GET /identity/v3/services/object-store => generated 93 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:28.065600 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a53bb3-1f8f-42ad-8207-bb70f942deee None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:28.074692 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a53bb3-1f8f-42ad-8207-bb70f942deee None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:28.080656 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043d93b-4ccf-4598-910c-d010c17f0acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:28.081309 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043d93b-4ccf-4598-910c-d010c17f0acb admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:28.081635 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043d93b-4ccf-4598-910c-d010c17f0acb admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:28.081910 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043d93b-4ccf-4598-910c-d010c17f0acb admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:28.082632 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043d93b-4ccf-4598-910c-d010c17f0acb admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:28.082940 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043d93b-4ccf-4598-910c-d010c17f0acb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:28.084536 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043d93b-4ccf-4598-910c-d010c17f0acb admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:28.089701 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 502/1007] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Dec 15 15:59:28 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:28.096081 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0652768-1f48-45af-815b-0912215a62f6 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:28.105900 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0652768-1f48-45af-815b-0912215a62f6 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:28.110441 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d63bf-5c06-46c4-b32f-e168e5916aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:28.111165 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d63bf-5c06-46c4-b32f-e168e5916aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:28.111443 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d63bf-5c06-46c4-b32f-e168e5916aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:28.111712 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d63bf-5c06-46c4-b32f-e168e5916aa3 admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:28.112416 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d63bf-5c06-46c4-b32f-e168e5916aa3 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:28.112715 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d63bf-5c06-46c4-b32f-e168e5916aa3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:28.114330 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d63bf-5c06-46c4-b32f-e168e5916aa3 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:28.121481 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 506/1008] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Dec 15 15:59:28 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:28.126929 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043d93b-4ccf-4598-910c-d010c17f0acb admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:28.136644 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043d93b-4ccf-4598-910c-d010c17f0acb admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:28.141832 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7e414-81f5-4ea9-9ba9-db72b7e9aa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:28.142502 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7e414-81f5-4ea9-9ba9-db72b7e9aa39 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:28.142784 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7e414-81f5-4ea9-9ba9-db72b7e9aa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:28.143051 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7e414-81f5-4ea9-9ba9-db72b7e9aa39 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:28.143801 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7e414-81f5-4ea9-9ba9-db72b7e9aa39 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:28.145369 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7e414-81f5-4ea9-9ba9-db72b7e9aa39 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:28.161543 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 503/1009] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Dec 15 15:59:28 2021] POST /identity/v3/endpoints => generated 325 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:59:28.991323 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b79786-4b19-4fa9-966d-a85b7c1d6861 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:28.991732 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b79786-4b19-4fa9-966d-a85b7c1d6861 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:28.992001 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b79786-4b19-4fa9-966d-a85b7c1d6861 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:28.993929 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 507/1010] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:28.999555 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad4804-bff3-40a1-93aa-f980df3f362c None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:28.999849 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad4804-bff3-40a1-93aa-f980df3f362c None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:29.000128 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad4804-bff3-40a1-93aa-f980df3f362c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:29.020029 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-32ad4804-bff3-40a1-93aa-f980df3f362c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:29.021230 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-32ad4804-bff3-40a1-93aa-f980df3f362c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:29.041332 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 504/1011] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:28 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:29.066803 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b79786-4b19-4fa9-966d-a85b7c1d6861 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:29.079454 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b79786-4b19-4fa9-966d-a85b7c1d6861 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:29.083831 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e74c20-43de-43be-ade4-039ffa310b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:29.084599 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e74c20-43de-43be-ade4-039ffa310b2f admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:29.084883 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e74c20-43de-43be-ade4-039ffa310b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:29.085156 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e74c20-43de-43be-ade4-039ffa310b2f admin admin] PATH_INFO: `/v3/services/image` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:29.085847 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e74c20-43de-43be-ade4-039ffa310b2f admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:29.087448 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e74c20-43de-43be-ade4-039ffa310b2f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:29.099728 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-27e74c20-43de-43be-ade4-039ffa310b2f admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 15 15:59:29.101087 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 508/1012] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Dec 15 15:59:29 2021] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:29.107444 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad4804-bff3-40a1-93aa-f980df3f362c None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:29.118045 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad4804-bff3-40a1-93aa-f980df3f362c None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:29.122693 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da348e-026c-428e-8a43-5986d3284009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:29.123348 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da348e-026c-428e-8a43-5986d3284009 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:29.123632 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da348e-026c-428e-8a43-5986d3284009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:29.123910 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da348e-026c-428e-8a43-5986d3284009 admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:29.124661 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da348e-026c-428e-8a43-5986d3284009 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:29.124937 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da348e-026c-428e-8a43-5986d3284009 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:29.127560 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da348e-026c-428e-8a43-5986d3284009 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:29.132922 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 505/1013] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:29 2021] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:29.139007 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e74c20-43de-43be-ade4-039ffa310b2f admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:29.149879 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e74c20-43de-43be-ade4-039ffa310b2f admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:29.154473 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ddccd-ca9c-431e-a115-8cc71dc6ff14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:29.155110 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ddccd-ca9c-431e-a115-8cc71dc6ff14 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:29.155396 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ddccd-ca9c-431e-a115-8cc71dc6ff14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:29.155672 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ddccd-ca9c-431e-a115-8cc71dc6ff14 admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:29.156380 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ddccd-ca9c-431e-a115-8cc71dc6ff14 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:29.156729 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ddccd-ca9c-431e-a115-8cc71dc6ff14 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:29.158965 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ddccd-ca9c-431e-a115-8cc71dc6ff14 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:29.164066 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 509/1014] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:29 2021] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:29.170292 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da348e-026c-428e-8a43-5986d3284009 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:29.181138 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da348e-026c-428e-8a43-5986d3284009 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:29.185756 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cff4e-cf14-4bb1-b9fb-0b5762ad42f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:29.186492 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cff4e-cf14-4bb1-b9fb-0b5762ad42f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:29.186846 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cff4e-cf14-4bb1-b9fb-0b5762ad42f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:29.187191 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cff4e-cf14-4bb1-b9fb-0b5762ad42f5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:29.188653 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cff4e-cf14-4bb1-b9fb-0b5762ad42f5 admin admin] RBAC: Adding query filter params (interface=public, service_id=cd025b37ea9d4737894ecec5508e0c96, region_id=RegionOne) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:29.189268 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cff4e-cf14-4bb1-b9fb-0b5762ad42f5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:29.191022 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cff4e-cf14-4bb1-b9fb-0b5762ad42f5 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:29.196411 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 506/1015] 10.222.0.36 () {56 vars in 1272 bytes} [Wed Dec 15 15:59:29 2021] GET /identity/v3/endpoints?service_id=cd025b37ea9d4737894ecec5508e0c96&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:29.202383 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ddccd-ca9c-431e-a115-8cc71dc6ff14 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:29.212647 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ddccd-ca9c-431e-a115-8cc71dc6ff14 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:29.217148 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcc00c-6731-44f5-a02c-c6d8de1a1292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:29.217824 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcc00c-6731-44f5-a02c-c6d8de1a1292 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:29.218110 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcc00c-6731-44f5-a02c-c6d8de1a1292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:29.218386 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcc00c-6731-44f5-a02c-c6d8de1a1292 admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:29.219144 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcc00c-6731-44f5-a02c-c6d8de1a1292 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:29.221330 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcc00c-6731-44f5-a02c-c6d8de1a1292 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:29.228353 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 510/1016] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Dec 15 15:59:29 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 15:59:29.819451 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e12a2-79cd-420b-8578-59652eae9d70 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:29.819860 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e12a2-79cd-420b-8578-59652eae9d70 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:29.820119 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e12a2-79cd-420b-8578-59652eae9d70 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:29.821915 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 507/1017] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:29.827740 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85385283-75cb-4a62-9578-ff8740a0bbbe None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:29.828104 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85385283-75cb-4a62-9578-ff8740a0bbbe None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:29.828456 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85385283-75cb-4a62-9578-ff8740a0bbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:29.846223 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-85385283-75cb-4a62-9578-ff8740a0bbbe None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:29.847425 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-85385283-75cb-4a62-9578-ff8740a0bbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:29.855188 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 511/1018] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:29 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 15:59:29.880502 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e12a2-79cd-420b-8578-59652eae9d70 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:29.892738 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e12a2-79cd-420b-8578-59652eae9d70 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:29.897052 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada3aca-b4a6-4ac2-ae0f-33d99d2fb92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:29.897852 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada3aca-b4a6-4ac2-ae0f-33d99d2fb92c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:29.898138 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada3aca-b4a6-4ac2-ae0f-33d99d2fb92c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:29.898413 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada3aca-b4a6-4ac2-ae0f-33d99d2fb92c admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:29.899084 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada3aca-b4a6-4ac2-ae0f-33d99d2fb92c admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:29.900667 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada3aca-b4a6-4ac2-ae0f-33d99d2fb92c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:29.917136 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-7ada3aca-b4a6-4ac2-ae0f-33d99d2fb92c admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 15 15:59:29.919640 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 508/1019] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:59:29 2021] GET /identity/v3/services/compute => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:29.926809 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85385283-75cb-4a62-9578-ff8740a0bbbe None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:29.938702 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85385283-75cb-4a62-9578-ff8740a0bbbe None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:29.944613 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f47b1-b6d4-46c6-bb50-37e441e0431d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:29.945271 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f47b1-b6d4-46c6-bb50-37e441e0431d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:29.945583 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f47b1-b6d4-46c6-bb50-37e441e0431d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:29.945859 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f47b1-b6d4-46c6-bb50-37e441e0431d admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:29.946583 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f47b1-b6d4-46c6-bb50-37e441e0431d admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:29.946890 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f47b1-b6d4-46c6-bb50-37e441e0431d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:29.948487 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f47b1-b6d4-46c6-bb50-37e441e0431d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:29.953879 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 512/1020] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Dec 15 15:59:29 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:29.960060 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada3aca-b4a6-4ac2-ae0f-33d99d2fb92c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:29.970153 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada3aca-b4a6-4ac2-ae0f-33d99d2fb92c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:29.975247 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c1531-a823-4158-9fd6-b775cca46a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:29.976358 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c1531-a823-4158-9fd6-b775cca46a90 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:29.976867 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c1531-a823-4158-9fd6-b775cca46a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:29.977338 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c1531-a823-4158-9fd6-b775cca46a90 admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:29.978720 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c1531-a823-4158-9fd6-b775cca46a90 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:29.979291 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c1531-a823-4158-9fd6-b775cca46a90 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:29.981544 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c1531-a823-4158-9fd6-b775cca46a90 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:29.988341 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 509/1021] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Dec 15 15:59:29 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:29.994348 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f47b1-b6d4-46c6-bb50-37e441e0431d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:30.005011 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f47b1-b6d4-46c6-bb50-37e441e0431d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:30.009655 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5464790-aeed-4a73-8708-e5f4c682fec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:30.010370 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5464790-aeed-4a73-8708-e5f4c682fec2 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:30.010721 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5464790-aeed-4a73-8708-e5f4c682fec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:30.011066 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5464790-aeed-4a73-8708-e5f4c682fec2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:30.011908 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5464790-aeed-4a73-8708-e5f4c682fec2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:30.013602 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5464790-aeed-4a73-8708-e5f4c682fec2 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:30.035423 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 513/1022] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Dec 15 15:59:29 2021] POST /identity/v3/endpoints => generated 334 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 15:59:30.571057 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85cce3-d423-4d12-83b2-5fef0cd29552 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:30.571655 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85cce3-d423-4d12-83b2-5fef0cd29552 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:30.571655 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85cce3-d423-4d12-83b2-5fef0cd29552 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:30.573502 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 510/1023] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:30.579152 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af7466-c75f-4f94-a64c-b8ed74a9d609 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:30.579549 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af7466-c75f-4f94-a64c-b8ed74a9d609 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:30.579709 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af7466-c75f-4f94-a64c-b8ed74a9d609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:30.597113 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-67af7466-c75f-4f94-a64c-b8ed74a9d609 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:30.598345 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-67af7466-c75f-4f94-a64c-b8ed74a9d609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:30.615411 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 514/1024] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:30 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:30.639902 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85cce3-d423-4d12-83b2-5fef0cd29552 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:30.653077 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85cce3-d423-4d12-83b2-5fef0cd29552 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:30.657801 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff2594-9a8f-41d6-8bed-e62f67bbd367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:30.658628 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff2594-9a8f-41d6-8bed-e62f67bbd367 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:30.658907 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff2594-9a8f-41d6-8bed-e62f67bbd367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:30.659219 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff2594-9a8f-41d6-8bed-e62f67bbd367 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:30.660398 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff2594-9a8f-41d6-8bed-e62f67bbd367 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:30.662093 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff2594-9a8f-41d6-8bed-e62f67bbd367 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:30.663812 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 511/1025] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:30 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:30.669918 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af7466-c75f-4f94-a64c-b8ed74a9d609 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:30.679505 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af7466-c75f-4f94-a64c-b8ed74a9d609 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:30.683866 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2438c8-a279-476d-b8f0-44ed268a624e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:30.684502 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2438c8-a279-476d-b8f0-44ed268a624e admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:30.684778 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2438c8-a279-476d-b8f0-44ed268a624e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:30.685048 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2438c8-a279-476d-b8f0-44ed268a624e admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:30.685801 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2438c8-a279-476d-b8f0-44ed268a624e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:30.687737 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2438c8-a279-476d-b8f0-44ed268a624e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:30.714563 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 515/1026] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Dec 15 15:59:30 2021] POST /identity/v3/projects => generated 311 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:59:31.809656 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815df76-a364-401a-bdac-61c26dc1e1f6 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:31.810301 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815df76-a364-401a-bdac-61c26dc1e1f6 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:31.810301 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815df76-a364-401a-bdac-61c26dc1e1f6 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:31.812213 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 512/1027] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:31.818948 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e0ed4-8124-42c3-9383-7637b75224e1 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:31.819420 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e0ed4-8124-42c3-9383-7637b75224e1 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:31.819507 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e0ed4-8124-42c3-9383-7637b75224e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:31.837801 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-485e0ed4-8124-42c3-9383-7637b75224e1 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:31.838994 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-485e0ed4-8124-42c3-9383-7637b75224e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:31.896985 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 516/1028] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:31 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:31.921486 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815df76-a364-401a-bdac-61c26dc1e1f6 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:31.934831 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815df76-a364-401a-bdac-61c26dc1e1f6 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:31.940275 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9314c34-c57d-4f6d-b6b9-213a60f49374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:31.941061 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9314c34-c57d-4f6d-b6b9-213a60f49374 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:31.941346 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9314c34-c57d-4f6d-b6b9-213a60f49374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:31.941653 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9314c34-c57d-4f6d-b6b9-213a60f49374 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:31.942321 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9314c34-c57d-4f6d-b6b9-213a60f49374 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:31.943925 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9314c34-c57d-4f6d-b6b9-213a60f49374 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:31.955282 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-c9314c34-c57d-4f6d-b6b9-213a60f49374 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 15 15:59:31.956605 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 513/1029] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Dec 15 15:59:31 2021] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:31.962974 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e0ed4-8124-42c3-9383-7637b75224e1 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:31.972486 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e0ed4-8124-42c3-9383-7637b75224e1 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:31.978563 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a172965-d786-4f09-85e9-6686330a4e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:31.979309 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a172965-d786-4f09-85e9-6686330a4e60 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:31.979596 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a172965-d786-4f09-85e9-6686330a4e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:31.979871 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a172965-d786-4f09-85e9-6686330a4e60 admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:31.980585 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a172965-d786-4f09-85e9-6686330a4e60 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:31.980894 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a172965-d786-4f09-85e9-6686330a4e60 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:31.982537 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a172965-d786-4f09-85e9-6686330a4e60 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:31.988954 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 517/1030] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:31 2021] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:31.994345 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9314c34-c57d-4f6d-b6b9-213a60f49374 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:32.005508 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9314c34-c57d-4f6d-b6b9-213a60f49374 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:32.009998 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f19b5-e32d-4066-95bd-91c505490d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:32.010644 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f19b5-e32d-4066-95bd-91c505490d9b admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:32.010931 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f19b5-e32d-4066-95bd-91c505490d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:32.011217 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f19b5-e32d-4066-95bd-91c505490d9b admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:32.011932 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f19b5-e32d-4066-95bd-91c505490d9b admin admin] RBAC: Adding query filter params (type=image) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:32.012240 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f19b5-e32d-4066-95bd-91c505490d9b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:32.013864 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f19b5-e32d-4066-95bd-91c505490d9b admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:32.019376 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 514/1031] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:31 2021] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:32.025483 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a172965-d786-4f09-85e9-6686330a4e60 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:32.035913 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a172965-d786-4f09-85e9-6686330a4e60 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:32.045299 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee489557-8f32-4282-b02c-96874aadd775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:32.046060 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee489557-8f32-4282-b02c-96874aadd775 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:32.046343 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee489557-8f32-4282-b02c-96874aadd775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:32.046616 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee489557-8f32-4282-b02c-96874aadd775 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:32.047865 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee489557-8f32-4282-b02c-96874aadd775 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:32.049553 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee489557-8f32-4282-b02c-96874aadd775 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:32.081486 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 518/1032] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Dec 15 15:59:32 2021] POST /identity/v3/endpoints => generated 327 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 15:59:32.545590 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b557483-b4c0-42b6-b934-2bae33938f2a None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:32.545819 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b557483-b4c0-42b6-b934-2bae33938f2a None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:32.546091 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b557483-b4c0-42b6-b934-2bae33938f2a None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:32.548519 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 515/1033] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:32.554435 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827c1a7-7cc1-4959-b490-8956eb7ba82c None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:32.554795 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827c1a7-7cc1-4959-b490-8956eb7ba82c None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:32.555144 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827c1a7-7cc1-4959-b490-8956eb7ba82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:32.572781 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-8827c1a7-7cc1-4959-b490-8956eb7ba82c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:32.573995 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-8827c1a7-7cc1-4959-b490-8956eb7ba82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:32.591316 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 519/1034] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:32 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 15:59:32.616589 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b557483-b4c0-42b6-b934-2bae33938f2a None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:32.628563 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b557483-b4c0-42b6-b934-2bae33938f2a None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:32.632879 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abeb06-310d-4f55-8079-8671ea99c6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:32.633718 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abeb06-310d-4f55-8079-8671ea99c6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:32.634002 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abeb06-310d-4f55-8079-8671ea99c6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:32.634274 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abeb06-310d-4f55-8079-8671ea99c6e2 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:32.645160 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abeb06-310d-4f55-8079-8671ea99c6e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:59:32.652392 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-c6abeb06-310d-4f55-8079-8671ea99c6e2 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 15:59:32.653778 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 516/1035] 10.222.0.36 () {56 vars in 1141 bytes} [Wed Dec 15 15:59:32 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:32.660850 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827c1a7-7cc1-4959-b490-8956eb7ba82c None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:32.670605 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827c1a7-7cc1-4959-b490-8956eb7ba82c None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:32.675233 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bee19-aed3-40d0-9de6-92b2b5f20bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:32.676141 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bee19-aed3-40d0-9de6-92b2b5f20bfe admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:32.676520 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bee19-aed3-40d0-9de6-92b2b5f20bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:32.676895 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bee19-aed3-40d0-9de6-92b2b5f20bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:32.677841 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042bee19-aed3-40d0-9de6-92b2b5f20bfe admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:32.678211 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042bee19-aed3-40d0-9de6-92b2b5f20bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:32.679935 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042bee19-aed3-40d0-9de6-92b2b5f20bfe admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:32.693127 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 520/1036] 10.222.0.36 () {56 vars in 1136 bytes} [Wed Dec 15 15:59:32 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:32.694318 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abeb06-310d-4f55-8079-8671ea99c6e2 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:32.705451 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abeb06-310d-4f55-8079-8671ea99c6e2 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:32.710305 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fd2a7-1aab-4faf-848b-353fbe0fa3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:32.711242 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fd2a7-1aab-4faf-848b-353fbe0fa3ba admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:32.711560 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fd2a7-1aab-4faf-848b-353fbe0fa3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:32.711918 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fd2a7-1aab-4faf-848b-353fbe0fa3ba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:32.722571 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fd2a7-1aab-4faf-848b-353fbe0fa3ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:32.724518 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fd2a7-1aab-4faf-848b-353fbe0fa3ba admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:32.741037 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-415fd2a7-1aab-4faf-848b-353fbe0fa3ba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:32.745417 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 517/1037] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:32.749174 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bee19-aed3-40d0-9de6-92b2b5f20bfe admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:32.763791 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bee19-aed3-40d0-9de6-92b2b5f20bfe admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:32.769858 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d66c9-9bd8-41f3-a7a3-de203ae75d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:32.770614 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d66c9-9bd8-41f3-a7a3-de203ae75d84 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:32.770965 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d66c9-9bd8-41f3-a7a3-de203ae75d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:32.771327 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d66c9-9bd8-41f3-a7a3-de203ae75d84 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:32.772133 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d66c9-9bd8-41f3-a7a3-de203ae75d84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:32.772500 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d66c9-9bd8-41f3-a7a3-de203ae75d84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:32.774531 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d66c9-9bd8-41f3-a7a3-de203ae75d84 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:32.789317 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 521/1038] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:32.796288 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fd2a7-1aab-4faf-848b-353fbe0fa3ba admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:32.808989 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fd2a7-1aab-4faf-848b-353fbe0fa3ba admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:32.814973 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcf23c-1098-48a3-ba57-c45d4ae97531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:32.816013 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcf23c-1098-48a3-ba57-c45d4ae97531 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:32.816408 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcf23c-1098-48a3-ba57-c45d4ae97531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:32.816817 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcf23c-1098-48a3-ba57-c45d4ae97531 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:32.826161 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbcf23c-1098-48a3-ba57-c45d4ae97531 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:32.829294 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbcf23c-1098-48a3-ba57-c45d4ae97531 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:32.846885 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-9bbcf23c-1098-48a3-ba57-c45d4ae97531 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 15:59:32.848430 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 518/1039] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Dec 15 15:59:32 2021] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:32.855776 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d66c9-9bd8-41f3-a7a3-de203ae75d84 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:32.867651 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d66c9-9bd8-41f3-a7a3-de203ae75d84 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:32.873009 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb5468-1fd4-4a48-95c6-1cf444d59811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:32.873910 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb5468-1fd4-4a48-95c6-1cf444d59811 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:32.874313 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb5468-1fd4-4a48-95c6-1cf444d59811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:32.874731 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb5468-1fd4-4a48-95c6-1cf444d59811 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:32.875887 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb5468-1fd4-4a48-95c6-1cf444d59811 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:32.876329 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb5468-1fd4-4a48-95c6-1cf444d59811 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:32.878624 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb5468-1fd4-4a48-95c6-1cf444d59811 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:32.898606 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 522/1040] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Dec 15 15:59:32 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:32.905486 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcf23c-1098-48a3-ba57-c45d4ae97531 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:32.917653 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcf23c-1098-48a3-ba57-c45d4ae97531 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:32.923360 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f52312-53d9-48b6-b4e4-3d981744af46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:32.924103 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f52312-53d9-48b6-b4e4-3d981744af46 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:32.924428 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f52312-53d9-48b6-b4e4-3d981744af46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:32.924715 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f52312-53d9-48b6-b4e4-3d981744af46 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:32.934069 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f52312-53d9-48b6-b4e4-3d981744af46 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:32.936114 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f52312-53d9-48b6-b4e4-3d981744af46 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:32.951873 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 519/1041] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:59:32 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 15:59:32.953329 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb5468-1fd4-4a48-95c6-1cf444d59811 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:32.963469 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb5468-1fd4-4a48-95c6-1cf444d59811 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:32.968001 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76777897-b038-486d-8486-0ef2dff1af3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:32.968773 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76777897-b038-486d-8486-0ef2dff1af3d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:32.969307 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76777897-b038-486d-8486-0ef2dff1af3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:32.969703 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76777897-b038-486d-8486-0ef2dff1af3d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:32.980073 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76777897-b038-486d-8486-0ef2dff1af3d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:32.981961 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76777897-b038-486d-8486-0ef2dff1af3d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:32.999968 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-76777897-b038-486d-8486-0ef2dff1af3d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:33.002312 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 523/1042] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:33.008701 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f52312-53d9-48b6-b4e4-3d981744af46 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:33.019343 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f52312-53d9-48b6-b4e4-3d981744af46 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:33.024578 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13629f-d8ba-4c74-bb07-6dfe67477811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:33.025336 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13629f-d8ba-4c74-bb07-6dfe67477811 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:33.025688 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13629f-d8ba-4c74-bb07-6dfe67477811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:33.026014 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13629f-d8ba-4c74-bb07-6dfe67477811 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:33.026834 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13629f-d8ba-4c74-bb07-6dfe67477811 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:33.027180 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13629f-d8ba-4c74-bb07-6dfe67477811 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:33.029145 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13629f-d8ba-4c74-bb07-6dfe67477811 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:33.048039 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 520/1043] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:33.057055 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76777897-b038-486d-8486-0ef2dff1af3d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:33.067171 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76777897-b038-486d-8486-0ef2dff1af3d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:33.071881 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae226067-b353-4a52-aa81-e0ccc17e3fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:33.072667 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae226067-b353-4a52-aa81-e0ccc17e3fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:33.072948 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae226067-b353-4a52-aa81-e0ccc17e3fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:33.073228 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae226067-b353-4a52-aa81-e0ccc17e3fb7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:33.080574 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae226067-b353-4a52-aa81-e0ccc17e3fb7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:33.082574 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae226067-b353-4a52-aa81-e0ccc17e3fb7 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:33.095948 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-ae226067-b353-4a52-aa81-e0ccc17e3fb7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:59:33.097272 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 524/1044] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:59:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:33.103344 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13629f-d8ba-4c74-bb07-6dfe67477811 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:33.113731 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13629f-d8ba-4c74-bb07-6dfe67477811 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:33.118234 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfa53a-feea-47da-8d32-9e5bfb10d1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:33.118880 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfa53a-feea-47da-8d32-9e5bfb10d1eb admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:33.119163 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfa53a-feea-47da-8d32-9e5bfb10d1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:33.119439 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfa53a-feea-47da-8d32-9e5bfb10d1eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:33.120234 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfa53a-feea-47da-8d32-9e5bfb10d1eb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:33.120543 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfa53a-feea-47da-8d32-9e5bfb10d1eb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:33.122413 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfa53a-feea-47da-8d32-9e5bfb10d1eb admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:33.134837 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 521/1045] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:59:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:33.141050 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae226067-b353-4a52-aa81-e0ccc17e3fb7 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:33.151636 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae226067-b353-4a52-aa81-e0ccc17e3fb7 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:33.152919 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cfdeb-1483-4a5d-8bd6-7d7ac02cf627 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:33.153211 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cfdeb-1483-4a5d-8bd6-7d7ac02cf627 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:33.153515 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cfdeb-1483-4a5d-8bd6-7d7ac02cf627 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:33.155257 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 522/1046] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:59:33.157154 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910ab18-32bf-40a8-ac3d-f17a34d640b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:33.158263 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910ab18-32bf-40a8-ac3d-f17a34d640b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:33.158742 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910ab18-32bf-40a8-ac3d-f17a34d640b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:33.159201 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910ab18-32bf-40a8-ac3d-f17a34d640b9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:33.160250 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910ab18-32bf-40a8-ac3d-f17a34d640b9 admin admin] RBAC: Adding query filter params (role.id=2c90a3a6a076416a94ab31da2efd66cc, scope.project.id=bc314fbc91c54810b27f9fcad7129c64, user.id=bc13934328e742f9a1a85d1c84ab83dd) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:33.160559 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910ab18-32bf-40a8-ac3d-f17a34d640b9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:33.161650 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b2f26-200c-4b1d-a962-bc27382357cd None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:33.161945 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b2f26-200c-4b1d-a962-bc27382357cd None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:33.162224 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b2f26-200c-4b1d-a962-bc27382357cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:33.162450 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910ab18-32bf-40a8-ac3d-f17a34d640b9 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:33.173311 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 525/1047] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:59:33 2021] GET /identity/v3/role_assignments?user.id=bc13934328e742f9a1a85d1c84ab83dd&scope.project.id=bc314fbc91c54810b27f9fcad7129c64&role.id=2c90a3a6a076416a94ab31da2efd66cc => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:33.182307 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-312b2f26-200c-4b1d-a962-bc27382357cd None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:33.183543 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-312b2f26-200c-4b1d-a962-bc27382357cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:33.192169 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 523/1048] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:33 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:33.217853 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910ab18-32bf-40a8-ac3d-f17a34d640b9 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:33.228798 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910ab18-32bf-40a8-ac3d-f17a34d640b9 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:33.233718 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ac89d-e67c-4a85-83a8-f3b1f88f561b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:33.235135 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ac89d-e67c-4a85-83a8-f3b1f88f561b admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:33.235567 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ac89d-e67c-4a85-83a8-f3b1f88f561b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:33.236052 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ac89d-e67c-4a85-83a8-f3b1f88f561b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:33.237558 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ac89d-e67c-4a85-83a8-f3b1f88f561b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:33.239286 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ac89d-e67c-4a85-83a8-f3b1f88f561b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:33.241103 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 526/1049] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:33 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:33.247382 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b2f26-200c-4b1d-a962-bc27382357cd None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:33.257739 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b2f26-200c-4b1d-a962-bc27382357cd None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:33.262926 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bc194-17e5-4a5e-8f90-730066a5f1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:33.263827 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bc194-17e5-4a5e-8f90-730066a5f1cf admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:33.264328 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bc194-17e5-4a5e-8f90-730066a5f1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:33.264817 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bc194-17e5-4a5e-8f90-730066a5f1cf admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:33.265852 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bc194-17e5-4a5e-8f90-730066a5f1cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:33.268425 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bc194-17e5-4a5e-8f90-730066a5f1cf admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:33.291916 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 524/1050] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Dec 15 15:59:33 2021] POST /identity/v3/users => generated 285 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:59:34.508528 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdac11-939a-4943-9322-f457ae086802 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:34.509050 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdac11-939a-4943-9322-f457ae086802 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:34.509158 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdac11-939a-4943-9322-f457ae086802 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:34.510908 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 527/1051] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:34.516955 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c14af-29a4-4d77-86d7-0f63206f9195 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:34.517342 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c14af-29a4-4d77-86d7-0f63206f9195 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:34.517551 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c14af-29a4-4d77-86d7-0f63206f9195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:34.535405 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-966c14af-29a4-4d77-86d7-0f63206f9195 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:34.536592 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-966c14af-29a4-4d77-86d7-0f63206f9195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:34.544246 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 525/1052] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:34 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:34.568697 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdac11-939a-4943-9322-f457ae086802 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:34.581599 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdac11-939a-4943-9322-f457ae086802 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:34.585945 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a5340-4397-4a94-b581-277ec70b9b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:34.586578 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a5340-4397-4a94-b581-277ec70b9b24 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:34.586866 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a5340-4397-4a94-b581-277ec70b9b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:34.587141 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a5340-4397-4a94-b581-277ec70b9b24 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:34.595133 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a5340-4397-4a94-b581-277ec70b9b24 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:34.596900 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a5340-4397-4a94-b581-277ec70b9b24 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:34.605877 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 528/1053] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:59:34 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 15:59:34.612359 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c14af-29a4-4d77-86d7-0f63206f9195 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:34.621202 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c14af-29a4-4d77-86d7-0f63206f9195 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:34.626315 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6892d8-74fa-4651-b745-c6d5a550738a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:34.627150 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6892d8-74fa-4651-b745-c6d5a550738a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:34.627499 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6892d8-74fa-4651-b745-c6d5a550738a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:34.627836 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6892d8-74fa-4651-b745-c6d5a550738a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:34.629253 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6892d8-74fa-4651-b745-c6d5a550738a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:34.631028 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6892d8-74fa-4651-b745-c6d5a550738a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:34.632841 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 526/1054] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:35.573862 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfc9c5-3e09-48ef-872a-1b6380862c17 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:35.574415 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfc9c5-3e09-48ef-872a-1b6380862c17 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:35.574415 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfc9c5-3e09-48ef-872a-1b6380862c17 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:35.576146 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 529/1055] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:35.582072 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb46b6e-9d54-4bb4-b019-0a71ec1aa1cc None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:35.582664 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb46b6e-9d54-4bb4-b019-0a71ec1aa1cc None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:35.582664 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb46b6e-9d54-4bb4-b019-0a71ec1aa1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:35.600556 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-7fb46b6e-9d54-4bb4-b019-0a71ec1aa1cc None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:35.601766 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-7fb46b6e-9d54-4bb4-b019-0a71ec1aa1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:35.610102 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 527/1056] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:35 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:35.633359 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfc9c5-3e09-48ef-872a-1b6380862c17 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:35.646157 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfc9c5-3e09-48ef-872a-1b6380862c17 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:35.650729 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62df8b3-ae7b-4779-9fd4-db967c934658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:35.651719 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62df8b3-ae7b-4779-9fd4-db967c934658 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:35.651951 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62df8b3-ae7b-4779-9fd4-db967c934658 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:35.652293 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62df8b3-ae7b-4779-9fd4-db967c934658 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:35.663595 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62df8b3-ae7b-4779-9fd4-db967c934658 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:59:35.671065 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-f62df8b3-ae7b-4779-9fd4-db967c934658 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 15:59:35.672320 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 530/1057] 10.222.0.36 () {56 vars in 1141 bytes} [Wed Dec 15 15:59:35 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:35.678877 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb46b6e-9d54-4bb4-b019-0a71ec1aa1cc None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:35.689031 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb46b6e-9d54-4bb4-b019-0a71ec1aa1cc None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:35.693952 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e79fd5-3f7c-4393-b594-13f63b06ac9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:35.694819 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e79fd5-3f7c-4393-b594-13f63b06ac9e admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:35.695108 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e79fd5-3f7c-4393-b594-13f63b06ac9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:35.695381 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e79fd5-3f7c-4393-b594-13f63b06ac9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:35.696132 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e79fd5-3f7c-4393-b594-13f63b06ac9e admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:35.696433 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e79fd5-3f7c-4393-b594-13f63b06ac9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:35.698606 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e79fd5-3f7c-4393-b594-13f63b06ac9e admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:35.710916 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 528/1058] 10.222.0.36 () {56 vars in 1136 bytes} [Wed Dec 15 15:59:35 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:35.716330 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62df8b3-ae7b-4779-9fd4-db967c934658 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:35.718352 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc3e53-6ffb-4063-a8af-9e57bd3de263 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:35.718668 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc3e53-6ffb-4063-a8af-9e57bd3de263 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:35.719494 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc3e53-6ffb-4063-a8af-9e57bd3de263 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:35.721125 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 529/1059] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:59:35.726585 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ceca7e-4f4e-4fe1-b41d-d7312c0f8f77 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:35.726871 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ceca7e-4f4e-4fe1-b41d-d7312c0f8f77 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:35.727145 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ceca7e-4f4e-4fe1-b41d-d7312c0f8f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:35.727561 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62df8b3-ae7b-4779-9fd4-db967c934658 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:35.732041 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e301e-654c-43e2-8890-aeadc05285f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:35.732833 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e301e-654c-43e2-8890-aeadc05285f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:35.733124 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e301e-654c-43e2-8890-aeadc05285f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:35.733437 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e301e-654c-43e2-8890-aeadc05285f0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:35.743468 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e301e-654c-43e2-8890-aeadc05285f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:35.744290 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-c1ceca7e-4f4e-4fe1-b41d-d7312c0f8f77 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:35.745358 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e301e-654c-43e2-8890-aeadc05285f0 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:35.745533 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c1ceca7e-4f4e-4fe1-b41d-d7312c0f8f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:35.753297 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 530/1060] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:35 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 15:59:35.763349 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-c41e301e-654c-43e2-8890-aeadc05285f0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:35.770604 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 531/1061] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:35.771471 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ceca7e-4f4e-4fe1-b41d-d7312c0f8f77 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:35.777701 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e301e-654c-43e2-8890-aeadc05285f0 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:35.780656 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ceca7e-4f4e-4fe1-b41d-d7312c0f8f77 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:35.785797 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23921fb-6dbd-4689-b604-c5d1392e0f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:35.786432 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23921fb-6dbd-4689-b604-c5d1392e0f3f admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:35.786711 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23921fb-6dbd-4689-b604-c5d1392e0f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:35.786983 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23921fb-6dbd-4689-b604-c5d1392e0f3f admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:35.787711 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23921fb-6dbd-4689-b604-c5d1392e0f3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:35.787803 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e301e-654c-43e2-8890-aeadc05285f0 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:35.788021 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23921fb-6dbd-4689-b604-c5d1392e0f3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:35.789625 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23921fb-6dbd-4689-b604-c5d1392e0f3f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:35.792251 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93612f5-9679-48a3-b648-fbf825fce586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:35.793005 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93612f5-9679-48a3-b648-fbf825fce586 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:35.793288 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93612f5-9679-48a3-b648-fbf825fce586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:35.793593 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93612f5-9679-48a3-b648-fbf825fce586 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:35.801072 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 531/1062] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:35.805025 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93612f5-9679-48a3-b648-fbf825fce586 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:59:35.806951 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23921fb-6dbd-4689-b604-c5d1392e0f3f admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:35.811962 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-b93612f5-9679-48a3-b648-fbf825fce586 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 15:59:35.813171 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 532/1063] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:59:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:35.816589 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23921fb-6dbd-4689-b604-c5d1392e0f3f admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:35.819385 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93612f5-9679-48a3-b648-fbf825fce586 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:35.821443 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600c364-7edc-4604-ab97-6b73eb0d3a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:35.822191 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600c364-7edc-4604-ab97-6b73eb0d3a11 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:35.822472 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600c364-7edc-4604-ab97-6b73eb0d3a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:35.822745 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600c364-7edc-4604-ab97-6b73eb0d3a11 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:35.829211 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93612f5-9679-48a3-b648-fbf825fce586 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:35.830772 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600c364-7edc-4604-ab97-6b73eb0d3a11 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:35.832767 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600c364-7edc-4604-ab97-6b73eb0d3a11 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:35.833858 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c01dea-2e7d-477a-b423-428d81b0fd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:35.834507 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c01dea-2e7d-477a-b423-428d81b0fd1d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:35.834806 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c01dea-2e7d-477a-b423-428d81b0fd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:35.835083 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c01dea-2e7d-477a-b423-428d81b0fd1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:35.835847 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c01dea-2e7d-477a-b423-428d81b0fd1d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:35.836165 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c01dea-2e7d-477a-b423-428d81b0fd1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:35.837850 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c01dea-2e7d-477a-b423-428d81b0fd1d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:35.846188 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-2600c364-7edc-4604-ab97-6b73eb0d3a11 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 15:59:35.847484 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 533/1065] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:59:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:35.847595 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 532/1065] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Dec 15 15:59:35 2021] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:35.853351 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c01dea-2e7d-477a-b423-428d81b0fd1d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:35.853499 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600c364-7edc-4604-ab97-6b73eb0d3a11 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:35.862642 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c01dea-2e7d-477a-b423-428d81b0fd1d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:35.862768 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600c364-7edc-4604-ab97-6b73eb0d3a11 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:35.867204 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbab51e-3278-4af9-8862-2c8efb92765d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:35.867382 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d8c31-5d7d-452e-a2e4-f2a9686e0128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:35.867834 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d8c31-5d7d-452e-a2e4-f2a9686e0128 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:35.868014 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbab51e-3278-4af9-8862-2c8efb92765d admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:35.868111 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d8c31-5d7d-452e-a2e4-f2a9686e0128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:35.868294 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbab51e-3278-4af9-8862-2c8efb92765d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:35.868388 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d8c31-5d7d-452e-a2e4-f2a9686e0128 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:35.868566 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbab51e-3278-4af9-8862-2c8efb92765d admin admin] PATH_INFO: `/v3/users/11533b6142af471e898873b86904857c` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:35.869183 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d8c31-5d7d-452e-a2e4-f2a9686e0128 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:35.869517 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d8c31-5d7d-452e-a2e4-f2a9686e0128 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:35.871345 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d8c31-5d7d-452e-a2e4-f2a9686e0128 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:35.882035 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbab51e-3278-4af9-8862-2c8efb92765d admin admin] RBAC: Authorizing `identity:get_user(user_id=11533b6142af471e898873b86904857c)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:35.884176 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbab51e-3278-4af9-8862-2c8efb92765d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:35.885875 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 533/1066] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:59:35 2021] GET /identity/v3/users/11533b6142af471e898873b86904857c => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:35.888523 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 534/1067] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Dec 15 15:59:35 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:35.892414 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbab51e-3278-4af9-8862-2c8efb92765d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:35.895064 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d8c31-5d7d-452e-a2e4-f2a9686e0128 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:35.901551 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbab51e-3278-4af9-8862-2c8efb92765d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:35.904152 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d8c31-5d7d-452e-a2e4-f2a9686e0128 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:35.906019 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b5cfe-ed22-433b-97e7-adcba0556f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:35.907237 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b5cfe-ed22-433b-97e7-adcba0556f82 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:35.907518 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b5cfe-ed22-433b-97e7-adcba0556f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:35.907793 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b5cfe-ed22-433b-97e7-adcba0556f82 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:35.909494 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e513e-104f-4283-90f0-3fc88b1f59d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:35.910245 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e513e-104f-4283-90f0-3fc88b1f59d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:35.910526 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e513e-104f-4283-90f0-3fc88b1f59d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:35.910799 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e513e-104f-4283-90f0-3fc88b1f59d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:35.915310 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b5cfe-ed22-433b-97e7-adcba0556f82 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:35.917022 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b5cfe-ed22-433b-97e7-adcba0556f82 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:35.920746 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e513e-104f-4283-90f0-3fc88b1f59d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:35.922794 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e513e-104f-4283-90f0-3fc88b1f59d3 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:35.925687 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 534/1068] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:59:35 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 15:59:35.931941 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b5cfe-ed22-433b-97e7-adcba0556f82 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:35.939800 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-347e513e-104f-4283-90f0-3fc88b1f59d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:35.940252 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b5cfe-ed22-433b-97e7-adcba0556f82 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:35.940964 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 535/1069] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:35.945589 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f83874-7de1-455b-9896-61e6f64abc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:35.945716 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f83874-7de1-455b-9896-61e6f64abc99 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:35.945930 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f83874-7de1-455b-9896-61e6f64abc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:35.946202 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f83874-7de1-455b-9896-61e6f64abc99 admin admin] PATH_INFO: `/v3/projects/45192e36fa48484d93670e4e26c28fde` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:35.946894 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e513e-104f-4283-90f0-3fc88b1f59d3 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:35.947370 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f83874-7de1-455b-9896-61e6f64abc99 admin admin] RBAC: Authorizing `identity:get_project(project_id=45192e36fa48484d93670e4e26c28fde)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:35.949367 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f83874-7de1-455b-9896-61e6f64abc99 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:35.955260 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 535/1070] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:59:35 2021] GET /identity/v3/projects/45192e36fa48484d93670e4e26c28fde => generated 311 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:35.957116 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e513e-104f-4283-90f0-3fc88b1f59d3 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:35.957620 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f83874-7de1-455b-9896-61e6f64abc99 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:35.961658 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7241306-88ee-4d6a-9aab-b4089ee951c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:35.962276 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7241306-88ee-4d6a-9aab-b4089ee951c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:35.962555 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7241306-88ee-4d6a-9aab-b4089ee951c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:35.962827 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7241306-88ee-4d6a-9aab-b4089ee951c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:35.963545 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7241306-88ee-4d6a-9aab-b4089ee951c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:35.963842 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7241306-88ee-4d6a-9aab-b4089ee951c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:35.965442 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7241306-88ee-4d6a-9aab-b4089ee951c0 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:35.966622 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f83874-7de1-455b-9896-61e6f64abc99 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:35.972067 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a897b-26f6-4d76-845d-3d19c52db221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:35.972670 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a897b-26f6-4d76-845d-3d19c52db221 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:35.972953 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a897b-26f6-4d76-845d-3d19c52db221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:35.973226 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a897b-26f6-4d76-845d-3d19c52db221 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:35.974151 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a897b-26f6-4d76-845d-3d19c52db221 admin admin] RBAC: Adding query filter params (role.id=bc362f875c6d4cee83ba65b8d134462d, scope.project.id=45192e36fa48484d93670e4e26c28fde, user.id=11533b6142af471e898873b86904857c) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:35.974461 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a897b-26f6-4d76-845d-3d19c52db221 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:35.976239 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a897b-26f6-4d76-845d-3d19c52db221 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:35.977276 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 536/1071] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:35.981646 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 536/1072] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:59:35 2021] GET /identity/v3/role_assignments?user.id=11533b6142af471e898873b86904857c&scope.project.id=45192e36fa48484d93670e4e26c28fde&role.id=bc362f875c6d4cee83ba65b8d134462d => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:35.983188 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7241306-88ee-4d6a-9aab-b4089ee951c0 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:35.993585 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7241306-88ee-4d6a-9aab-b4089ee951c0 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:35.998523 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b8072-8b66-4077-bde2-b2694f5bac74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:35.999380 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b8072-8b66-4077-bde2-b2694f5bac74 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:35.999682 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b8072-8b66-4077-bde2-b2694f5bac74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:36.000027 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b8072-8b66-4077-bde2-b2694f5bac74 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:36.009179 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b8072-8b66-4077-bde2-b2694f5bac74 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:36.011277 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b8072-8b66-4077-bde2-b2694f5bac74 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:36.026686 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-e95b8072-8b66-4077-bde2-b2694f5bac74 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:59:36.027984 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 537/1073] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:59:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:36.035235 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a897b-26f6-4d76-845d-3d19c52db221 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:36.046288 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a897b-26f6-4d76-845d-3d19c52db221 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:36.051369 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f2f7e-e2da-4d45-a744-cac78d73b21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:36.052065 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f2f7e-e2da-4d45-a744-cac78d73b21b admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:36.052345 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f2f7e-e2da-4d45-a744-cac78d73b21b admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:36.052617 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f2f7e-e2da-4d45-a744-cac78d73b21b admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:36.053477 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f2f7e-e2da-4d45-a744-cac78d73b21b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:36.053805 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f2f7e-e2da-4d45-a744-cac78d73b21b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:36.055765 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f2f7e-e2da-4d45-a744-cac78d73b21b admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:36.074917 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 537/1074] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:59:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:36.076325 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b8072-8b66-4077-bde2-b2694f5bac74 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:36.087197 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b8072-8b66-4077-bde2-b2694f5bac74 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:36.091792 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23cb45-f00d-494d-b984-48b606281e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:36.092685 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23cb45-f00d-494d-b984-48b606281e38 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:36.092970 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23cb45-f00d-494d-b984-48b606281e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:36.093243 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23cb45-f00d-494d-b984-48b606281e38 admin admin] PATH_INFO: `/v3/projects/bc314fbc91c54810b27f9fcad7129c64/users/bc13934328e742f9a1a85d1c84ab83dd/roles/2c90a3a6a076416a94ab31da2efd66cc` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:36.095869 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23cb45-f00d-494d-b984-48b606281e38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc314fbc91c54810b27f9fcad7129c64, user_id=bc13934328e742f9a1a85d1c84ab83dd, role_id=2c90a3a6a076416a94ab31da2efd66cc)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:36.098605 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23cb45-f00d-494d-b984-48b606281e38 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:36.113333 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 538/1075] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Dec 15 15:59:36 2021] PUT /identity/v3/projects/bc314fbc91c54810b27f9fcad7129c64/users/bc13934328e742f9a1a85d1c84ab83dd/roles/2c90a3a6a076416a94ab31da2efd66cc => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 15:59:38.387718 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b694ee-5560-427b-9475-56b0cdd03100 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:38.388246 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b694ee-5560-427b-9475-56b0cdd03100 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:38.388364 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b694ee-5560-427b-9475-56b0cdd03100 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:38.390172 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 538/1076] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:38.396841 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9f631-5795-40c8-9b9f-c0b58cd835e6 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:38.397272 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9f631-5795-40c8-9b9f-c0b58cd835e6 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:38.397501 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9f631-5795-40c8-9b9f-c0b58cd835e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:38.415244 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-f7d9f631-5795-40c8-9b9f-c0b58cd835e6 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:38.416420 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-f7d9f631-5795-40c8-9b9f-c0b58cd835e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:38.470912 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512b7d6-de0d-4686-9a93-2fed9a496536 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:38.471206 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512b7d6-de0d-4686-9a93-2fed9a496536 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:38.471483 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512b7d6-de0d-4686-9a93-2fed9a496536 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:38.473342 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 539/1077] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 15:59:38.473494 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 539/1078] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:38 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:38.479301 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b8e0d-7123-44b7-8878-1b53903ce6f5 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:38.479587 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b8e0d-7123-44b7-8878-1b53903ce6f5 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:38.479863 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b8e0d-7123-44b7-8878-1b53903ce6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:38.497922 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9f631-5795-40c8-9b9f-c0b58cd835e6 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:38.499167 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-7f8b8e0d-7123-44b7-8878-1b53903ce6f5 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:38.500993 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-7f8b8e0d-7123-44b7-8878-1b53903ce6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:38.507565 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9f631-5795-40c8-9b9f-c0b58cd835e6 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:38.508711 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 540/1079] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:38 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:38.512151 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d07813-af8d-4fe6-9802-2e382f487128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:38.512924 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d07813-af8d-4fe6-9802-2e382f487128 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:38.513207 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d07813-af8d-4fe6-9802-2e382f487128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:38.513510 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d07813-af8d-4fe6-9802-2e382f487128 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:38.524452 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d07813-af8d-4fe6-9802-2e382f487128 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:59:38.531988 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-f4d07813-af8d-4fe6-9802-2e382f487128 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 15:59:38.533156 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 540/1080] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:59:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:38.534006 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b8e0d-7123-44b7-8878-1b53903ce6f5 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:38.539560 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d07813-af8d-4fe6-9802-2e382f487128 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:38.543062 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b8e0d-7123-44b7-8878-1b53903ce6f5 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:38.547625 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bf61d-4a6c-4f9f-a2a5-52bf25a44d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:38.548413 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bf61d-4a6c-4f9f-a2a5-52bf25a44d4b admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:38.548693 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bf61d-4a6c-4f9f-a2a5-52bf25a44d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:38.548967 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bf61d-4a6c-4f9f-a2a5-52bf25a44d4b admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:38.549555 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d07813-af8d-4fe6-9802-2e382f487128 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:38.554081 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f4297-3309-454f-822e-1fc9283c279d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:38.554701 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f4297-3309-454f-822e-1fc9283c279d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:38.554986 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f4297-3309-454f-822e-1fc9283c279d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:38.555263 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f4297-3309-454f-822e-1fc9283c279d admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:38.556004 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f4297-3309-454f-822e-1fc9283c279d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:38.556310 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f4297-3309-454f-822e-1fc9283c279d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:38.557931 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f4297-3309-454f-822e-1fc9283c279d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:38.559095 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6bf61d-4a6c-4f9f-a2a5-52bf25a44d4b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:59:38.566828 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 541/1081] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:59:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:38.567119 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-0c6bf61d-4a6c-4f9f-a2a5-52bf25a44d4b admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 15:59:38.568430 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 541/1082] 10.222.0.36 () {56 vars in 1141 bytes} [Wed Dec 15 15:59:38 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:38.573585 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f4297-3309-454f-822e-1fc9283c279d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:38.574330 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bf61d-4a6c-4f9f-a2a5-52bf25a44d4b admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:38.583895 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f4297-3309-454f-822e-1fc9283c279d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:38.584874 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bf61d-4a6c-4f9f-a2a5-52bf25a44d4b admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:38.588524 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666168ec-a12a-4d1e-b3f6-32cd481c3080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:38.589354 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666168ec-a12a-4d1e-b3f6-32cd481c3080 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:38.589528 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81e1db-95cb-4c5c-9b9b-043f4a36410f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:38.589668 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666168ec-a12a-4d1e-b3f6-32cd481c3080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:38.589946 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666168ec-a12a-4d1e-b3f6-32cd481c3080 admin admin] PATH_INFO: `/v3/users/11533b6142af471e898873b86904857c` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:38.590160 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81e1db-95cb-4c5c-9b9b-043f4a36410f admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:38.590440 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81e1db-95cb-4c5c-9b9b-043f4a36410f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:38.590733 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81e1db-95cb-4c5c-9b9b-043f4a36410f admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:38.591203 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666168ec-a12a-4d1e-b3f6-32cd481c3080 admin admin] RBAC: Authorizing `identity:get_user(user_id=11533b6142af471e898873b86904857c)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:38.591504 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81e1db-95cb-4c5c-9b9b-043f4a36410f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:38.591822 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81e1db-95cb-4c5c-9b9b-043f4a36410f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:38.593318 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666168ec-a12a-4d1e-b3f6-32cd481c3080 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:38.593473 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81e1db-95cb-4c5c-9b9b-043f4a36410f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:38.595355 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 542/1083] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:59:38 2021] GET /identity/v3/users/11533b6142af471e898873b86904857c => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:38.602133 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 542/1084] 10.222.0.36 () {56 vars in 1136 bytes} [Wed Dec 15 15:59:38 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:38.602255 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666168ec-a12a-4d1e-b3f6-32cd481c3080 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:38.608877 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81e1db-95cb-4c5c-9b9b-043f4a36410f admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:38.611626 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666168ec-a12a-4d1e-b3f6-32cd481c3080 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:38.616070 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd001df6-3a2f-41b4-8211-d2d58f1866d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:38.616902 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd001df6-3a2f-41b4-8211-d2d58f1866d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:38.617185 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd001df6-3a2f-41b4-8211-d2d58f1866d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:38.617492 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd001df6-3a2f-41b4-8211-d2d58f1866d1 admin admin] PATH_INFO: `/v3/projects/45192e36fa48484d93670e4e26c28fde` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:38.618666 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd001df6-3a2f-41b4-8211-d2d58f1866d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=45192e36fa48484d93670e4e26c28fde)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:38.619942 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81e1db-95cb-4c5c-9b9b-043f4a36410f admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:38.620678 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd001df6-3a2f-41b4-8211-d2d58f1866d1 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:38.622306 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 543/1085] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:59:38 2021] GET /identity/v3/projects/45192e36fa48484d93670e4e26c28fde => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:38.626724 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a2d48-7f63-43da-a148-782c4207b103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:38.627480 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a2d48-7f63-43da-a148-782c4207b103 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:38.627764 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a2d48-7f63-43da-a148-782c4207b103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:38.628039 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a2d48-7f63-43da-a148-782c4207b103 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:38.629960 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd001df6-3a2f-41b4-8211-d2d58f1866d1 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:38.638813 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a2d48-7f63-43da-a148-782c4207b103 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:38.638997 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd001df6-3a2f-41b4-8211-d2d58f1866d1 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:38.641160 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a2d48-7f63-43da-a148-782c4207b103 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:38.644101 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb626b39-0aff-46a0-9d2d-386f8009e7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:38.644929 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb626b39-0aff-46a0-9d2d-386f8009e7e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:38.645209 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb626b39-0aff-46a0-9d2d-386f8009e7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:38.645506 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb626b39-0aff-46a0-9d2d-386f8009e7e7 admin admin] PATH_INFO: `/v3/projects/45192e36fa48484d93670e4e26c28fde/users/11533b6142af471e898873b86904857c/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:38.647438 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb626b39-0aff-46a0-9d2d-386f8009e7e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45192e36fa48484d93670e4e26c28fde, user_id=11533b6142af471e898873b86904857c, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:38.650054 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb626b39-0aff-46a0-9d2d-386f8009e7e7 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:38.659309 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-ce6a2d48-7f63-43da-a148-782c4207b103 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:38.660503 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 543/1086] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 15:59:38.666098 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 544/1087] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Dec 15 15:59:38 2021] PUT /identity/v3/projects/45192e36fa48484d93670e4e26c28fde/users/11533b6142af471e898873b86904857c/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 15:59:38.666833 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a2d48-7f63-43da-a148-782c4207b103 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:38.677533 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a2d48-7f63-43da-a148-782c4207b103 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:38.735692 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fa2a1-cadc-483f-844e-56cbe0b369f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:38.736461 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fa2a1-cadc-483f-844e-56cbe0b369f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:38.736804 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fa2a1-cadc-483f-844e-56cbe0b369f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:38.737143 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fa2a1-cadc-483f-844e-56cbe0b369f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:38.737994 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590fa2a1-cadc-483f-844e-56cbe0b369f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:38.738298 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590fa2a1-cadc-483f-844e-56cbe0b369f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:38.739902 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590fa2a1-cadc-483f-844e-56cbe0b369f5 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:38.752778 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 544/1088] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:38.759062 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb626b39-0aff-46a0-9d2d-386f8009e7e7 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:38.769601 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb626b39-0aff-46a0-9d2d-386f8009e7e7 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:38.774138 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435d3c3-69ca-42d6-9804-3f0d7901ac24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:38.774920 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435d3c3-69ca-42d6-9804-3f0d7901ac24 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:38.775200 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435d3c3-69ca-42d6-9804-3f0d7901ac24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:38.775471 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435d3c3-69ca-42d6-9804-3f0d7901ac24 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:38.783713 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435d3c3-69ca-42d6-9804-3f0d7901ac24 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:38.785796 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435d3c3-69ca-42d6-9804-3f0d7901ac24 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:38.800910 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-6435d3c3-69ca-42d6-9804-3f0d7901ac24 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 15:59:38.802385 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 545/1089] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Dec 15 15:59:38 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:38.808520 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fa2a1-cadc-483f-844e-56cbe0b369f5 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:38.822978 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fa2a1-cadc-483f-844e-56cbe0b369f5 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:38.828233 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732789f5-14dc-4a88-b44b-6f795a4479a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:38.828916 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732789f5-14dc-4a88-b44b-6f795a4479a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:38.829194 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732789f5-14dc-4a88-b44b-6f795a4479a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:38.829502 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732789f5-14dc-4a88-b44b-6f795a4479a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:38.830356 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732789f5-14dc-4a88-b44b-6f795a4479a0 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:38.830659 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732789f5-14dc-4a88-b44b-6f795a4479a0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:38.832777 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732789f5-14dc-4a88-b44b-6f795a4479a0 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:38.856578 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 545/1090] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Dec 15 15:59:38 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:38.857900 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435d3c3-69ca-42d6-9804-3f0d7901ac24 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:38.868686 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435d3c3-69ca-42d6-9804-3f0d7901ac24 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:38.876967 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49b394-eccf-4878-99b6-ecb2dbecebfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:38.876967 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49b394-eccf-4878-99b6-ecb2dbecebfb admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:38.876967 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49b394-eccf-4878-99b6-ecb2dbecebfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:38.876967 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49b394-eccf-4878-99b6-ecb2dbecebfb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:38.885959 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49b394-eccf-4878-99b6-ecb2dbecebfb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:38.887724 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49b394-eccf-4878-99b6-ecb2dbecebfb admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:38.896678 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 546/1091] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:59:38 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 15:59:38.902887 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732789f5-14dc-4a88-b44b-6f795a4479a0 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:38.912852 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732789f5-14dc-4a88-b44b-6f795a4479a0 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:38.917347 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86603e7f-264a-4d70-9d68-3c30ef956fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:38.918197 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86603e7f-264a-4d70-9d68-3c30ef956fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:38.918475 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86603e7f-264a-4d70-9d68-3c30ef956fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:38.918740 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86603e7f-264a-4d70-9d68-3c30ef956fc8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:38.929181 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86603e7f-264a-4d70-9d68-3c30ef956fc8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:38.931046 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86603e7f-264a-4d70-9d68-3c30ef956fc8 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:38.947794 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-86603e7f-264a-4d70-9d68-3c30ef956fc8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 15:59:38.948950 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 546/1092] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:38.955570 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49b394-eccf-4878-99b6-ecb2dbecebfb admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:38.964364 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49b394-eccf-4878-99b6-ecb2dbecebfb admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:38.969208 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52aabbd-b724-4de3-95ea-6a3f1d7d57fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:38.969885 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52aabbd-b724-4de3-95ea-6a3f1d7d57fe admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:38.970166 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52aabbd-b724-4de3-95ea-6a3f1d7d57fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:38.970435 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52aabbd-b724-4de3-95ea-6a3f1d7d57fe admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:38.971145 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52aabbd-b724-4de3-95ea-6a3f1d7d57fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:38.971447 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52aabbd-b724-4de3-95ea-6a3f1d7d57fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:38.973016 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52aabbd-b724-4de3-95ea-6a3f1d7d57fe admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:38.984869 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 547/1093] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 15:59:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:38.990626 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86603e7f-264a-4d70-9d68-3c30ef956fc8 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:39.000781 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86603e7f-264a-4d70-9d68-3c30ef956fc8 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:39.005230 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465c85b-0d04-44db-b921-841814a88b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:39.006034 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465c85b-0d04-44db-b921-841814a88b70 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:39.006315 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465c85b-0d04-44db-b921-841814a88b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:39.006629 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465c85b-0d04-44db-b921-841814a88b70 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:39.013279 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465c85b-0d04-44db-b921-841814a88b70 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:39.015298 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465c85b-0d04-44db-b921-841814a88b70 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:39.027997 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-1465c85b-0d04-44db-b921-841814a88b70 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 15:59:39.029131 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 547/1094] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 15:59:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:39.036115 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52aabbd-b724-4de3-95ea-6a3f1d7d57fe admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:39.046349 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52aabbd-b724-4de3-95ea-6a3f1d7d57fe admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:39.051639 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b94e00-fac9-4a59-bcdf-776060d818b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:39.052276 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b94e00-fac9-4a59-bcdf-776060d818b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:39.052557 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b94e00-fac9-4a59-bcdf-776060d818b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:39.052829 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b94e00-fac9-4a59-bcdf-776060d818b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:39.053655 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b94e00-fac9-4a59-bcdf-776060d818b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:39.053958 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b94e00-fac9-4a59-bcdf-776060d818b2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:39.055804 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b94e00-fac9-4a59-bcdf-776060d818b2 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:39.068121 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 548/1095] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 15:59:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:39.074499 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465c85b-0d04-44db-b921-841814a88b70 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:39.085442 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465c85b-0d04-44db-b921-841814a88b70 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:39.089936 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7b9e5-49a7-4c8c-9e51-681f8e4da2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:39.090557 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7b9e5-49a7-4c8c-9e51-681f8e4da2fd admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:39.090838 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7b9e5-49a7-4c8c-9e51-681f8e4da2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:39.091111 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7b9e5-49a7-4c8c-9e51-681f8e4da2fd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:39.091937 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7b9e5-49a7-4c8c-9e51-681f8e4da2fd admin admin] RBAC: Adding query filter params (role.id=2c90a3a6a076416a94ab31da2efd66cc, scope.project.id=bc314fbc91c54810b27f9fcad7129c64, user.id=bc13934328e742f9a1a85d1c84ab83dd) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:39.092244 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7b9e5-49a7-4c8c-9e51-681f8e4da2fd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:39.094738 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7b9e5-49a7-4c8c-9e51-681f8e4da2fd admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:39.100409 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 548/1096] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:59:39 2021] GET /identity/v3/role_assignments?user.id=bc13934328e742f9a1a85d1c84ab83dd&scope.project.id=bc314fbc91c54810b27f9fcad7129c64&role.id=2c90a3a6a076416a94ab31da2efd66cc => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:41.017473 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f637d9-5b88-4272-b551-5b562d3bbc05 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:41.018011 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f637d9-5b88-4272-b551-5b562d3bbc05 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:41.018011 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f637d9-5b88-4272-b551-5b562d3bbc05 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:41.019760 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 549/1097] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:41.025509 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85e2d8-8f33-415c-bf68-531672618685 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:41.025916 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85e2d8-8f33-415c-bf68-531672618685 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:41.026063 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85e2d8-8f33-415c-bf68-531672618685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:41.043626 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-6a85e2d8-8f33-415c-bf68-531672618685 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:41.044820 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-6a85e2d8-8f33-415c-bf68-531672618685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:41.053181 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 549/1098] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:41 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:41.077900 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f637d9-5b88-4272-b551-5b562d3bbc05 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:41.089731 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f637d9-5b88-4272-b551-5b562d3bbc05 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:41.093992 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0f6a6-824b-467b-84b4-0e2be0784ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:41.094751 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0f6a6-824b-467b-84b4-0e2be0784ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:41.095030 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0f6a6-824b-467b-84b4-0e2be0784ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:41.095300 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0f6a6-824b-467b-84b4-0e2be0784ff5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:41.105024 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0f6a6-824b-467b-84b4-0e2be0784ff5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:59:41.112273 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-08c0f6a6-824b-467b-84b4-0e2be0784ff5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 15:59:41.113375 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 550/1099] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:59:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:41.119588 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85e2d8-8f33-415c-bf68-531672618685 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:41.129043 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85e2d8-8f33-415c-bf68-531672618685 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:41.133555 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed04fd3-d5df-4553-8eba-7d42ee2872fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:41.134218 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed04fd3-d5df-4553-8eba-7d42ee2872fa admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:41.134497 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed04fd3-d5df-4553-8eba-7d42ee2872fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:41.134772 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed04fd3-d5df-4553-8eba-7d42ee2872fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:41.135524 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed04fd3-d5df-4553-8eba-7d42ee2872fa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:41.135826 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed04fd3-d5df-4553-8eba-7d42ee2872fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:41.137415 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed04fd3-d5df-4553-8eba-7d42ee2872fa admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:41.145783 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 550/1100] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:59:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:41.151866 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0f6a6-824b-467b-84b4-0e2be0784ff5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:41.162196 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0f6a6-824b-467b-84b4-0e2be0784ff5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:41.166602 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff20755-0b8d-42bd-a53d-339b12d21e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:41.167429 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff20755-0b8d-42bd-a53d-339b12d21e28 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:41.167704 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff20755-0b8d-42bd-a53d-339b12d21e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:41.167973 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff20755-0b8d-42bd-a53d-339b12d21e28 admin admin] PATH_INFO: `/v3/users/11533b6142af471e898873b86904857c` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:41.169173 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff20755-0b8d-42bd-a53d-339b12d21e28 admin admin] RBAC: Authorizing `identity:get_user(user_id=11533b6142af471e898873b86904857c)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:41.171341 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff20755-0b8d-42bd-a53d-339b12d21e28 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:41.173556 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 551/1101] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:59:41 2021] GET /identity/v3/users/11533b6142af471e898873b86904857c => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:41.179243 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed04fd3-d5df-4553-8eba-7d42ee2872fa admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:41.189051 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed04fd3-d5df-4553-8eba-7d42ee2872fa admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:41.193555 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7421d66-5568-4e79-b45d-2430da5af2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:41.194166 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7421d66-5568-4e79-b45d-2430da5af2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:41.194445 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7421d66-5568-4e79-b45d-2430da5af2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:41.194718 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7421d66-5568-4e79-b45d-2430da5af2f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:41.202147 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7421d66-5568-4e79-b45d-2430da5af2f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:41.203848 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7421d66-5568-4e79-b45d-2430da5af2f8 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:41.212308 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 551/1102] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:59:41 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 15:59:41.218307 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff20755-0b8d-42bd-a53d-339b12d21e28 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:41.227635 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff20755-0b8d-42bd-a53d-339b12d21e28 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:41.232082 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceca41e-2300-46a1-a6be-75b442df7f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:41.232885 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceca41e-2300-46a1-a6be-75b442df7f93 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:41.233169 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceca41e-2300-46a1-a6be-75b442df7f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:41.233482 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceca41e-2300-46a1-a6be-75b442df7f93 admin admin] PATH_INFO: `/v3/projects/45192e36fa48484d93670e4e26c28fde` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:41.235468 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceca41e-2300-46a1-a6be-75b442df7f93 admin admin] RBAC: Authorizing `identity:get_project(project_id=45192e36fa48484d93670e4e26c28fde)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:41.237514 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceca41e-2300-46a1-a6be-75b442df7f93 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:41.239104 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 552/1103] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:59:41 2021] GET /identity/v3/projects/45192e36fa48484d93670e4e26c28fde => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:41.244998 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7421d66-5568-4e79-b45d-2430da5af2f8 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:41.254075 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7421d66-5568-4e79-b45d-2430da5af2f8 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:41.258589 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544bb6d-96d9-4e42-929a-9bd985a16f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:41.259190 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544bb6d-96d9-4e42-929a-9bd985a16f65 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:41.259470 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544bb6d-96d9-4e42-929a-9bd985a16f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:41.259742 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544bb6d-96d9-4e42-929a-9bd985a16f65 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:41.260563 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544bb6d-96d9-4e42-929a-9bd985a16f65 admin admin] RBAC: Adding query filter params (role.id=bc362f875c6d4cee83ba65b8d134462d, scope.project.id=45192e36fa48484d93670e4e26c28fde, user.id=11533b6142af471e898873b86904857c) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:41.260872 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544bb6d-96d9-4e42-929a-9bd985a16f65 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:41.262687 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544bb6d-96d9-4e42-929a-9bd985a16f65 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:41.268268 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 552/1104] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:59:41 2021] GET /identity/v3/role_assignments?user.id=11533b6142af471e898873b86904857c&scope.project.id=45192e36fa48484d93670e4e26c28fde&role.id=bc362f875c6d4cee83ba65b8d134462d => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:43.606499 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc28eb3-1db2-4637-a402-b62e6bf0814c None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:43.607047 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc28eb3-1db2-4637-a402-b62e6bf0814c None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:43.607047 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc28eb3-1db2-4637-a402-b62e6bf0814c None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:43.608974 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 553/1105] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:43.614558 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48704ccf-61a5-4b15-b082-ae6f4f1ede6c None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:43.614959 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48704ccf-61a5-4b15-b082-ae6f4f1ede6c None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:43.615107 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48704ccf-61a5-4b15-b082-ae6f4f1ede6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:43.632753 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-48704ccf-61a5-4b15-b082-ae6f4f1ede6c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:43.633945 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-48704ccf-61a5-4b15-b082-ae6f4f1ede6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:43.642520 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 553/1106] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:43 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:43.669217 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc28eb3-1db2-4637-a402-b62e6bf0814c None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:43.681332 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc28eb3-1db2-4637-a402-b62e6bf0814c None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:43.685772 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b6de5-679c-41dc-ad7b-a255c68e4525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:43.686537 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b6de5-679c-41dc-ad7b-a255c68e4525 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:43.686819 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b6de5-679c-41dc-ad7b-a255c68e4525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:43.687709 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b6de5-679c-41dc-ad7b-a255c68e4525 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:43.688880 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b6de5-679c-41dc-ad7b-a255c68e4525 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:43.690593 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b6de5-679c-41dc-ad7b-a255c68e4525 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:43.692117 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 554/1107] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:43 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:43.697847 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48704ccf-61a5-4b15-b082-ae6f4f1ede6c None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:43.707226 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48704ccf-61a5-4b15-b082-ae6f4f1ede6c None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:43.711631 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67f128-13f2-4be5-8b72-097dc02d4b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:43.712272 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67f128-13f2-4be5-8b72-097dc02d4b30 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:43.712550 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67f128-13f2-4be5-8b72-097dc02d4b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:43.712821 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67f128-13f2-4be5-8b72-097dc02d4b30 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:43.713580 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67f128-13f2-4be5-8b72-097dc02d4b30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:43.715453 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67f128-13f2-4be5-8b72-097dc02d4b30 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:43.735223 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 554/1108] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Dec 15 15:59:43 2021] POST /identity/v3/users => generated 286 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:59:46.105610 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32575e08-074d-43cb-8c96-c01aa1b5d702 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:46.106102 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32575e08-074d-43cb-8c96-c01aa1b5d702 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:46.106194 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32575e08-074d-43cb-8c96-c01aa1b5d702 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:46.107912 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 555/1109] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:46.113620 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd606c-b318-4b08-af25-0da455afe23b None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:46.114030 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd606c-b318-4b08-af25-0da455afe23b None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:46.114177 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd606c-b318-4b08-af25-0da455afe23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:46.131877 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-bbcd606c-b318-4b08-af25-0da455afe23b None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:46.133057 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-bbcd606c-b318-4b08-af25-0da455afe23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:46.141323 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 555/1110] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:46 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:46.165628 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32575e08-074d-43cb-8c96-c01aa1b5d702 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:46.179981 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32575e08-074d-43cb-8c96-c01aa1b5d702 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:46.184476 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ec21f-b5dd-4dfb-a318-c723148d8ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:46.185304 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ec21f-b5dd-4dfb-a318-c723148d8ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:46.185613 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ec21f-b5dd-4dfb-a318-c723148d8ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:46.185890 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ec21f-b5dd-4dfb-a318-c723148d8ce6 admin admin] PATH_INFO: `/v3/roles/d042901298ef4d56b504a30c45128dca` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:46.188040 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ec21f-b5dd-4dfb-a318-c723148d8ce6 admin admin] RBAC: Authorizing `identity:get_role(role_id=d042901298ef4d56b504a30c45128dca)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:46.189063 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING py.warnings [None req-883ec21f-b5dd-4dfb-a318-c723148d8ce6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:59:46.189063 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: warnings.warn(msg) Dec 15 15:59:46.189063 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: Dec 15 15:59:46.189972 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ec21f-b5dd-4dfb-a318-c723148d8ce6 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:46.191305 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 556/1111] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:59:46 2021] GET /identity/v3/roles/d042901298ef4d56b504a30c45128dca => generated 223 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:46.197509 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd606c-b318-4b08-af25-0da455afe23b None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:46.206427 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd606c-b318-4b08-af25-0da455afe23b None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:46.210979 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b008b0-d11c-4a63-90d6-e9392bcc823f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:46.211812 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b008b0-d11c-4a63-90d6-e9392bcc823f admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:46.212086 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b008b0-d11c-4a63-90d6-e9392bcc823f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:46.212353 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b008b0-d11c-4a63-90d6-e9392bcc823f admin admin] PATH_INFO: `/v3/users/cbb7b582d99b47f78388442380d992d8` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:46.225289 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b008b0-d11c-4a63-90d6-e9392bcc823f admin admin] RBAC: Authorizing `identity:get_user(user_id=cbb7b582d99b47f78388442380d992d8)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:46.227432 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b008b0-d11c-4a63-90d6-e9392bcc823f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:46.229017 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 556/1112] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:59:46 2021] GET /identity/v3/users/cbb7b582d99b47f78388442380d992d8 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:46.235658 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ec21f-b5dd-4dfb-a318-c723148d8ce6 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:46.245133 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ec21f-b5dd-4dfb-a318-c723148d8ce6 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:46.250336 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d272da-2151-4212-b242-c18b91ef3ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:46.250960 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d272da-2151-4212-b242-c18b91ef3ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:46.251242 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d272da-2151-4212-b242-c18b91ef3ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:46.251515 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d272da-2151-4212-b242-c18b91ef3ba4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:46.259052 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d272da-2151-4212-b242-c18b91ef3ba4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:46.260771 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d272da-2151-4212-b242-c18b91ef3ba4 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:46.269474 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 557/1113] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:59:46 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 15:59:46.275321 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b008b0-d11c-4a63-90d6-e9392bcc823f admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:46.284899 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b008b0-d11c-4a63-90d6-e9392bcc823f admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:46.289304 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b7546-d0a0-4035-85b5-8a037ff601a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:46.290140 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b7546-d0a0-4035-85b5-8a037ff601a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:46.290421 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b7546-d0a0-4035-85b5-8a037ff601a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:46.290692 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b7546-d0a0-4035-85b5-8a037ff601a7 admin admin] PATH_INFO: `/v3/projects/45192e36fa48484d93670e4e26c28fde` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:46.291887 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b7546-d0a0-4035-85b5-8a037ff601a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=45192e36fa48484d93670e4e26c28fde)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:46.293840 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b7546-d0a0-4035-85b5-8a037ff601a7 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:46.295416 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 557/1114] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:59:46 2021] GET /identity/v3/projects/45192e36fa48484d93670e4e26c28fde => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:46.302194 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d272da-2151-4212-b242-c18b91ef3ba4 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:46.310594 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d272da-2151-4212-b242-c18b91ef3ba4 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:46.315857 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa15b9-cda6-4aec-a512-03ff3a04e5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:46.316455 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa15b9-cda6-4aec-a512-03ff3a04e5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:46.316736 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa15b9-cda6-4aec-a512-03ff3a04e5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:46.317009 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa15b9-cda6-4aec-a512-03ff3a04e5d1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:46.317855 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa15b9-cda6-4aec-a512-03ff3a04e5d1 admin admin] RBAC: Adding query filter params (role.id=d042901298ef4d56b504a30c45128dca, scope.project.id=45192e36fa48484d93670e4e26c28fde, user.id=cbb7b582d99b47f78388442380d992d8) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:46.318161 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa15b9-cda6-4aec-a512-03ff3a04e5d1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:46.319944 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa15b9-cda6-4aec-a512-03ff3a04e5d1 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:46.325024 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 558/1115] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:59:46 2021] GET /identity/v3/role_assignments?user.id=cbb7b582d99b47f78388442380d992d8&scope.project.id=45192e36fa48484d93670e4e26c28fde&role.id=d042901298ef4d56b504a30c45128dca => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:48.633837 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e453ee-4fff-417d-81c2-48b01ee083d4 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:48.634366 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e453ee-4fff-417d-81c2-48b01ee083d4 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:48.634366 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e453ee-4fff-417d-81c2-48b01ee083d4 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:48.636135 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 558/1116] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:48.642463 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd10fa7-58eb-4d02-8b8e-9671f340e9fd None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:48.642886 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd10fa7-58eb-4d02-8b8e-9671f340e9fd None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:48.643001 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd10fa7-58eb-4d02-8b8e-9671f340e9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:48.661470 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-7fd10fa7-58eb-4d02-8b8e-9671f340e9fd None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:48.662643 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-7fd10fa7-58eb-4d02-8b8e-9671f340e9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:48.670118 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 559/1117] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:48 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 15:59:48.693217 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e453ee-4fff-417d-81c2-48b01ee083d4 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:48.705557 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e453ee-4fff-417d-81c2-48b01ee083d4 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:48.709862 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b5fce-e07c-4c8b-bc8f-229a7007baa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:48.710676 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b5fce-e07c-4c8b-bc8f-229a7007baa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:48.710958 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b5fce-e07c-4c8b-bc8f-229a7007baa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:48.711229 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b5fce-e07c-4c8b-bc8f-229a7007baa9 admin admin] PATH_INFO: `/v3/roles/d042901298ef4d56b504a30c45128dca` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:48.712688 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b5fce-e07c-4c8b-bc8f-229a7007baa9 admin admin] RBAC: Authorizing `identity:get_role(role_id=d042901298ef4d56b504a30c45128dca)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:48.713726 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING py.warnings [None req-4c6b5fce-e07c-4c8b-bc8f-229a7007baa9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 15:59:48.713726 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: warnings.warn(msg) Dec 15 15:59:48.713726 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: Dec 15 15:59:48.714602 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b5fce-e07c-4c8b-bc8f-229a7007baa9 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:48.716005 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 559/1118] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:59:48 2021] GET /identity/v3/roles/d042901298ef4d56b504a30c45128dca => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:48.722309 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd10fa7-58eb-4d02-8b8e-9671f340e9fd None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:48.730895 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd10fa7-58eb-4d02-8b8e-9671f340e9fd None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:48.735329 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b65df-058f-4b49-b477-438e2a121d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:48.736157 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b65df-058f-4b49-b477-438e2a121d87 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:48.736436 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b65df-058f-4b49-b477-438e2a121d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:48.736711 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b65df-058f-4b49-b477-438e2a121d87 admin admin] PATH_INFO: `/v3/users/cbb7b582d99b47f78388442380d992d8` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:48.737897 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b65df-058f-4b49-b477-438e2a121d87 admin admin] RBAC: Authorizing `identity:get_user(user_id=cbb7b582d99b47f78388442380d992d8)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:48.739982 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b65df-058f-4b49-b477-438e2a121d87 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:48.741500 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 560/1119] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:59:48 2021] GET /identity/v3/users/cbb7b582d99b47f78388442380d992d8 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 15:59:48.747279 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b5fce-e07c-4c8b-bc8f-229a7007baa9 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:48.756610 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b5fce-e07c-4c8b-bc8f-229a7007baa9 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:48.761084 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca75d8-ee3e-4fac-af24-34a36319a019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:48.761913 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca75d8-ee3e-4fac-af24-34a36319a019 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:48.762194 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca75d8-ee3e-4fac-af24-34a36319a019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:48.762464 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca75d8-ee3e-4fac-af24-34a36319a019 admin admin] PATH_INFO: `/v3/projects/45192e36fa48484d93670e4e26c28fde` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:48.763618 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca75d8-ee3e-4fac-af24-34a36319a019 admin admin] RBAC: Authorizing `identity:get_project(project_id=45192e36fa48484d93670e4e26c28fde)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:48.766335 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca75d8-ee3e-4fac-af24-34a36319a019 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:48.767927 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 560/1120] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:59:48 2021] GET /identity/v3/projects/45192e36fa48484d93670e4e26c28fde => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:48.773731 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b65df-058f-4b49-b477-438e2a121d87 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:48.783794 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b65df-058f-4b49-b477-438e2a121d87 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:48.788149 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ee242-f021-46fd-90e0-acc615820764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:48.788973 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ee242-f021-46fd-90e0-acc615820764 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:48.789252 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ee242-f021-46fd-90e0-acc615820764 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:48.789550 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ee242-f021-46fd-90e0-acc615820764 admin admin] PATH_INFO: `/v3/projects/45192e36fa48484d93670e4e26c28fde/users/cbb7b582d99b47f78388442380d992d8/roles/d042901298ef4d56b504a30c45128dca` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:48.791710 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ee242-f021-46fd-90e0-acc615820764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45192e36fa48484d93670e4e26c28fde, user_id=cbb7b582d99b47f78388442380d992d8, role_id=d042901298ef4d56b504a30c45128dca)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:48.794306 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ee242-f021-46fd-90e0-acc615820764 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:48.806468 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 561/1121] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Dec 15 15:59:48 2021] PUT /identity/v3/projects/45192e36fa48484d93670e4e26c28fde/users/cbb7b582d99b47f78388442380d992d8/roles/d042901298ef4d56b504a30c45128dca => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 15:59:51.118249 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be29db-b4dd-40bd-8b9c-eeaef9b30e7a None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:51.118779 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be29db-b4dd-40bd-8b9c-eeaef9b30e7a None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:51.118779 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be29db-b4dd-40bd-8b9c-eeaef9b30e7a None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:51.120542 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 561/1122] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:51.126794 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de1a3a-b2f3-47e0-8c59-adec3d659ae5 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:51.127227 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de1a3a-b2f3-47e0-8c59-adec3d659ae5 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:51.127334 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de1a3a-b2f3-47e0-8c59-adec3d659ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:51.145592 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-66de1a3a-b2f3-47e0-8c59-adec3d659ae5 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:51.146753 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-66de1a3a-b2f3-47e0-8c59-adec3d659ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:51.201038 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 562/1123] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:51 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:51.225283 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be29db-b4dd-40bd-8b9c-eeaef9b30e7a None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:51.237416 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be29db-b4dd-40bd-8b9c-eeaef9b30e7a None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:51.241731 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd4e84-73f7-4d3c-a63f-47a86d4daacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:51.242551 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd4e84-73f7-4d3c-a63f-47a86d4daacc admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:51.242832 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd4e84-73f7-4d3c-a63f-47a86d4daacc admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:51.243108 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd4e84-73f7-4d3c-a63f-47a86d4daacc admin admin] PATH_INFO: `/v3/roles/d042901298ef4d56b504a30c45128dca` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:51.244578 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd4e84-73f7-4d3c-a63f-47a86d4daacc admin admin] RBAC: Authorizing `identity:get_role(role_id=d042901298ef4d56b504a30c45128dca)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:51.246199 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd4e84-73f7-4d3c-a63f-47a86d4daacc admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:51.247485 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 562/1124] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:59:51 2021] GET /identity/v3/roles/d042901298ef4d56b504a30c45128dca => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:51.254054 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de1a3a-b2f3-47e0-8c59-adec3d659ae5 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:51.262636 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de1a3a-b2f3-47e0-8c59-adec3d659ae5 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:51.267830 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30322ac-79a8-4adc-bf2c-186bf6a64915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:51.268665 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30322ac-79a8-4adc-bf2c-186bf6a64915 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:51.268941 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30322ac-79a8-4adc-bf2c-186bf6a64915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:51.269210 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30322ac-79a8-4adc-bf2c-186bf6a64915 admin admin] PATH_INFO: `/v3/users/cbb7b582d99b47f78388442380d992d8` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:51.270414 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30322ac-79a8-4adc-bf2c-186bf6a64915 admin admin] RBAC: Authorizing `identity:get_user(user_id=cbb7b582d99b47f78388442380d992d8)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:51.272516 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30322ac-79a8-4adc-bf2c-186bf6a64915 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:51.274055 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 563/1125] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:59:51 2021] GET /identity/v3/users/cbb7b582d99b47f78388442380d992d8 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:51.279757 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd4e84-73f7-4d3c-a63f-47a86d4daacc admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:51.289251 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd4e84-73f7-4d3c-a63f-47a86d4daacc admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:51.293791 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db100a-5747-4dff-ac6e-132574d66e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:51.294342 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db100a-5747-4dff-ac6e-132574d66e63 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:51.294625 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db100a-5747-4dff-ac6e-132574d66e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:51.294901 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db100a-5747-4dff-ac6e-132574d66e63 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:51.302433 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db100a-5747-4dff-ac6e-132574d66e63 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:51.304127 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db100a-5747-4dff-ac6e-132574d66e63 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:51.313318 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 563/1126] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:59:51 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 15:59:51.319116 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30322ac-79a8-4adc-bf2c-186bf6a64915 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:51.329002 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30322ac-79a8-4adc-bf2c-186bf6a64915 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:51.333406 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25b67d-7e66-4819-92f4-2ea0ee9d0306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:51.334219 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25b67d-7e66-4819-92f4-2ea0ee9d0306 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:51.334492 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25b67d-7e66-4819-92f4-2ea0ee9d0306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:51.334761 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25b67d-7e66-4819-92f4-2ea0ee9d0306 admin admin] PATH_INFO: `/v3/projects/45192e36fa48484d93670e4e26c28fde` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:51.335922 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25b67d-7e66-4819-92f4-2ea0ee9d0306 admin admin] RBAC: Authorizing `identity:get_project(project_id=45192e36fa48484d93670e4e26c28fde)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:51.337950 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25b67d-7e66-4819-92f4-2ea0ee9d0306 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:51.339516 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 564/1127] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:59:51 2021] GET /identity/v3/projects/45192e36fa48484d93670e4e26c28fde => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:51.345833 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db100a-5747-4dff-ac6e-132574d66e63 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:51.354255 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db100a-5747-4dff-ac6e-132574d66e63 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:51.359201 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fa3fe-9836-4a24-9d4d-b2fe96747177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:51.359806 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fa3fe-9836-4a24-9d4d-b2fe96747177 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:51.360088 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fa3fe-9836-4a24-9d4d-b2fe96747177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:51.360362 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fa3fe-9836-4a24-9d4d-b2fe96747177 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:51.361186 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fa3fe-9836-4a24-9d4d-b2fe96747177 admin admin] RBAC: Adding query filter params (role.id=d042901298ef4d56b504a30c45128dca, scope.project.id=45192e36fa48484d93670e4e26c28fde, user.id=cbb7b582d99b47f78388442380d992d8) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:51.361533 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fa3fe-9836-4a24-9d4d-b2fe96747177 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:51.363322 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fa3fe-9836-4a24-9d4d-b2fe96747177 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:51.369005 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 564/1128] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:59:51 2021] GET /identity/v3/role_assignments?user.id=cbb7b582d99b47f78388442380d992d8&scope.project.id=45192e36fa48484d93670e4e26c28fde&role.id=d042901298ef4d56b504a30c45128dca => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:53.716118 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07689092-2155-4584-8a60-8c0c663d037c None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:53.716647 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07689092-2155-4584-8a60-8c0c663d037c None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:53.716647 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07689092-2155-4584-8a60-8c0c663d037c None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:53.719135 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 565/1129] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:53.724739 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fee547-aa55-47be-a827-741b967a84f7 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:53.725132 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fee547-aa55-47be-a827-741b967a84f7 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:53.725308 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fee547-aa55-47be-a827-741b967a84f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:53.743203 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-82fee547-aa55-47be-a827-741b967a84f7 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:53.744373 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-82fee547-aa55-47be-a827-741b967a84f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:53.752160 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 565/1130] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:53 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:53.777625 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07689092-2155-4584-8a60-8c0c663d037c None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:53.790536 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07689092-2155-4584-8a60-8c0c663d037c None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:53.794858 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53196df-0b53-4b02-b739-8f5744f65b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:53.795617 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53196df-0b53-4b02-b739-8f5744f65b1f admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:53.795900 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53196df-0b53-4b02-b739-8f5744f65b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:53.796180 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53196df-0b53-4b02-b739-8f5744f65b1f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:53.797347 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53196df-0b53-4b02-b739-8f5744f65b1f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:53.799069 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53196df-0b53-4b02-b739-8f5744f65b1f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:53.800598 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 566/1131] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:53 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:53.806545 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fee547-aa55-47be-a827-741b967a84f7 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:53.815138 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fee547-aa55-47be-a827-741b967a84f7 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:53.819607 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dadf3-b6d2-4a20-9341-4d2fe4827ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:53.820236 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dadf3-b6d2-4a20-9341-4d2fe4827ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:53.820513 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dadf3-b6d2-4a20-9341-4d2fe4827ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:53.820783 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dadf3-b6d2-4a20-9341-4d2fe4827ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:53.821529 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02dadf3-b6d2-4a20-9341-4d2fe4827ee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:53.823379 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02dadf3-b6d2-4a20-9341-4d2fe4827ee5 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:53.848372 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 566/1132] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Dec 15 15:59:53 2021] POST /identity/v3/projects => generated 311 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 15:59:56.213717 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e11f6b-d8fe-4ea6-9753-b704cdf2be56 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:56.214237 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e11f6b-d8fe-4ea6-9753-b704cdf2be56 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:56.214352 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e11f6b-d8fe-4ea6-9753-b704cdf2be56 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:56.216013 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 567/1133] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:56.222324 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376799c7-ef58-4da0-a966-41e350c578cc None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:56.222715 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376799c7-ef58-4da0-a966-41e350c578cc None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:56.222874 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376799c7-ef58-4da0-a966-41e350c578cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:56.240110 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-376799c7-ef58-4da0-a966-41e350c578cc None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:56.241270 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-376799c7-ef58-4da0-a966-41e350c578cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:56.295692 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 567/1134] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:56 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:56.321640 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e11f6b-d8fe-4ea6-9753-b704cdf2be56 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:56.334194 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e11f6b-d8fe-4ea6-9753-b704cdf2be56 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:56.338512 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88985b-b45d-4bf0-b29f-5b84ae03a03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:56.339337 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88985b-b45d-4bf0-b29f-5b84ae03a03d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:56.339624 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88985b-b45d-4bf0-b29f-5b84ae03a03d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:56.339901 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88985b-b45d-4bf0-b29f-5b84ae03a03d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:56.341071 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88985b-b45d-4bf0-b29f-5b84ae03a03d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:56.342782 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88985b-b45d-4bf0-b29f-5b84ae03a03d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:56.344345 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 568/1135] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 15:59:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:56.350105 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376799c7-ef58-4da0-a966-41e350c578cc None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:56.358588 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376799c7-ef58-4da0-a966-41e350c578cc None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:56.362993 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfdf1c-d38f-4eca-b4d0-2eb229078620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:56.363623 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfdf1c-d38f-4eca-b4d0-2eb229078620 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:56.363901 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfdf1c-d38f-4eca-b4d0-2eb229078620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:56.364173 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfdf1c-d38f-4eca-b4d0-2eb229078620 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:56.364883 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfdf1c-d38f-4eca-b4d0-2eb229078620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:56.366807 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfdf1c-d38f-4eca-b4d0-2eb229078620 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:56.389261 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 568/1136] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Dec 15 15:59:56 2021] POST /identity/v3/users => generated 286 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 15:59:58.759845 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d84b45-6b02-4d3c-8493-d15b7080428c None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:58.760427 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d84b45-6b02-4d3c-8493-d15b7080428c None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:58.760427 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d84b45-6b02-4d3c-8493-d15b7080428c None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:58.762136 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 569/1137] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 15:59:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 15:59:58.768547 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c835e-6551-4d78-b65a-f2e03e601ae3 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:58.768944 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c835e-6551-4d78-b65a-f2e03e601ae3 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:58.769101 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c835e-6551-4d78-b65a-f2e03e601ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:58.786823 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-bf0c835e-6551-4d78-b65a-f2e03e601ae3 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 15:59:58.788010 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-bf0c835e-6551-4d78-b65a-f2e03e601ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 15:59:58.795606 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 569/1138] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 15:59:58 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 15:59:58.820495 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d84b45-6b02-4d3c-8493-d15b7080428c None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:58.833254 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d84b45-6b02-4d3c-8493-d15b7080428c None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:58.837795 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637b57b-5bb9-4054-9cec-6d6b392417e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:58.838581 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637b57b-5bb9-4054-9cec-6d6b392417e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:58.838859 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637b57b-5bb9-4054-9cec-6d6b392417e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:58.839127 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637b57b-5bb9-4054-9cec-6d6b392417e3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:58.852755 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637b57b-5bb9-4054-9cec-6d6b392417e3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 15:59:58.862069 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-e637b57b-5bb9-4054-9cec-6d6b392417e3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 15:59:58.864207 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 570/1139] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 15:59:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 15:59:58.870826 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c835e-6551-4d78-b65a-f2e03e601ae3 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:58.880710 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c835e-6551-4d78-b65a-f2e03e601ae3 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:58.885210 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6d16d-0594-43f8-98ec-167e705f05d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:58.885893 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6d16d-0594-43f8-98ec-167e705f05d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:58.886174 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6d16d-0594-43f8-98ec-167e705f05d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:58.886448 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6d16d-0594-43f8-98ec-167e705f05d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:58.887203 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6d16d-0594-43f8-98ec-167e705f05d7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:58.887506 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6d16d-0594-43f8-98ec-167e705f05d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:58.889102 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6d16d-0594-43f8-98ec-167e705f05d7 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:58.897674 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 570/1140] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 15:59:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:58.906410 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637b57b-5bb9-4054-9cec-6d6b392417e3 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:58.918446 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637b57b-5bb9-4054-9cec-6d6b392417e3 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:58.923448 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955353be-5e85-43c8-a96d-d294d4d39884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:58.924276 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955353be-5e85-43c8-a96d-d294d4d39884 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:58.924551 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955353be-5e85-43c8-a96d-d294d4d39884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:58.924820 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955353be-5e85-43c8-a96d-d294d4d39884 admin admin] PATH_INFO: `/v3/users/4b4eac14ed4b4c8aadd9d4ce7c6827bc` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:58.938122 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955353be-5e85-43c8-a96d-d294d4d39884 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b4eac14ed4b4c8aadd9d4ce7c6827bc)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:58.940246 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955353be-5e85-43c8-a96d-d294d4d39884 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:58.941848 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 571/1141] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 15:59:58 2021] GET /identity/v3/users/4b4eac14ed4b4c8aadd9d4ce7c6827bc => generated 286 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:58.947995 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6d16d-0594-43f8-98ec-167e705f05d7 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:58.958081 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6d16d-0594-43f8-98ec-167e705f05d7 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:58.962879 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3f50a-3bcb-486b-8fe7-df09868006ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:58.963507 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3f50a-3bcb-486b-8fe7-df09868006ae admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:58.963784 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3f50a-3bcb-486b-8fe7-df09868006ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:58.964055 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3f50a-3bcb-486b-8fe7-df09868006ae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:58.973448 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3f50a-3bcb-486b-8fe7-df09868006ae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:58.975695 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3f50a-3bcb-486b-8fe7-df09868006ae admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:58.985069 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 571/1142] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 15:59:58 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 15:59:58.991210 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955353be-5e85-43c8-a96d-d294d4d39884 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:59.001153 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955353be-5e85-43c8-a96d-d294d4d39884 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:59.005577 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b19d8e-697d-4225-a06c-23db6876fc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:59.006400 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b19d8e-697d-4225-a06c-23db6876fc0d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:59.006679 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b19d8e-697d-4225-a06c-23db6876fc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:59.006950 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b19d8e-697d-4225-a06c-23db6876fc0d admin admin] PATH_INFO: `/v3/projects/f3ba2afef70f4b47aff957dbc80251f1` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:59.008100 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b19d8e-697d-4225-a06c-23db6876fc0d admin admin] RBAC: Authorizing `identity:get_project(project_id=f3ba2afef70f4b47aff957dbc80251f1)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:59.010226 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b19d8e-697d-4225-a06c-23db6876fc0d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:59.011746 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 572/1143] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 15:59:58 2021] GET /identity/v3/projects/f3ba2afef70f4b47aff957dbc80251f1 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 15:59:59.018056 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3f50a-3bcb-486b-8fe7-df09868006ae admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 15:59:59.026497 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3f50a-3bcb-486b-8fe7-df09868006ae admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 15:59:59.031422 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233981b-2d4e-42e2-aa39-a762ba4f5c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 15:59:59.032028 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233981b-2d4e-42e2-aa39-a762ba4f5c3c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 15:59:59.032308 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233981b-2d4e-42e2-aa39-a762ba4f5c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 15:59:59.032578 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233981b-2d4e-42e2-aa39-a762ba4f5c3c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 15:59:59.033410 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233981b-2d4e-42e2-aa39-a762ba4f5c3c admin admin] RBAC: Adding query filter params (role.id=bc362f875c6d4cee83ba65b8d134462d, scope.project.id=f3ba2afef70f4b47aff957dbc80251f1, user.id=4b4eac14ed4b4c8aadd9d4ce7c6827bc) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 15:59:59.033724 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233981b-2d4e-42e2-aa39-a762ba4f5c3c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 15:59:59.035506 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233981b-2d4e-42e2-aa39-a762ba4f5c3c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 15:59:59.040671 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 572/1144] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 15:59:59 2021] GET /identity/v3/role_assignments?user.id=4b4eac14ed4b4c8aadd9d4ce7c6827bc&scope.project.id=f3ba2afef70f4b47aff957dbc80251f1&role.id=bc362f875c6d4cee83ba65b8d134462d => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:00:01.350640 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec215fb-125d-4ded-8c9e-94f2acad08a6 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:01.351153 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec215fb-125d-4ded-8c9e-94f2acad08a6 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:01.351268 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec215fb-125d-4ded-8c9e-94f2acad08a6 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:01.352954 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 573/1145] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:00:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:00:01.359661 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac254f2-514a-436e-a18f-449dc978295f None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:01.360073 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac254f2-514a-436e-a18f-449dc978295f None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:01.360213 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac254f2-514a-436e-a18f-449dc978295f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:01.378039 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-eac254f2-514a-436e-a18f-449dc978295f None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:00:01.379207 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-eac254f2-514a-436e-a18f-449dc978295f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:00:01.386741 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 573/1146] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:00:01 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:00:01.411306 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec215fb-125d-4ded-8c9e-94f2acad08a6 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:01.424013 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec215fb-125d-4ded-8c9e-94f2acad08a6 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:01.428339 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca6e38-1f3e-40a6-9b9e-583aa2873552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:01.429104 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca6e38-1f3e-40a6-9b9e-583aa2873552 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:01.429409 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca6e38-1f3e-40a6-9b9e-583aa2873552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:01.429688 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca6e38-1f3e-40a6-9b9e-583aa2873552 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:01.440435 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca6e38-1f3e-40a6-9b9e-583aa2873552 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:00:01.447320 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-2aca6e38-1f3e-40a6-9b9e-583aa2873552 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:00:01.448445 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 574/1147] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 16:00:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:00:01.454539 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac254f2-514a-436e-a18f-449dc978295f None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:01.463246 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac254f2-514a-436e-a18f-449dc978295f None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:01.467759 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceae6d5-b786-423b-b85e-60f35346968a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:01.468395 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceae6d5-b786-423b-b85e-60f35346968a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:01.468676 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceae6d5-b786-423b-b85e-60f35346968a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:01.468950 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceae6d5-b786-423b-b85e-60f35346968a admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:01.469725 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceae6d5-b786-423b-b85e-60f35346968a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:00:01.470032 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceae6d5-b786-423b-b85e-60f35346968a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:01.471616 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceae6d5-b786-423b-b85e-60f35346968a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:01.479581 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 574/1148] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 16:00:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:00:01.486253 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca6e38-1f3e-40a6-9b9e-583aa2873552 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:01.496267 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca6e38-1f3e-40a6-9b9e-583aa2873552 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:01.501359 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521db0f8-f33e-45f9-aca6-594be5db4f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:01.502203 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521db0f8-f33e-45f9-aca6-594be5db4f74 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:01.502485 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521db0f8-f33e-45f9-aca6-594be5db4f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:01.502755 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521db0f8-f33e-45f9-aca6-594be5db4f74 admin admin] PATH_INFO: `/v3/users/4b4eac14ed4b4c8aadd9d4ce7c6827bc` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:01.503957 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521db0f8-f33e-45f9-aca6-594be5db4f74 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b4eac14ed4b4c8aadd9d4ce7c6827bc)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:01.506101 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521db0f8-f33e-45f9-aca6-594be5db4f74 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:01.507634 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 575/1149] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 16:00:01 2021] GET /identity/v3/users/4b4eac14ed4b4c8aadd9d4ce7c6827bc => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:00:01.513233 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceae6d5-b786-423b-b85e-60f35346968a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:01.522427 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceae6d5-b786-423b-b85e-60f35346968a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:01.526914 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2ca10-c15e-4d6c-a5f6-6d656ee3e026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:01.527720 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2ca10-c15e-4d6c-a5f6-6d656ee3e026 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:01.528002 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2ca10-c15e-4d6c-a5f6-6d656ee3e026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:01.528278 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2ca10-c15e-4d6c-a5f6-6d656ee3e026 admin admin] PATH_INFO: `/v3/projects/f3ba2afef70f4b47aff957dbc80251f1` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:01.529472 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2ca10-c15e-4d6c-a5f6-6d656ee3e026 admin admin] RBAC: Authorizing `identity:get_project(project_id=f3ba2afef70f4b47aff957dbc80251f1)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:01.532321 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2ca10-c15e-4d6c-a5f6-6d656ee3e026 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:01.533934 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 575/1150] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 16:00:01 2021] GET /identity/v3/projects/f3ba2afef70f4b47aff957dbc80251f1 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:00:01.539524 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521db0f8-f33e-45f9-aca6-594be5db4f74 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:01.551144 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521db0f8-f33e-45f9-aca6-594be5db4f74 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:01.555711 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905bba5-c80e-41b0-8276-ed079ba77b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:01.556561 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905bba5-c80e-41b0-8276-ed079ba77b1b admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:01.556842 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905bba5-c80e-41b0-8276-ed079ba77b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:01.557118 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905bba5-c80e-41b0-8276-ed079ba77b1b admin admin] PATH_INFO: `/v3/projects/f3ba2afef70f4b47aff957dbc80251f1/users/4b4eac14ed4b4c8aadd9d4ce7c6827bc/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:01.559136 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905bba5-c80e-41b0-8276-ed079ba77b1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3ba2afef70f4b47aff957dbc80251f1, user_id=4b4eac14ed4b4c8aadd9d4ce7c6827bc, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:01.561874 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905bba5-c80e-41b0-8276-ed079ba77b1b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:01.574866 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 576/1151] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Dec 15 16:00:01 2021] PUT /identity/v3/projects/f3ba2afef70f4b47aff957dbc80251f1/users/4b4eac14ed4b4c8aadd9d4ce7c6827bc/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:00:03.880620 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b0c7a-ee7c-464c-8cc2-ec2858477131 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:03.881215 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b0c7a-ee7c-464c-8cc2-ec2858477131 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:03.881316 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b0c7a-ee7c-464c-8cc2-ec2858477131 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:03.883061 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 576/1152] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:00:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:00:03.888928 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddfe24-c01a-4dce-b011-50d8a4672642 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:03.890119 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddfe24-c01a-4dce-b011-50d8a4672642 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:03.890119 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddfe24-c01a-4dce-b011-50d8a4672642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:03.907760 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-63ddfe24-c01a-4dce-b011-50d8a4672642 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:00:03.908949 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-63ddfe24-c01a-4dce-b011-50d8a4672642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:00:03.964370 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 577/1153] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:00:03 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:00:03.988616 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b0c7a-ee7c-464c-8cc2-ec2858477131 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:04.001227 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b0c7a-ee7c-464c-8cc2-ec2858477131 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:04.005717 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eaa01a-f889-4b17-b9ff-2bdaacbbec76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:04.006477 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eaa01a-f889-4b17-b9ff-2bdaacbbec76 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:04.006761 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eaa01a-f889-4b17-b9ff-2bdaacbbec76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:04.007037 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eaa01a-f889-4b17-b9ff-2bdaacbbec76 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:04.017644 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eaa01a-f889-4b17-b9ff-2bdaacbbec76 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:00:04.024333 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-71eaa01a-f889-4b17-b9ff-2bdaacbbec76 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:00:04.025478 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 577/1154] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 16:00:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:00:04.031966 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddfe24-c01a-4dce-b011-50d8a4672642 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:04.040649 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddfe24-c01a-4dce-b011-50d8a4672642 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:04.045133 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2014788-4526-492e-983f-31bea2fd49e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:04.045816 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2014788-4526-492e-983f-31bea2fd49e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:04.046096 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2014788-4526-492e-983f-31bea2fd49e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:04.046363 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2014788-4526-492e-983f-31bea2fd49e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:04.047110 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2014788-4526-492e-983f-31bea2fd49e3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:00:04.047410 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2014788-4526-492e-983f-31bea2fd49e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:04.049049 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2014788-4526-492e-983f-31bea2fd49e3 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:04.057224 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 578/1155] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 16:00:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:00:04.064044 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eaa01a-f889-4b17-b9ff-2bdaacbbec76 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:04.074073 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eaa01a-f889-4b17-b9ff-2bdaacbbec76 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:04.079252 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4b2aa-84f6-4412-80dc-db4efb0dd2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:04.080083 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4b2aa-84f6-4412-80dc-db4efb0dd2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:04.080362 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4b2aa-84f6-4412-80dc-db4efb0dd2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:04.080633 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4b2aa-84f6-4412-80dc-db4efb0dd2b7 admin admin] PATH_INFO: `/v3/users/4b4eac14ed4b4c8aadd9d4ce7c6827bc` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:04.081873 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4b2aa-84f6-4412-80dc-db4efb0dd2b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b4eac14ed4b4c8aadd9d4ce7c6827bc)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:04.083967 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4b2aa-84f6-4412-80dc-db4efb0dd2b7 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:04.085535 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 578/1156] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 16:00:04 2021] GET /identity/v3/users/4b4eac14ed4b4c8aadd9d4ce7c6827bc => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:00:04.091454 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2014788-4526-492e-983f-31bea2fd49e3 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:04.100832 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2014788-4526-492e-983f-31bea2fd49e3 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:04.105407 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366398f7-691e-4ffe-999b-ebdd48eaf1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:04.106029 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366398f7-691e-4ffe-999b-ebdd48eaf1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:04.106314 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366398f7-691e-4ffe-999b-ebdd48eaf1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:04.106589 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366398f7-691e-4ffe-999b-ebdd48eaf1d1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:04.114230 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366398f7-691e-4ffe-999b-ebdd48eaf1d1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:04.115968 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366398f7-691e-4ffe-999b-ebdd48eaf1d1 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:04.125186 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 579/1157] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 16:00:04 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:00:04.131148 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4b2aa-84f6-4412-80dc-db4efb0dd2b7 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:04.141054 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4b2aa-84f6-4412-80dc-db4efb0dd2b7 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:04.145549 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc449e-5334-4fa1-bb1d-ada374adeac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:04.146344 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc449e-5334-4fa1-bb1d-ada374adeac5 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:04.146623 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc449e-5334-4fa1-bb1d-ada374adeac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:04.146894 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc449e-5334-4fa1-bb1d-ada374adeac5 admin admin] PATH_INFO: `/v3/projects/f3ba2afef70f4b47aff957dbc80251f1` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:04.148054 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc449e-5334-4fa1-bb1d-ada374adeac5 admin admin] RBAC: Authorizing `identity:get_project(project_id=f3ba2afef70f4b47aff957dbc80251f1)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:04.150084 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc449e-5334-4fa1-bb1d-ada374adeac5 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:04.151667 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 579/1158] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 16:00:04 2021] GET /identity/v3/projects/f3ba2afef70f4b47aff957dbc80251f1 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:00:04.158197 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366398f7-691e-4ffe-999b-ebdd48eaf1d1 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:04.166592 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366398f7-691e-4ffe-999b-ebdd48eaf1d1 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:04.171739 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09962b6-4a0f-4726-a1ea-26496eaa3eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:04.172335 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09962b6-4a0f-4726-a1ea-26496eaa3eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:04.172617 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09962b6-4a0f-4726-a1ea-26496eaa3eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:04.172891 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09962b6-4a0f-4726-a1ea-26496eaa3eb4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:04.173740 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09962b6-4a0f-4726-a1ea-26496eaa3eb4 admin admin] RBAC: Adding query filter params (role.id=bc362f875c6d4cee83ba65b8d134462d, scope.project.id=f3ba2afef70f4b47aff957dbc80251f1, user.id=4b4eac14ed4b4c8aadd9d4ce7c6827bc) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:00:04.174047 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09962b6-4a0f-4726-a1ea-26496eaa3eb4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:04.175840 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09962b6-4a0f-4726-a1ea-26496eaa3eb4 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:04.181499 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 580/1159] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 16:00:04 2021] GET /identity/v3/role_assignments?user.id=4b4eac14ed4b4c8aadd9d4ce7c6827bc&scope.project.id=f3ba2afef70f4b47aff957dbc80251f1&role.id=bc362f875c6d4cee83ba65b8d134462d => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:00:06.521186 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3467963-5c5a-425a-b335-e570427e5c6f None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:06.521780 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3467963-5c5a-425a-b335-e570427e5c6f None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:06.521780 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3467963-5c5a-425a-b335-e570427e5c6f None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:06.523536 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 580/1160] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:00:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:00:06.529615 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0dfff-008b-421a-8f78-eacaa2fc45dd None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:06.530327 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0dfff-008b-421a-8f78-eacaa2fc45dd None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:06.530434 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0dfff-008b-421a-8f78-eacaa2fc45dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:06.550139 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-2cb0dfff-008b-421a-8f78-eacaa2fc45dd None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:00:06.551362 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-2cb0dfff-008b-421a-8f78-eacaa2fc45dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:00:06.559195 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 581/1161] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:00:06 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:00:06.584203 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3467963-5c5a-425a-b335-e570427e5c6f None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:06.600484 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3467963-5c5a-425a-b335-e570427e5c6f None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:06.605026 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5babdc3-f6e5-462e-9d5b-836bf7bcf681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:06.605704 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5babdc3-f6e5-462e-9d5b-836bf7bcf681 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:06.605980 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5babdc3-f6e5-462e-9d5b-836bf7bcf681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:06.606247 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5babdc3-f6e5-462e-9d5b-836bf7bcf681 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:06.614352 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5babdc3-f6e5-462e-9d5b-836bf7bcf681 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:06.616790 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5babdc3-f6e5-462e-9d5b-836bf7bcf681 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:06.626119 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 581/1162] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 16:00:06 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:00:06.632778 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0dfff-008b-421a-8f78-eacaa2fc45dd None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:06.642586 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0dfff-008b-421a-8f78-eacaa2fc45dd None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:06.647140 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b30342-ff9c-4d95-b2da-fba89f676c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:06.647926 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b30342-ff9c-4d95-b2da-fba89f676c37 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:06.648205 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b30342-ff9c-4d95-b2da-fba89f676c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:06.648477 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b30342-ff9c-4d95-b2da-fba89f676c37 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:06.657120 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b30342-ff9c-4d95-b2da-fba89f676c37 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:06.659022 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b30342-ff9c-4d95-b2da-fba89f676c37 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:06.674809 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-10b30342-ff9c-4d95-b2da-fba89f676c37 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Dec 15 16:00:06.675998 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 582/1163] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Dec 15 16:00:06 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:00:06.682751 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5babdc3-f6e5-462e-9d5b-836bf7bcf681 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:06.691816 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5babdc3-f6e5-462e-9d5b-836bf7bcf681 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:06.696780 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0ea63-acfb-4ac8-8dc1-175e1799fec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:06.697450 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0ea63-acfb-4ac8-8dc1-175e1799fec7 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:06.697735 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0ea63-acfb-4ac8-8dc1-175e1799fec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:06.698008 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0ea63-acfb-4ac8-8dc1-175e1799fec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:06.698761 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0ea63-acfb-4ac8-8dc1-175e1799fec7 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:00:06.699067 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0ea63-acfb-4ac8-8dc1-175e1799fec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:06.701051 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0ea63-acfb-4ac8-8dc1-175e1799fec7 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:06.710634 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 582/1164] 10.222.0.36 () {56 vars in 1136 bytes} [Wed Dec 15 16:00:06 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:00:09.070456 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621cb1d-98b6-4325-9fa6-7d3291e63e60 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:09.070921 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621cb1d-98b6-4325-9fa6-7d3291e63e60 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:09.071026 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621cb1d-98b6-4325-9fa6-7d3291e63e60 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:09.072794 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 583/1165] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:00:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:00:09.079225 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff865d0-f1b4-43ee-88ab-96031094dd52 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:09.079650 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff865d0-f1b4-43ee-88ab-96031094dd52 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:09.079772 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff865d0-f1b4-43ee-88ab-96031094dd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:09.097157 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-6ff865d0-f1b4-43ee-88ab-96031094dd52 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:00:09.098370 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-6ff865d0-f1b4-43ee-88ab-96031094dd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:00:09.105857 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 583/1166] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:00:09 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:00:09.129503 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621cb1d-98b6-4325-9fa6-7d3291e63e60 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:09.142315 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621cb1d-98b6-4325-9fa6-7d3291e63e60 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:09.146653 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6afc6-32eb-4f3d-8e88-e7880b2ef141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:09.147287 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6afc6-32eb-4f3d-8e88-e7880b2ef141 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:09.147568 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6afc6-32eb-4f3d-8e88-e7880b2ef141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:09.147841 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6afc6-32eb-4f3d-8e88-e7880b2ef141 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:09.148590 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6afc6-32eb-4f3d-8e88-e7880b2ef141 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:09.149634 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING py.warnings [None req-5cb6afc6-32eb-4f3d-8e88-e7880b2ef141 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:00:09.149634 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: warnings.warn(msg) Dec 15 16:00:09.149634 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: Dec 15 16:00:09.150501 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6afc6-32eb-4f3d-8e88-e7880b2ef141 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:09.164609 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 584/1167] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Dec 15 16:00:09 2021] POST /identity/v3/domains => generated 267 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:00:11.495205 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65667f8f-3109-4db1-a102-ac520ce0a53f None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:11.495753 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65667f8f-3109-4db1-a102-ac520ce0a53f None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:11.495753 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65667f8f-3109-4db1-a102-ac520ce0a53f None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:11.497539 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 584/1168] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:00:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:00:11.503222 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0d090-d158-4b59-84e0-7585ac292b12 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:11.503620 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0d090-d158-4b59-84e0-7585ac292b12 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:11.503779 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0d090-d158-4b59-84e0-7585ac292b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:11.521114 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-abb0d090-d158-4b59-84e0-7585ac292b12 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:00:11.522316 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-abb0d090-d158-4b59-84e0-7585ac292b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:00:11.577785 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 585/1169] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:00:11 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:00:11.602351 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65667f8f-3109-4db1-a102-ac520ce0a53f None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:11.614726 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65667f8f-3109-4db1-a102-ac520ce0a53f None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:11.619036 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e311d56-ae92-4ad1-bc23-9da545a1adcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:11.619862 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e311d56-ae92-4ad1-bc23-9da545a1adcc admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:11.620139 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e311d56-ae92-4ad1-bc23-9da545a1adcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:11.620409 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e311d56-ae92-4ad1-bc23-9da545a1adcc admin admin] PATH_INFO: `/v3/domains/bfba3e0167224293920a56ef3e94631a` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:11.630610 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e311d56-ae92-4ad1-bc23-9da545a1adcc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=bfba3e0167224293920a56ef3e94631a)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:11.632569 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e311d56-ae92-4ad1-bc23-9da545a1adcc admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:11.634160 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 585/1170] 10.222.0.36 () {56 vars in 1204 bytes} [Wed Dec 15 16:00:11 2021] GET /identity/v3/domains/bfba3e0167224293920a56ef3e94631a => generated 267 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:00:11.640537 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0d090-d158-4b59-84e0-7585ac292b12 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:11.649173 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0d090-d158-4b59-84e0-7585ac292b12 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:11.653757 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea4644-3291-47a5-b17e-0eb910fb091a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:11.655199 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea4644-3291-47a5-b17e-0eb910fb091a admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:11.655524 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea4644-3291-47a5-b17e-0eb910fb091a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:11.655802 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea4644-3291-47a5-b17e-0eb910fb091a admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:11.656517 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea4644-3291-47a5-b17e-0eb910fb091a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:11.658441 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea4644-3291-47a5-b17e-0eb910fb091a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:11.683441 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 586/1171] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Dec 15 16:00:11 2021] POST /identity/v3/projects => generated 361 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:00:14.129562 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624c7c4-71b4-4c0a-98f0-c894472f0a4b None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:14.130095 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624c7c4-71b4-4c0a-98f0-c894472f0a4b None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:14.130095 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624c7c4-71b4-4c0a-98f0-c894472f0a4b None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:14.131859 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 586/1172] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:00:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:00:14.137401 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afaeef-8df3-4b56-9461-37866e0c7bef None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:14.137823 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afaeef-8df3-4b56-9461-37866e0c7bef None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:14.137952 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afaeef-8df3-4b56-9461-37866e0c7bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:14.155539 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-97afaeef-8df3-4b56-9461-37866e0c7bef None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:00:14.156703 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-97afaeef-8df3-4b56-9461-37866e0c7bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:00:14.211227 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 587/1173] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:00:14 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:00:14.237494 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624c7c4-71b4-4c0a-98f0-c894472f0a4b None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:14.249867 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624c7c4-71b4-4c0a-98f0-c894472f0a4b None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:14.254166 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08911cc6-8063-4e47-bab1-8013adf2130c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:14.254989 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08911cc6-8063-4e47-bab1-8013adf2130c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:14.255271 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08911cc6-8063-4e47-bab1-8013adf2130c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:14.255548 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08911cc6-8063-4e47-bab1-8013adf2130c admin admin] PATH_INFO: `/v3/domains/bfba3e0167224293920a56ef3e94631a` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:14.256717 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08911cc6-8063-4e47-bab1-8013adf2130c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=bfba3e0167224293920a56ef3e94631a)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:14.258679 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08911cc6-8063-4e47-bab1-8013adf2130c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:14.260208 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 587/1174] 10.222.0.36 () {56 vars in 1204 bytes} [Wed Dec 15 16:00:14 2021] GET /identity/v3/domains/bfba3e0167224293920a56ef3e94631a => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:00:14.266288 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97afaeef-8df3-4b56-9461-37866e0c7bef None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:14.274890 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97afaeef-8df3-4b56-9461-37866e0c7bef None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:14.280126 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4caf71-f931-40f3-b91f-99453f24c218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:14.280758 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4caf71-f931-40f3-b91f-99453f24c218 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:14.281037 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4caf71-f931-40f3-b91f-99453f24c218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:14.281309 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4caf71-f931-40f3-b91f-99453f24c218 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:14.282050 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4caf71-f931-40f3-b91f-99453f24c218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:14.283938 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4caf71-f931-40f3-b91f-99453f24c218 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:14.303598 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 588/1175] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Dec 15 16:00:14 2021] POST /identity/v3/users => generated 311 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:00:16.713446 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a637c0-8050-4bbc-82b1-e56a202cf85b None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:16.714002 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a637c0-8050-4bbc-82b1-e56a202cf85b None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:16.714002 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a637c0-8050-4bbc-82b1-e56a202cf85b None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:16.715757 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 588/1176] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:00:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:00:16.721496 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090b4e6-dbb9-42c9-8550-a6153787a18a None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:16.721922 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090b4e6-dbb9-42c9-8550-a6153787a18a None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:16.722051 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090b4e6-dbb9-42c9-8550-a6153787a18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:16.739862 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-0090b4e6-dbb9-42c9-8550-a6153787a18a None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:00:16.741032 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-0090b4e6-dbb9-42c9-8550-a6153787a18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:00:16.749030 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 589/1177] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:00:16 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:00:16.773102 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a637c0-8050-4bbc-82b1-e56a202cf85b None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:16.785791 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a637c0-8050-4bbc-82b1-e56a202cf85b None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:16.790135 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3e7f4-774c-485d-b3f9-5eb83500dcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:16.790888 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3e7f4-774c-485d-b3f9-5eb83500dcf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:16.791173 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3e7f4-774c-485d-b3f9-5eb83500dcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:16.791453 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3e7f4-774c-485d-b3f9-5eb83500dcf0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:16.802539 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3e7f4-774c-485d-b3f9-5eb83500dcf0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:00:16.809297 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-b2b3e7f4-774c-485d-b3f9-5eb83500dcf0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:00:16.811204 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 589/1178] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 16:00:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:00:16.817309 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090b4e6-dbb9-42c9-8550-a6153787a18a None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:16.826539 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090b4e6-dbb9-42c9-8550-a6153787a18a None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:16.830955 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be7e85-e5f1-4a03-8da6-a23f5ccee080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:16.831583 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be7e85-e5f1-4a03-8da6-a23f5ccee080 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:16.831861 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be7e85-e5f1-4a03-8da6-a23f5ccee080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:16.832130 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be7e85-e5f1-4a03-8da6-a23f5ccee080 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:16.832870 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be7e85-e5f1-4a03-8da6-a23f5ccee080 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:00:16.833167 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be7e85-e5f1-4a03-8da6-a23f5ccee080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:16.834787 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be7e85-e5f1-4a03-8da6-a23f5ccee080 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:16.842684 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 590/1179] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 16:00:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:00:16.848578 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3e7f4-774c-485d-b3f9-5eb83500dcf0 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:16.857963 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3e7f4-774c-485d-b3f9-5eb83500dcf0 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:16.862461 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb9517-65de-47dd-8e29-e316e74364b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:16.863276 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb9517-65de-47dd-8e29-e316e74364b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:16.863555 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb9517-65de-47dd-8e29-e316e74364b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:16.863830 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb9517-65de-47dd-8e29-e316e74364b8 admin admin] PATH_INFO: `/v3/users/ab6b38546e12458b997d6da959b9d7f9` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:16.879657 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb9517-65de-47dd-8e29-e316e74364b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=ab6b38546e12458b997d6da959b9d7f9)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:16.883590 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb9517-65de-47dd-8e29-e316e74364b8 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:16.886413 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 590/1180] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 16:00:16 2021] GET /identity/v3/users/ab6b38546e12458b997d6da959b9d7f9 => generated 311 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:00:16.893609 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be7e85-e5f1-4a03-8da6-a23f5ccee080 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:16.903026 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be7e85-e5f1-4a03-8da6-a23f5ccee080 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:16.907796 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f336bab-c01e-4bc3-b067-a4f55edaef7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:16.908413 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f336bab-c01e-4bc3-b067-a4f55edaef7e admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:16.908698 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f336bab-c01e-4bc3-b067-a4f55edaef7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:16.908970 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f336bab-c01e-4bc3-b067-a4f55edaef7e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:16.916498 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f336bab-c01e-4bc3-b067-a4f55edaef7e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:16.918266 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f336bab-c01e-4bc3-b067-a4f55edaef7e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:16.927428 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 591/1181] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 16:00:16 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:00:16.933295 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb9517-65de-47dd-8e29-e316e74364b8 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:16.943095 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb9517-65de-47dd-8e29-e316e74364b8 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:16.947529 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972bb66-5613-45e5-8d3d-e106a60233cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:16.948338 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972bb66-5613-45e5-8d3d-e106a60233cb admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:16.948620 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972bb66-5613-45e5-8d3d-e106a60233cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:16.948894 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972bb66-5613-45e5-8d3d-e106a60233cb admin admin] PATH_INFO: `/v3/projects/fe100bda9c6d4657b253f8104a858575` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:16.950063 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972bb66-5613-45e5-8d3d-e106a60233cb admin admin] RBAC: Authorizing `identity:get_project(project_id=fe100bda9c6d4657b253f8104a858575)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:16.952255 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972bb66-5613-45e5-8d3d-e106a60233cb admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:16.953879 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 591/1182] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 16:00:16 2021] GET /identity/v3/projects/fe100bda9c6d4657b253f8104a858575 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:00:16.959916 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f336bab-c01e-4bc3-b067-a4f55edaef7e admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:16.968379 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f336bab-c01e-4bc3-b067-a4f55edaef7e admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:16.972769 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533093f5-95d0-44b3-af8b-10805f9962a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:16.973369 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533093f5-95d0-44b3-af8b-10805f9962a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:16.973686 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533093f5-95d0-44b3-af8b-10805f9962a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:16.973960 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533093f5-95d0-44b3-af8b-10805f9962a9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:16.974772 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533093f5-95d0-44b3-af8b-10805f9962a9 admin admin] RBAC: Adding query filter params (role.id=bc362f875c6d4cee83ba65b8d134462d, scope.project.id=fe100bda9c6d4657b253f8104a858575, user.id=ab6b38546e12458b997d6da959b9d7f9) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:00:16.975077 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533093f5-95d0-44b3-af8b-10805f9962a9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:16.976872 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533093f5-95d0-44b3-af8b-10805f9962a9 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:16.982589 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 592/1183] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 16:00:16 2021] GET /identity/v3/role_assignments?user.id=ab6b38546e12458b997d6da959b9d7f9&scope.project.id=fe100bda9c6d4657b253f8104a858575&role.id=bc362f875c6d4cee83ba65b8d134462d => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:00:19.303557 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ef4d8-e181-460b-a998-467fa47b754a None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:19.304082 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ef4d8-e181-460b-a998-467fa47b754a None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:19.304082 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ef4d8-e181-460b-a998-467fa47b754a None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:19.305820 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 592/1184] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:00:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:00:19.311577 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757b33e-71db-4e06-9652-c790d2ed9726 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:19.311965 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757b33e-71db-4e06-9652-c790d2ed9726 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:19.312121 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757b33e-71db-4e06-9652-c790d2ed9726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:19.329797 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-d757b33e-71db-4e06-9652-c790d2ed9726 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:00:19.330971 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-d757b33e-71db-4e06-9652-c790d2ed9726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:00:19.338549 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 593/1185] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:00:19 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:00:19.362377 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ef4d8-e181-460b-a998-467fa47b754a None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:19.374341 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ef4d8-e181-460b-a998-467fa47b754a None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:19.378550 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279464e-5577-4982-8284-9e9485c1de62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:19.379295 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279464e-5577-4982-8284-9e9485c1de62 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:19.379575 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279464e-5577-4982-8284-9e9485c1de62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:19.379848 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279464e-5577-4982-8284-9e9485c1de62 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:19.390281 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1279464e-5577-4982-8284-9e9485c1de62 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:00:19.396909 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-1279464e-5577-4982-8284-9e9485c1de62 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:00:19.398044 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 593/1186] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 16:00:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:00:19.405050 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757b33e-71db-4e06-9652-c790d2ed9726 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:19.413762 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757b33e-71db-4e06-9652-c790d2ed9726 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:19.418214 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d04b5d-9a88-4d29-b997-2e3aef7fd9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:19.418852 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d04b5d-9a88-4d29-b997-2e3aef7fd9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:19.419132 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d04b5d-9a88-4d29-b997-2e3aef7fd9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:19.419407 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d04b5d-9a88-4d29-b997-2e3aef7fd9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:19.420151 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d04b5d-9a88-4d29-b997-2e3aef7fd9a2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:00:19.420453 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d04b5d-9a88-4d29-b997-2e3aef7fd9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:19.422085 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d04b5d-9a88-4d29-b997-2e3aef7fd9a2 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:19.430050 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 594/1187] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 16:00:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:00:19.436038 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279464e-5577-4982-8284-9e9485c1de62 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:19.445157 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279464e-5577-4982-8284-9e9485c1de62 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:19.449590 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e286b8-d215-43df-9d5f-c7b4d750fc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:19.450395 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e286b8-d215-43df-9d5f-c7b4d750fc6c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:19.451191 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e286b8-d215-43df-9d5f-c7b4d750fc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:19.451459 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e286b8-d215-43df-9d5f-c7b4d750fc6c admin admin] PATH_INFO: `/v3/users/ab6b38546e12458b997d6da959b9d7f9` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:19.452635 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e286b8-d215-43df-9d5f-c7b4d750fc6c admin admin] RBAC: Authorizing `identity:get_user(user_id=ab6b38546e12458b997d6da959b9d7f9)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:19.454749 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e286b8-d215-43df-9d5f-c7b4d750fc6c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:19.456272 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 594/1188] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 16:00:19 2021] GET /identity/v3/users/ab6b38546e12458b997d6da959b9d7f9 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:00:19.461867 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d04b5d-9a88-4d29-b997-2e3aef7fd9a2 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:19.471541 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d04b5d-9a88-4d29-b997-2e3aef7fd9a2 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:19.475949 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff069998-1d71-46e6-9d6a-b2775d7bbcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:19.476759 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff069998-1d71-46e6-9d6a-b2775d7bbcee admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:19.477041 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff069998-1d71-46e6-9d6a-b2775d7bbcee admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:19.477315 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff069998-1d71-46e6-9d6a-b2775d7bbcee admin admin] PATH_INFO: `/v3/projects/fe100bda9c6d4657b253f8104a858575` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:19.478526 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff069998-1d71-46e6-9d6a-b2775d7bbcee admin admin] RBAC: Authorizing `identity:get_project(project_id=fe100bda9c6d4657b253f8104a858575)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:19.480557 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff069998-1d71-46e6-9d6a-b2775d7bbcee admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:19.482415 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 595/1189] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 16:00:19 2021] GET /identity/v3/projects/fe100bda9c6d4657b253f8104a858575 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:00:19.487923 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e286b8-d215-43df-9d5f-c7b4d750fc6c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:19.497349 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e286b8-d215-43df-9d5f-c7b4d750fc6c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:19.501800 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc90ba-7031-4282-861b-9fd68011a552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:19.502609 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc90ba-7031-4282-861b-9fd68011a552 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:19.502885 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc90ba-7031-4282-861b-9fd68011a552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:19.503156 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc90ba-7031-4282-861b-9fd68011a552 admin admin] PATH_INFO: `/v3/projects/fe100bda9c6d4657b253f8104a858575/users/ab6b38546e12458b997d6da959b9d7f9/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:19.505048 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc90ba-7031-4282-861b-9fd68011a552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe100bda9c6d4657b253f8104a858575, user_id=ab6b38546e12458b997d6da959b9d7f9, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:19.507610 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc90ba-7031-4282-861b-9fd68011a552 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:19.520505 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 595/1190] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Dec 15 16:00:19 2021] PUT /identity/v3/projects/fe100bda9c6d4657b253f8104a858575/users/ab6b38546e12458b997d6da959b9d7f9/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:00:21.821266 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49d76e-9969-45bf-a03c-e1ac22c35b81 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:21.821823 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49d76e-9969-45bf-a03c-e1ac22c35b81 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:21.821823 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49d76e-9969-45bf-a03c-e1ac22c35b81 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:21.823575 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 596/1191] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:00:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:00:21.830014 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b3764-7d5e-40f4-a316-0dc9aba62643 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:21.830411 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b3764-7d5e-40f4-a316-0dc9aba62643 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:21.830568 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b3764-7d5e-40f4-a316-0dc9aba62643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:21.847679 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-fd4b3764-7d5e-40f4-a316-0dc9aba62643 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:00:21.848855 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-fd4b3764-7d5e-40f4-a316-0dc9aba62643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:00:21.903864 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 596/1192] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:00:21 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:00:21.928200 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49d76e-9969-45bf-a03c-e1ac22c35b81 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:21.940841 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49d76e-9969-45bf-a03c-e1ac22c35b81 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:21.945102 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2ad3f-5371-47fe-bb26-4987eeeee3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:21.945892 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2ad3f-5371-47fe-bb26-4987eeeee3fc admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:21.946173 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2ad3f-5371-47fe-bb26-4987eeeee3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:21.946442 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2ad3f-5371-47fe-bb26-4987eeeee3fc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:21.956811 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2ad3f-5371-47fe-bb26-4987eeeee3fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:00:21.963577 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-85d2ad3f-5371-47fe-bb26-4987eeeee3fc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:00:21.964691 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 597/1193] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 16:00:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:00:21.971022 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b3764-7d5e-40f4-a316-0dc9aba62643 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:21.979524 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b3764-7d5e-40f4-a316-0dc9aba62643 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:21.984173 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28d49c-06c2-4fdb-8534-c876d577000d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:21.984805 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28d49c-06c2-4fdb-8534-c876d577000d admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:21.985083 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28d49c-06c2-4fdb-8534-c876d577000d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:21.985354 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28d49c-06c2-4fdb-8534-c876d577000d admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:21.986139 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28d49c-06c2-4fdb-8534-c876d577000d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:00:21.986440 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28d49c-06c2-4fdb-8534-c876d577000d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:21.987995 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28d49c-06c2-4fdb-8534-c876d577000d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:21.995796 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 597/1194] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 16:00:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:00:22.002395 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2ad3f-5371-47fe-bb26-4987eeeee3fc admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:22.012224 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2ad3f-5371-47fe-bb26-4987eeeee3fc admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:22.017197 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed6f75-b2b9-48ef-a127-bb2f6678997c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:22.018047 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed6f75-b2b9-48ef-a127-bb2f6678997c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:22.018335 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed6f75-b2b9-48ef-a127-bb2f6678997c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:22.018608 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed6f75-b2b9-48ef-a127-bb2f6678997c admin admin] PATH_INFO: `/v3/users/ab6b38546e12458b997d6da959b9d7f9` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:22.019784 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed6f75-b2b9-48ef-a127-bb2f6678997c admin admin] RBAC: Authorizing `identity:get_user(user_id=ab6b38546e12458b997d6da959b9d7f9)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:22.021928 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed6f75-b2b9-48ef-a127-bb2f6678997c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:22.023445 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 598/1195] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Dec 15 16:00:22 2021] GET /identity/v3/users/ab6b38546e12458b997d6da959b9d7f9 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:00:22.029086 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28d49c-06c2-4fdb-8534-c876d577000d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:22.038409 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28d49c-06c2-4fdb-8534-c876d577000d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:22.042868 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96521a88-9250-4a37-b7fe-0438fa006435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:22.043491 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96521a88-9250-4a37-b7fe-0438fa006435 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:22.043770 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96521a88-9250-4a37-b7fe-0438fa006435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:22.044043 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96521a88-9250-4a37-b7fe-0438fa006435 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:22.051753 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96521a88-9250-4a37-b7fe-0438fa006435 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:22.053501 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96521a88-9250-4a37-b7fe-0438fa006435 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:22.062507 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 598/1196] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 16:00:22 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:00:22.068656 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed6f75-b2b9-48ef-a127-bb2f6678997c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:22.078865 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed6f75-b2b9-48ef-a127-bb2f6678997c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:22.083310 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ceae6-8248-4442-8842-5b8d38bb937c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:22.084132 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ceae6-8248-4442-8842-5b8d38bb937c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:22.084413 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ceae6-8248-4442-8842-5b8d38bb937c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:22.084687 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ceae6-8248-4442-8842-5b8d38bb937c admin admin] PATH_INFO: `/v3/projects/fe100bda9c6d4657b253f8104a858575` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:22.085879 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ceae6-8248-4442-8842-5b8d38bb937c admin admin] RBAC: Authorizing `identity:get_project(project_id=fe100bda9c6d4657b253f8104a858575)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:22.087896 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ceae6-8248-4442-8842-5b8d38bb937c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:22.089634 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 599/1197] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 16:00:22 2021] GET /identity/v3/projects/fe100bda9c6d4657b253f8104a858575 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:00:22.095716 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96521a88-9250-4a37-b7fe-0438fa006435 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:00:22.103977 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96521a88-9250-4a37-b7fe-0438fa006435 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:00:22.108387 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45592390-3ca4-45f7-982e-b16a5d43d5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:00:22.108998 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45592390-3ca4-45f7-982e-b16a5d43d5cd admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:00:22.109278 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45592390-3ca4-45f7-982e-b16a5d43d5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:00:22.109591 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45592390-3ca4-45f7-982e-b16a5d43d5cd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:00:22.110408 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45592390-3ca4-45f7-982e-b16a5d43d5cd admin admin] RBAC: Adding query filter params (role.id=bc362f875c6d4cee83ba65b8d134462d, scope.project.id=fe100bda9c6d4657b253f8104a858575, user.id=ab6b38546e12458b997d6da959b9d7f9) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:00:22.110716 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45592390-3ca4-45f7-982e-b16a5d43d5cd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:00:22.112509 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45592390-3ca4-45f7-982e-b16a5d43d5cd admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:00:22.117949 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 599/1198] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 16:00:22 2021] GET /identity/v3/role_assignments?user.id=ab6b38546e12458b997d6da959b9d7f9&scope.project.id=fe100bda9c6d4657b253f8104a858575&role.id=bc362f875c6d4cee83ba65b8d134462d => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:20.440167 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4547391-f498-45da-8787-a1258b90bd85 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:20.440753 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4547391-f498-45da-8787-a1258b90bd85 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:20.440753 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4547391-f498-45da-8787-a1258b90bd85 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:20.442822 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 600/1199] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:01:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:01:20.448733 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8525a-369c-4046-b637-b9f5bf903345 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:20.449245 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8525a-369c-4046-b637-b9f5bf903345 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:20.449245 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8525a-369c-4046-b637-b9f5bf903345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:20.470000 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-c7d8525a-369c-4046-b637-b9f5bf903345 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:01:20.471348 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c7d8525a-369c-4046-b637-b9f5bf903345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:01:20.480335 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 600/1200] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:01:20 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:01:20.511981 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4547391-f498-45da-8787-a1258b90bd85 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:20.532418 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4547391-f498-45da-8787-a1258b90bd85 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:20.538488 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f741f2-c0f7-40e0-9c75-64e7d655ff98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:20.539591 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f741f2-c0f7-40e0-9c75-64e7d655ff98 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:20.539712 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f741f2-c0f7-40e0-9c75-64e7d655ff98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:20.539906 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f741f2-c0f7-40e0-9c75-64e7d655ff98 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:20.551496 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f741f2-c0f7-40e0-9c75-64e7d655ff98 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:20.553665 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f741f2-c0f7-40e0-9c75-64e7d655ff98 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:20.576484 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-55f741f2-c0f7-40e0-9c75-64e7d655ff98 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:01:20.581491 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 601/1201] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 16:01:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:20.586065 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8525a-369c-4046-b637-b9f5bf903345 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:20.601330 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8525a-369c-4046-b637-b9f5bf903345 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:20.609719 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ccef2-207e-4e11-8356-9841ef397768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:20.610605 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ccef2-207e-4e11-8356-9841ef397768 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:20.610891 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ccef2-207e-4e11-8356-9841ef397768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:20.611166 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ccef2-207e-4e11-8356-9841ef397768 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:20.611984 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ccef2-207e-4e11-8356-9841ef397768 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:20.612294 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ccef2-207e-4e11-8356-9841ef397768 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:20.613935 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ccef2-207e-4e11-8356-9841ef397768 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:20.626903 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 601/1202] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 16:01:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:20.633479 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f741f2-c0f7-40e0-9c75-64e7d655ff98 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:20.645595 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f741f2-c0f7-40e0-9c75-64e7d655ff98 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:20.656377 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44cfe6-27e4-4f1d-87e0-b1bd3537299c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:20.656377 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44cfe6-27e4-4f1d-87e0-b1bd3537299c admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:20.656377 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44cfe6-27e4-4f1d-87e0-b1bd3537299c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:20.656377 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44cfe6-27e4-4f1d-87e0-b1bd3537299c admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:20.656779 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae44cfe6-27e4-4f1d-87e0-b1bd3537299c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:20.657090 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae44cfe6-27e4-4f1d-87e0-b1bd3537299c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:20.681233 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 602/1203] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Dec 15 16:01:20 2021] POST /identity/v3/users => generated 251 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:01:23.372842 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e7509-465c-4cfa-83f1-9ebba79272d1 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:23.373445 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e7509-465c-4cfa-83f1-9ebba79272d1 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:23.373445 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e7509-465c-4cfa-83f1-9ebba79272d1 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:23.375313 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 602/1204] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:01:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:01:23.382356 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19875a30-f2e2-49bd-96e5-c8098bce88b6 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:23.382356 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19875a30-f2e2-49bd-96e5-c8098bce88b6 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:23.382356 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19875a30-f2e2-49bd-96e5-c8098bce88b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:23.401285 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-19875a30-f2e2-49bd-96e5-c8098bce88b6 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:01:23.402889 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-19875a30-f2e2-49bd-96e5-c8098bce88b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:01:23.411698 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 603/1205] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:01:23 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:01:23.437364 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e7509-465c-4cfa-83f1-9ebba79272d1 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:23.450219 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e7509-465c-4cfa-83f1-9ebba79272d1 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:23.454668 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f58a17-fdd7-4807-befd-346ec583e033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:23.455475 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f58a17-fdd7-4807-befd-346ec583e033 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:23.455717 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f58a17-fdd7-4807-befd-346ec583e033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:23.456015 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f58a17-fdd7-4807-befd-346ec583e033 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:23.467456 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f58a17-fdd7-4807-befd-346ec583e033 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:01:23.474408 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-c8f58a17-fdd7-4807-befd-346ec583e033 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 16:01:23.477565 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 603/1206] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Dec 15 16:01:23 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:23.482114 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19875a30-f2e2-49bd-96e5-c8098bce88b6 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:23.491197 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19875a30-f2e2-49bd-96e5-c8098bce88b6 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:23.496147 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bdfb3-f659-4928-bde5-c41f7fc2818d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:23.497514 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bdfb3-f659-4928-bde5-c41f7fc2818d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:23.497757 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bdfb3-f659-4928-bde5-c41f7fc2818d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:23.498030 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bdfb3-f659-4928-bde5-c41f7fc2818d admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:23.498786 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bdfb3-f659-4928-bde5-c41f7fc2818d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:23.499091 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bdfb3-f659-4928-bde5-c41f7fc2818d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:23.500779 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bdfb3-f659-4928-bde5-c41f7fc2818d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:23.509067 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 604/1207] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Dec 15 16:01:23 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:23.515381 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f58a17-fdd7-4807-befd-346ec583e033 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:23.525072 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f58a17-fdd7-4807-befd-346ec583e033 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:23.531213 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246b691-02da-4e2a-932f-31261397dcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:23.532025 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246b691-02da-4e2a-932f-31261397dcb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:23.532308 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246b691-02da-4e2a-932f-31261397dcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:23.532583 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246b691-02da-4e2a-932f-31261397dcb7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:23.543043 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246b691-02da-4e2a-932f-31261397dcb7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:23.544999 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246b691-02da-4e2a-932f-31261397dcb7 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:23.563383 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-2246b691-02da-4e2a-932f-31261397dcb7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:01:23.564778 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 604/1208] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 16:01:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:23.570926 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bdfb3-f659-4928-bde5-c41f7fc2818d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:23.581119 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bdfb3-f659-4928-bde5-c41f7fc2818d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:23.586277 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd64c9c-e878-4275-b939-3142a2f18504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:23.587462 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd64c9c-e878-4275-b939-3142a2f18504 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:23.587462 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd64c9c-e878-4275-b939-3142a2f18504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:23.587462 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd64c9c-e878-4275-b939-3142a2f18504 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:23.588232 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd64c9c-e878-4275-b939-3142a2f18504 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:23.588587 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd64c9c-e878-4275-b939-3142a2f18504 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:23.590767 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd64c9c-e878-4275-b939-3142a2f18504 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:23.603867 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 605/1209] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 16:01:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:23.610101 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246b691-02da-4e2a-932f-31261397dcb7 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:23.620709 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246b691-02da-4e2a-932f-31261397dcb7 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:23.627182 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf4a73-2daa-4b64-bb8d-2d5e02f582d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:23.629911 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf4a73-2daa-4b64-bb8d-2d5e02f582d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:23.630273 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf4a73-2daa-4b64-bb8d-2d5e02f582d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:23.630636 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf4a73-2daa-4b64-bb8d-2d5e02f582d3 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:23.639776 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf4a73-2daa-4b64-bb8d-2d5e02f582d3 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:23.641928 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf4a73-2daa-4b64-bb8d-2d5e02f582d3 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:23.658083 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-f6bf4a73-2daa-4b64-bb8d-2d5e02f582d3 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 16:01:23.659429 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 605/1210] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 16:01:23 2021] GET /identity/v3/users/placement => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:01:23.666444 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd64c9c-e878-4275-b939-3142a2f18504 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:23.677838 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd64c9c-e878-4275-b939-3142a2f18504 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:23.683173 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ba7a1-a4b8-4098-a396-54e948889d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:23.684172 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ba7a1-a4b8-4098-a396-54e948889d1e admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:23.684912 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ba7a1-a4b8-4098-a396-54e948889d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:23.685193 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ba7a1-a4b8-4098-a396-54e948889d1e admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:23.686435 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ba7a1-a4b8-4098-a396-54e948889d1e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:23.686962 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ba7a1-a4b8-4098-a396-54e948889d1e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:23.689164 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ba7a1-a4b8-4098-a396-54e948889d1e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:23.711508 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 606/1211] 10.222.0.36 () {56 vars in 1164 bytes} [Wed Dec 15 16:01:23 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:23.720148 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf4a73-2daa-4b64-bb8d-2d5e02f582d3 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:23.731104 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf4a73-2daa-4b64-bb8d-2d5e02f582d3 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:23.736855 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28bfa9-6039-432f-b80c-053f4d6c8f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:23.737524 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28bfa9-6039-432f-b80c-053f4d6c8f50 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:23.737821 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28bfa9-6039-432f-b80c-053f4d6c8f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:23.738431 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28bfa9-6039-432f-b80c-053f4d6c8f50 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:23.748446 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28bfa9-6039-432f-b80c-053f4d6c8f50 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:23.754828 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28bfa9-6039-432f-b80c-053f4d6c8f50 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:23.766143 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 606/1212] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 16:01:23 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:01:23.773038 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ba7a1-a4b8-4098-a396-54e948889d1e admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:23.784490 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ba7a1-a4b8-4098-a396-54e948889d1e admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:23.789393 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0e7ce-2a86-487a-9be2-62054e507f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:23.790291 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0e7ce-2a86-487a-9be2-62054e507f97 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:23.790571 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0e7ce-2a86-487a-9be2-62054e507f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:23.790843 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0e7ce-2a86-487a-9be2-62054e507f97 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:23.803815 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0e7ce-2a86-487a-9be2-62054e507f97 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:23.805733 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0e7ce-2a86-487a-9be2-62054e507f97 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:23.824289 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-7bb0e7ce-2a86-487a-9be2-62054e507f97 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:01:23.826242 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 607/1213] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 16:01:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:23.832462 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28bfa9-6039-432f-b80c-053f4d6c8f50 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:23.841614 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28bfa9-6039-432f-b80c-053f4d6c8f50 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:23.846678 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e1afe-3982-4fec-8f02-a3934a5e69bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:23.847381 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e1afe-3982-4fec-8f02-a3934a5e69bb admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:23.847648 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e1afe-3982-4fec-8f02-a3934a5e69bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:23.847951 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e1afe-3982-4fec-8f02-a3934a5e69bb admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:23.848664 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e1afe-3982-4fec-8f02-a3934a5e69bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:23.848958 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e1afe-3982-4fec-8f02-a3934a5e69bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:23.850666 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e1afe-3982-4fec-8f02-a3934a5e69bb admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:23.864640 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 607/1214] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 16:01:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:23.870483 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0e7ce-2a86-487a-9be2-62054e507f97 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:23.884192 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0e7ce-2a86-487a-9be2-62054e507f97 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:23.888320 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dcd25-93e0-4aa9-86ed-8ee75220b828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:23.889160 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dcd25-93e0-4aa9-86ed-8ee75220b828 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:23.889433 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dcd25-93e0-4aa9-86ed-8ee75220b828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:23.889703 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dcd25-93e0-4aa9-86ed-8ee75220b828 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:23.897012 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9dcd25-93e0-4aa9-86ed-8ee75220b828 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:23.899043 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9dcd25-93e0-4aa9-86ed-8ee75220b828 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:23.913807 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-ba9dcd25-93e0-4aa9-86ed-8ee75220b828 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:01:23.915070 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 608/1215] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 16:01:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:23.922580 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e1afe-3982-4fec-8f02-a3934a5e69bb admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:23.933047 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e1afe-3982-4fec-8f02-a3934a5e69bb admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:23.939211 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cc3ea-7a2f-489d-9370-c7cdc4f74c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:23.940068 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cc3ea-7a2f-489d-9370-c7cdc4f74c44 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:23.940407 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cc3ea-7a2f-489d-9370-c7cdc4f74c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:23.940690 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cc3ea-7a2f-489d-9370-c7cdc4f74c44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:23.941591 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3cc3ea-7a2f-489d-9370-c7cdc4f74c44 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:23.941905 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3cc3ea-7a2f-489d-9370-c7cdc4f74c44 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:23.943848 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3cc3ea-7a2f-489d-9370-c7cdc4f74c44 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:23.957614 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 608/1216] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 16:01:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:23.964569 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dcd25-93e0-4aa9-86ed-8ee75220b828 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:23.975793 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dcd25-93e0-4aa9-86ed-8ee75220b828 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:23.981501 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b3898-8a68-41b9-85be-637c797cf774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:23.982269 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b3898-8a68-41b9-85be-637c797cf774 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:23.982555 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b3898-8a68-41b9-85be-637c797cf774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:23.982832 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b3898-8a68-41b9-85be-637c797cf774 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:23.983753 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b3898-8a68-41b9-85be-637c797cf774 admin admin] RBAC: Adding query filter params (role.id=17e6533ce814487c9a8fb0ee2acaad32, scope.project.id=bc314fbc91c54810b27f9fcad7129c64, user.id=e186d6728a2341399252238c559002f6) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:23.984209 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b3898-8a68-41b9-85be-637c797cf774 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:23.986255 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b3898-8a68-41b9-85be-637c797cf774 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:23.993433 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 609/1217] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 16:01:23 2021] GET /identity/v3/role_assignments?user.id=e186d6728a2341399252238c559002f6&scope.project.id=bc314fbc91c54810b27f9fcad7129c64&role.id=17e6533ce814487c9a8fb0ee2acaad32 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:26.415119 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e170e8-3ae6-4dba-aa20-eff9d7d7141b None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:26.415690 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e170e8-3ae6-4dba-aa20-eff9d7d7141b None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:26.415814 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e170e8-3ae6-4dba-aa20-eff9d7d7141b None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:26.417889 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 609/1218] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:01:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:01:26.425280 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc46ac6-2d9b-40f7-a002-34c1a8c969e3 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:26.425771 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc46ac6-2d9b-40f7-a002-34c1a8c969e3 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:26.426052 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc46ac6-2d9b-40f7-a002-34c1a8c969e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:26.448438 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-dbc46ac6-2d9b-40f7-a002-34c1a8c969e3 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:01:26.450122 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-dbc46ac6-2d9b-40f7-a002-34c1a8c969e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:01:26.459438 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 610/1219] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:01:26 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:01:26.487923 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e170e8-3ae6-4dba-aa20-eff9d7d7141b None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:26.501010 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e170e8-3ae6-4dba-aa20-eff9d7d7141b None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:26.505633 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31b4ab-064b-40a1-91ad-72dd12882783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:26.506451 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31b4ab-064b-40a1-91ad-72dd12882783 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:26.506732 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31b4ab-064b-40a1-91ad-72dd12882783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:26.507010 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31b4ab-064b-40a1-91ad-72dd12882783 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:26.520844 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31b4ab-064b-40a1-91ad-72dd12882783 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:01:26.529875 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-1d31b4ab-064b-40a1-91ad-72dd12882783 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 16:01:26.531934 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 610/1220] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Dec 15 16:01:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:26.543808 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc46ac6-2d9b-40f7-a002-34c1a8c969e3 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:26.552525 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc46ac6-2d9b-40f7-a002-34c1a8c969e3 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:26.557788 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8f972-ad93-401c-b1ec-634df0f72c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:26.558571 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8f972-ad93-401c-b1ec-634df0f72c9e admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:26.559032 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8f972-ad93-401c-b1ec-634df0f72c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:26.559463 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8f972-ad93-401c-b1ec-634df0f72c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:26.560272 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8f972-ad93-401c-b1ec-634df0f72c9e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:26.560616 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8f972-ad93-401c-b1ec-634df0f72c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:26.562408 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8f972-ad93-401c-b1ec-634df0f72c9e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:26.572035 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 611/1221] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Dec 15 16:01:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:26.579560 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31b4ab-064b-40a1-91ad-72dd12882783 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:26.592019 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31b4ab-064b-40a1-91ad-72dd12882783 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:26.602109 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c35f92-8e77-4fc0-bd09-f9cc531b4e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:26.603301 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c35f92-8e77-4fc0-bd09-f9cc531b4e51 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:26.603680 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c35f92-8e77-4fc0-bd09-f9cc531b4e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:26.604058 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c35f92-8e77-4fc0-bd09-f9cc531b4e51 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:26.619390 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c35f92-8e77-4fc0-bd09-f9cc531b4e51 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:26.622540 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c35f92-8e77-4fc0-bd09-f9cc531b4e51 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:26.641747 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-35c35f92-8e77-4fc0-bd09-f9cc531b4e51 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:01:26.643003 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 611/1222] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 16:01:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:26.649608 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8f972-ad93-401c-b1ec-634df0f72c9e admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:26.663433 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8f972-ad93-401c-b1ec-634df0f72c9e admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:26.665333 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac77d7-472d-49c5-b3c3-89298ae3be1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:26.665984 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac77d7-472d-49c5-b3c3-89298ae3be1d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:26.666299 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac77d7-472d-49c5-b3c3-89298ae3be1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:26.666708 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac77d7-472d-49c5-b3c3-89298ae3be1d admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:26.667400 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac77d7-472d-49c5-b3c3-89298ae3be1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:26.667759 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac77d7-472d-49c5-b3c3-89298ae3be1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:26.670100 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac77d7-472d-49c5-b3c3-89298ae3be1d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:26.685815 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 612/1223] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 16:01:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:26.692775 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c35f92-8e77-4fc0-bd09-f9cc531b4e51 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:26.704670 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c35f92-8e77-4fc0-bd09-f9cc531b4e51 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:26.709220 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962c0d3-125d-4371-b540-c6b2e19d7b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:26.710067 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962c0d3-125d-4371-b540-c6b2e19d7b07 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:26.710456 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962c0d3-125d-4371-b540-c6b2e19d7b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:26.710702 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962c0d3-125d-4371-b540-c6b2e19d7b07 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:26.719554 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962c0d3-125d-4371-b540-c6b2e19d7b07 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:26.721936 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962c0d3-125d-4371-b540-c6b2e19d7b07 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:26.737814 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-0962c0d3-125d-4371-b540-c6b2e19d7b07 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 16:01:26.738977 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 612/1224] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 16:01:26 2021] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:26.745362 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac77d7-472d-49c5-b3c3-89298ae3be1d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:26.756521 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac77d7-472d-49c5-b3c3-89298ae3be1d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:26.761677 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8dedee-adde-4cb6-976e-adbf29b6e6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:26.763068 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dedee-adde-4cb6-976e-adbf29b6e6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:26.763346 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dedee-adde-4cb6-976e-adbf29b6e6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:26.763620 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dedee-adde-4cb6-976e-adbf29b6e6d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:26.764459 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8dedee-adde-4cb6-976e-adbf29b6e6d4 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:26.764765 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8dedee-adde-4cb6-976e-adbf29b6e6d4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:26.766628 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8dedee-adde-4cb6-976e-adbf29b6e6d4 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:26.786874 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 613/1225] 10.222.0.36 () {56 vars in 1164 bytes} [Wed Dec 15 16:01:26 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:26.794353 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962c0d3-125d-4371-b540-c6b2e19d7b07 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:26.805214 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962c0d3-125d-4371-b540-c6b2e19d7b07 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:26.811499 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727f6d8-ff64-4271-93a1-b1928dbc0001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:26.812601 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727f6d8-ff64-4271-93a1-b1928dbc0001 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:26.813409 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727f6d8-ff64-4271-93a1-b1928dbc0001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:26.813847 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727f6d8-ff64-4271-93a1-b1928dbc0001 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:26.828382 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727f6d8-ff64-4271-93a1-b1928dbc0001 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:26.831138 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727f6d8-ff64-4271-93a1-b1928dbc0001 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:26.858036 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-3727f6d8-ff64-4271-93a1-b1928dbc0001 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:01:26.859721 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 613/1226] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 16:01:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:26.866539 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8dedee-adde-4cb6-976e-adbf29b6e6d4 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:26.881618 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8dedee-adde-4cb6-976e-adbf29b6e6d4 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:26.889103 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e20f5-3185-4359-8462-8bbcfe03675b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:26.889864 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e20f5-3185-4359-8462-8bbcfe03675b admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:26.890292 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e20f5-3185-4359-8462-8bbcfe03675b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:26.890641 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e20f5-3185-4359-8462-8bbcfe03675b admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:26.891498 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e20f5-3185-4359-8462-8bbcfe03675b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:26.892563 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e20f5-3185-4359-8462-8bbcfe03675b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:26.893513 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e20f5-3185-4359-8462-8bbcfe03675b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:26.906288 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 614/1227] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 16:01:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:26.913003 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727f6d8-ff64-4271-93a1-b1928dbc0001 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:26.924770 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727f6d8-ff64-4271-93a1-b1928dbc0001 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:26.930022 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776d927-9cfb-404e-a767-8098824d75bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:26.930970 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776d927-9cfb-404e-a767-8098824d75bb admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:26.931301 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776d927-9cfb-404e-a767-8098824d75bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:26.931596 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776d927-9cfb-404e-a767-8098824d75bb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:26.939784 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776d927-9cfb-404e-a767-8098824d75bb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:26.941957 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776d927-9cfb-404e-a767-8098824d75bb admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:26.956424 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-7776d927-9cfb-404e-a767-8098824d75bb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:01:26.957829 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 614/1228] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 16:01:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:01:26.967024 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e20f5-3185-4359-8462-8bbcfe03675b admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:26.977239 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e20f5-3185-4359-8462-8bbcfe03675b admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:26.983557 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e98d83-ad2a-4789-a7cd-1c1af559c79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:26.984287 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e98d83-ad2a-4789-a7cd-1c1af559c79c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:26.984639 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e98d83-ad2a-4789-a7cd-1c1af559c79c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:26.984984 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e98d83-ad2a-4789-a7cd-1c1af559c79c admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:26.985827 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e98d83-ad2a-4789-a7cd-1c1af559c79c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:26.986131 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e98d83-ad2a-4789-a7cd-1c1af559c79c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:26.988021 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e98d83-ad2a-4789-a7cd-1c1af559c79c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:27.002396 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 615/1229] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 16:01:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:27.008904 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776d927-9cfb-404e-a767-8098824d75bb admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:27.021004 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776d927-9cfb-404e-a767-8098824d75bb admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:27.028160 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a2bbd-f1ab-4690-8a6e-2d2077b5196a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:27.029371 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a2bbd-f1ab-4690-8a6e-2d2077b5196a admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:27.029975 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a2bbd-f1ab-4690-8a6e-2d2077b5196a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:27.030294 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a2bbd-f1ab-4690-8a6e-2d2077b5196a admin admin] PATH_INFO: `/v3/projects/bc314fbc91c54810b27f9fcad7129c64/users/e186d6728a2341399252238c559002f6/roles/17e6533ce814487c9a8fb0ee2acaad32` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:27.048344 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a2bbd-f1ab-4690-8a6e-2d2077b5196a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc314fbc91c54810b27f9fcad7129c64, user_id=e186d6728a2341399252238c559002f6, role_id=17e6533ce814487c9a8fb0ee2acaad32)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:27.051252 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a2bbd-f1ab-4690-8a6e-2d2077b5196a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:27.064585 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 615/1230] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Dec 15 16:01:27 2021] PUT /identity/v3/projects/bc314fbc91c54810b27f9fcad7129c64/users/e186d6728a2341399252238c559002f6/roles/17e6533ce814487c9a8fb0ee2acaad32 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:01:29.519237 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0611a3f-c2c0-4dbb-9568-d574c40d128e None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:29.519832 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0611a3f-c2c0-4dbb-9568-d574c40d128e None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:29.520078 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0611a3f-c2c0-4dbb-9568-d574c40d128e None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:29.521975 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 616/1231] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:01:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:01:29.531821 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc4acd-7726-40d6-a529-43b7ab1c19ac None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:29.532281 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc4acd-7726-40d6-a529-43b7ab1c19ac None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:29.532400 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc4acd-7726-40d6-a529-43b7ab1c19ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:29.550932 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-6abc4acd-7726-40d6-a529-43b7ab1c19ac None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:01:29.552277 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-6abc4acd-7726-40d6-a529-43b7ab1c19ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:01:29.614695 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 616/1232] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:01:29 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:01:29.641817 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0611a3f-c2c0-4dbb-9568-d574c40d128e None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:29.655093 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0611a3f-c2c0-4dbb-9568-d574c40d128e None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:29.659646 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d36695-71cf-42b4-be6f-79997258bfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:29.660424 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d36695-71cf-42b4-be6f-79997258bfbc admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:29.660709 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d36695-71cf-42b4-be6f-79997258bfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:29.661089 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d36695-71cf-42b4-be6f-79997258bfbc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:29.676599 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d36695-71cf-42b4-be6f-79997258bfbc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:01:29.683773 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-93d36695-71cf-42b4-be6f-79997258bfbc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 16:01:29.685517 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 617/1233] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Dec 15 16:01:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:01:29.693067 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc4acd-7726-40d6-a529-43b7ab1c19ac None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:29.706494 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc4acd-7726-40d6-a529-43b7ab1c19ac None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:29.712054 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94ee0a-48fc-455e-a8a4-4808281e856c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:29.712804 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94ee0a-48fc-455e-a8a4-4808281e856c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:29.713116 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94ee0a-48fc-455e-a8a4-4808281e856c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:29.713406 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94ee0a-48fc-455e-a8a4-4808281e856c admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:29.714315 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94ee0a-48fc-455e-a8a4-4808281e856c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:29.714654 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94ee0a-48fc-455e-a8a4-4808281e856c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:29.716676 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94ee0a-48fc-455e-a8a4-4808281e856c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:29.726683 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 617/1234] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Dec 15 16:01:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:29.733605 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d36695-71cf-42b4-be6f-79997258bfbc admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:29.744396 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d36695-71cf-42b4-be6f-79997258bfbc admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:29.750995 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16152d5b-5ec2-463b-ac33-fd6aedb01d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:29.752098 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16152d5b-5ec2-463b-ac33-fd6aedb01d2e admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:29.752601 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16152d5b-5ec2-463b-ac33-fd6aedb01d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:29.753136 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16152d5b-5ec2-463b-ac33-fd6aedb01d2e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:29.765147 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16152d5b-5ec2-463b-ac33-fd6aedb01d2e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:29.767354 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16152d5b-5ec2-463b-ac33-fd6aedb01d2e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:29.787429 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-16152d5b-5ec2-463b-ac33-fd6aedb01d2e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:01:29.789224 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 618/1235] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 16:01:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:29.797337 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94ee0a-48fc-455e-a8a4-4808281e856c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:29.807181 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94ee0a-48fc-455e-a8a4-4808281e856c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:29.813435 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5b174-07cb-42f4-8cf8-24d09393be97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:29.814088 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5b174-07cb-42f4-8cf8-24d09393be97 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:29.814366 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5b174-07cb-42f4-8cf8-24d09393be97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:29.814638 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5b174-07cb-42f4-8cf8-24d09393be97 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:29.815370 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5b174-07cb-42f4-8cf8-24d09393be97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:29.815706 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5b174-07cb-42f4-8cf8-24d09393be97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:29.817451 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5b174-07cb-42f4-8cf8-24d09393be97 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:29.830491 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 618/1236] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 16:01:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:01:29.838191 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16152d5b-5ec2-463b-ac33-fd6aedb01d2e admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:29.848968 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16152d5b-5ec2-463b-ac33-fd6aedb01d2e admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:29.854600 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f94b9e-7333-48ed-8faf-1ed3b3f56ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:29.856252 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f94b9e-7333-48ed-8faf-1ed3b3f56ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:29.856532 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f94b9e-7333-48ed-8faf-1ed3b3f56ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:29.856877 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f94b9e-7333-48ed-8faf-1ed3b3f56ba5 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:29.866589 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f94b9e-7333-48ed-8faf-1ed3b3f56ba5 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:29.869086 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f94b9e-7333-48ed-8faf-1ed3b3f56ba5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:29.884929 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-d2f94b9e-7333-48ed-8faf-1ed3b3f56ba5 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 16:01:29.886221 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 619/1237] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 16:01:29 2021] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:29.893341 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5b174-07cb-42f4-8cf8-24d09393be97 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:29.902925 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5b174-07cb-42f4-8cf8-24d09393be97 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:29.908850 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e88470-70be-4d0d-9228-0efc50f9badb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:29.909914 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e88470-70be-4d0d-9228-0efc50f9badb admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:29.910332 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e88470-70be-4d0d-9228-0efc50f9badb admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:29.910617 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e88470-70be-4d0d-9228-0efc50f9badb admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:29.911876 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e88470-70be-4d0d-9228-0efc50f9badb admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:29.912200 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e88470-70be-4d0d-9228-0efc50f9badb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:29.914985 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e88470-70be-4d0d-9228-0efc50f9badb admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:29.938426 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 619/1238] 10.222.0.36 () {56 vars in 1164 bytes} [Wed Dec 15 16:01:29 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:29.946044 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f94b9e-7333-48ed-8faf-1ed3b3f56ba5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:29.958404 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f94b9e-7333-48ed-8faf-1ed3b3f56ba5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:29.963111 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422278c1-f916-4a0e-89fd-b365f9b50945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:29.963844 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422278c1-f916-4a0e-89fd-b365f9b50945 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:29.964151 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422278c1-f916-4a0e-89fd-b365f9b50945 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:29.964569 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422278c1-f916-4a0e-89fd-b365f9b50945 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:29.973935 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422278c1-f916-4a0e-89fd-b365f9b50945 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:29.976042 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422278c1-f916-4a0e-89fd-b365f9b50945 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:29.986827 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 620/1239] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 16:01:29 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:01:29.994105 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e88470-70be-4d0d-9228-0efc50f9badb admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:30.006090 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e88470-70be-4d0d-9228-0efc50f9badb admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:30.010741 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a823653-097f-4c93-99a6-193b827901aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:30.011515 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a823653-097f-4c93-99a6-193b827901aa admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:30.011829 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a823653-097f-4c93-99a6-193b827901aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:30.012213 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a823653-097f-4c93-99a6-193b827901aa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:30.024022 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a823653-097f-4c93-99a6-193b827901aa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:30.026108 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a823653-097f-4c93-99a6-193b827901aa admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:30.050998 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-7a823653-097f-4c93-99a6-193b827901aa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:01:30.053255 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 620/1240] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 16:01:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:30.062749 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422278c1-f916-4a0e-89fd-b365f9b50945 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:30.073623 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422278c1-f916-4a0e-89fd-b365f9b50945 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:30.082576 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85229c-fb2d-4b21-ac6c-f236d9d7fb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:30.083270 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85229c-fb2d-4b21-ac6c-f236d9d7fb04 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:30.083553 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85229c-fb2d-4b21-ac6c-f236d9d7fb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:30.083831 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85229c-fb2d-4b21-ac6c-f236d9d7fb04 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:30.084592 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85229c-fb2d-4b21-ac6c-f236d9d7fb04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:30.085557 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85229c-fb2d-4b21-ac6c-f236d9d7fb04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:30.087233 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85229c-fb2d-4b21-ac6c-f236d9d7fb04 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:30.101793 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 621/1241] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 16:01:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:30.109141 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a823653-097f-4c93-99a6-193b827901aa admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:30.120799 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a823653-097f-4c93-99a6-193b827901aa admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:30.126236 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3282993-fe4a-4f3f-806d-54ec7eefd455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:30.127215 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3282993-fe4a-4f3f-806d-54ec7eefd455 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:30.127498 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3282993-fe4a-4f3f-806d-54ec7eefd455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:30.127878 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3282993-fe4a-4f3f-806d-54ec7eefd455 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:30.135886 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3282993-fe4a-4f3f-806d-54ec7eefd455 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:30.138727 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3282993-fe4a-4f3f-806d-54ec7eefd455 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:30.152921 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-b3282993-fe4a-4f3f-806d-54ec7eefd455 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:01:30.154468 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 621/1242] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 16:01:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:30.161166 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85229c-fb2d-4b21-ac6c-f236d9d7fb04 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:30.171711 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85229c-fb2d-4b21-ac6c-f236d9d7fb04 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:30.177101 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81883020-44f3-42db-9304-104a60905b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:30.177782 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81883020-44f3-42db-9304-104a60905b71 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:30.178063 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81883020-44f3-42db-9304-104a60905b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:30.178337 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81883020-44f3-42db-9304-104a60905b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:30.179123 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81883020-44f3-42db-9304-104a60905b71 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:30.179427 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81883020-44f3-42db-9304-104a60905b71 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:30.181263 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81883020-44f3-42db-9304-104a60905b71 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:30.195137 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 622/1243] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 16:01:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:01:30.202476 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3282993-fe4a-4f3f-806d-54ec7eefd455 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:30.212766 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3282993-fe4a-4f3f-806d-54ec7eefd455 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:30.217575 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec93562-6c22-4dba-b6e8-78bfcb3425c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:30.218199 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec93562-6c22-4dba-b6e8-78bfcb3425c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:30.218498 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec93562-6c22-4dba-b6e8-78bfcb3425c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:30.218760 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec93562-6c22-4dba-b6e8-78bfcb3425c7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:30.219592 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec93562-6c22-4dba-b6e8-78bfcb3425c7 admin admin] RBAC: Adding query filter params (role.id=17e6533ce814487c9a8fb0ee2acaad32, scope.project.id=bc314fbc91c54810b27f9fcad7129c64, user.id=e186d6728a2341399252238c559002f6) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:30.219981 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec93562-6c22-4dba-b6e8-78bfcb3425c7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:30.221763 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec93562-6c22-4dba-b6e8-78bfcb3425c7 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:30.227946 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 622/1244] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 16:01:30 2021] GET /identity/v3/role_assignments?user.id=e186d6728a2341399252238c559002f6&scope.project.id=bc314fbc91c54810b27f9fcad7129c64&role.id=17e6533ce814487c9a8fb0ee2acaad32 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:01:32.976761 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51e1c0-9fae-4b3c-8eec-d0751d8ca54e None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:32.977293 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51e1c0-9fae-4b3c-8eec-d0751d8ca54e None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:32.977293 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51e1c0-9fae-4b3c-8eec-d0751d8ca54e None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:32.979099 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 623/1245] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:01:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:01:32.986017 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe188112-7ed4-41ca-932b-5b9cb53aa03f None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:32.986494 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe188112-7ed4-41ca-932b-5b9cb53aa03f None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:32.986589 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe188112-7ed4-41ca-932b-5b9cb53aa03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:33.005479 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-fe188112-7ed4-41ca-932b-5b9cb53aa03f None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:01:33.006742 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-fe188112-7ed4-41ca-932b-5b9cb53aa03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:01:33.015494 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 623/1246] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:01:32 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:01:33.042163 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51e1c0-9fae-4b3c-8eec-d0751d8ca54e None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:33.055898 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51e1c0-9fae-4b3c-8eec-d0751d8ca54e None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:33.061800 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec497a-c6a3-4a1f-ae27-422b5424a2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:33.062601 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec497a-c6a3-4a1f-ae27-422b5424a2bb admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:33.062924 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec497a-c6a3-4a1f-ae27-422b5424a2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:33.063200 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec497a-c6a3-4a1f-ae27-422b5424a2bb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:33.074991 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec497a-c6a3-4a1f-ae27-422b5424a2bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:01:33.082618 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-49ec497a-c6a3-4a1f-ae27-422b5424a2bb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:01:33.083966 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 624/1247] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 16:01:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:33.090661 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe188112-7ed4-41ca-932b-5b9cb53aa03f None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:33.099995 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe188112-7ed4-41ca-932b-5b9cb53aa03f None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:33.104837 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f37c3-97d1-4962-8b07-28034d13368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:33.105538 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f37c3-97d1-4962-8b07-28034d13368a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:33.105836 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f37c3-97d1-4962-8b07-28034d13368a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:33.106106 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f37c3-97d1-4962-8b07-28034d13368a admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:33.106985 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f37c3-97d1-4962-8b07-28034d13368a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:33.107294 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f37c3-97d1-4962-8b07-28034d13368a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:33.108902 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f37c3-97d1-4962-8b07-28034d13368a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:33.124298 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 624/1248] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 16:01:33 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:01:33.125555 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec497a-c6a3-4a1f-ae27-422b5424a2bb admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:33.136473 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec497a-c6a3-4a1f-ae27-422b5424a2bb admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:33.141985 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b8590-e29d-4ca4-ac48-2118996086a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:33.142807 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b8590-e29d-4ca4-ac48-2118996086a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:33.143132 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b8590-e29d-4ca4-ac48-2118996086a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:33.143474 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b8590-e29d-4ca4-ac48-2118996086a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:33.159533 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b8590-e29d-4ca4-ac48-2118996086a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:33.159533 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b8590-e29d-4ca4-ac48-2118996086a8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:33.177131 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-e08b8590-e29d-4ca4-ac48-2118996086a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:01:33.178331 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 625/1249] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 16:01:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:33.185553 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f37c3-97d1-4962-8b07-28034d13368a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:33.195535 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f37c3-97d1-4962-8b07-28034d13368a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:33.203156 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e525e37-9989-44e1-b59c-7f4cc9f46644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:33.203907 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e525e37-9989-44e1-b59c-7f4cc9f46644 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:33.204189 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e525e37-9989-44e1-b59c-7f4cc9f46644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:33.204463 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e525e37-9989-44e1-b59c-7f4cc9f46644 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:33.205204 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e525e37-9989-44e1-b59c-7f4cc9f46644 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:33.205540 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e525e37-9989-44e1-b59c-7f4cc9f46644 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:33.207254 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e525e37-9989-44e1-b59c-7f4cc9f46644 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:33.221441 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 625/1250] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 16:01:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:33.228345 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b8590-e29d-4ca4-ac48-2118996086a8 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:33.240430 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b8590-e29d-4ca4-ac48-2118996086a8 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:33.245547 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc3a9a-e1c1-4a2b-9a8d-0650a7e21cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:33.247856 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc3a9a-e1c1-4a2b-9a8d-0650a7e21cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:33.248159 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc3a9a-e1c1-4a2b-9a8d-0650a7e21cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:33.248498 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc3a9a-e1c1-4a2b-9a8d-0650a7e21cd7 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:33.256506 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc3a9a-e1c1-4a2b-9a8d-0650a7e21cd7 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:33.258688 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc3a9a-e1c1-4a2b-9a8d-0650a7e21cd7 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:33.274464 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-3afc3a9a-e1c1-4a2b-9a8d-0650a7e21cd7 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 16:01:33.275751 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 626/1251] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 16:01:33 2021] GET /identity/v3/users/placement => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:33.283188 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e525e37-9989-44e1-b59c-7f4cc9f46644 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:33.294337 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e525e37-9989-44e1-b59c-7f4cc9f46644 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:33.299258 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c04d4-f3f2-4824-9a44-41f160363a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:33.299927 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c04d4-f3f2-4824-9a44-41f160363a79 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:33.300207 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c04d4-f3f2-4824-9a44-41f160363a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:33.300477 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c04d4-f3f2-4824-9a44-41f160363a79 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:33.301323 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c04d4-f3f2-4824-9a44-41f160363a79 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:33.301661 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c04d4-f3f2-4824-9a44-41f160363a79 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:33.303617 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c04d4-f3f2-4824-9a44-41f160363a79 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:33.327901 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 626/1252] 10.222.0.36 () {56 vars in 1164 bytes} [Wed Dec 15 16:01:33 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:01:33.335719 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc3a9a-e1c1-4a2b-9a8d-0650a7e21cd7 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:33.348099 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc3a9a-e1c1-4a2b-9a8d-0650a7e21cd7 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:33.353212 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c66b60-b2e7-4f91-b4cb-10b400635ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:33.353930 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c66b60-b2e7-4f91-b4cb-10b400635ebc admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:33.354265 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c66b60-b2e7-4f91-b4cb-10b400635ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:33.354483 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c66b60-b2e7-4f91-b4cb-10b400635ebc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:33.363245 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c66b60-b2e7-4f91-b4cb-10b400635ebc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:33.365051 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c66b60-b2e7-4f91-b4cb-10b400635ebc admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:33.375327 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 627/1253] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 16:01:33 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:01:33.382001 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c04d4-f3f2-4824-9a44-41f160363a79 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:33.393926 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c04d4-f3f2-4824-9a44-41f160363a79 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:33.398905 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2912a35-9b5c-4d04-a6c8-00a28c8adcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:33.399749 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2912a35-9b5c-4d04-a6c8-00a28c8adcf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:33.400033 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2912a35-9b5c-4d04-a6c8-00a28c8adcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:33.400337 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2912a35-9b5c-4d04-a6c8-00a28c8adcf4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:33.412420 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2912a35-9b5c-4d04-a6c8-00a28c8adcf4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:33.414492 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2912a35-9b5c-4d04-a6c8-00a28c8adcf4 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:33.435180 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-b2912a35-9b5c-4d04-a6c8-00a28c8adcf4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:01:33.436525 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 627/1254] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 16:01:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:33.444016 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c66b60-b2e7-4f91-b4cb-10b400635ebc admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:33.453687 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c66b60-b2e7-4f91-b4cb-10b400635ebc admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:33.458957 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff3021-b6ab-4930-a7c2-955d2ec1362c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:33.459604 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff3021-b6ab-4930-a7c2-955d2ec1362c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:33.459873 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff3021-b6ab-4930-a7c2-955d2ec1362c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:33.460150 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff3021-b6ab-4930-a7c2-955d2ec1362c admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:33.460882 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff3021-b6ab-4930-a7c2-955d2ec1362c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:33.461190 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff3021-b6ab-4930-a7c2-955d2ec1362c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:33.462852 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff3021-b6ab-4930-a7c2-955d2ec1362c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:33.474792 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 628/1255] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 16:01:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:33.483129 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2912a35-9b5c-4d04-a6c8-00a28c8adcf4 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:33.494461 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2912a35-9b5c-4d04-a6c8-00a28c8adcf4 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:33.499637 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95de9e8-3b71-424e-b428-3c0eed887e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:33.500411 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95de9e8-3b71-424e-b428-3c0eed887e80 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:33.500825 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95de9e8-3b71-424e-b428-3c0eed887e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:33.501127 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95de9e8-3b71-424e-b428-3c0eed887e80 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:33.508565 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95de9e8-3b71-424e-b428-3c0eed887e80 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:33.510711 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95de9e8-3b71-424e-b428-3c0eed887e80 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:33.526016 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-c95de9e8-3b71-424e-b428-3c0eed887e80 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:01:33.527455 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 628/1256] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 16:01:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:01:33.535578 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff3021-b6ab-4930-a7c2-955d2ec1362c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:33.547843 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff3021-b6ab-4930-a7c2-955d2ec1362c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:33.553275 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693ccbe-6ec4-4a07-950e-7e806e465d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:33.553944 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693ccbe-6ec4-4a07-950e-7e806e465d75 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:33.554224 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693ccbe-6ec4-4a07-950e-7e806e465d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:33.554495 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693ccbe-6ec4-4a07-950e-7e806e465d75 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:33.555284 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693ccbe-6ec4-4a07-950e-7e806e465d75 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:33.555596 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693ccbe-6ec4-4a07-950e-7e806e465d75 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:33.557668 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693ccbe-6ec4-4a07-950e-7e806e465d75 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:33.573413 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 629/1257] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 16:01:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:33.580397 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95de9e8-3b71-424e-b428-3c0eed887e80 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:33.591664 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95de9e8-3b71-424e-b428-3c0eed887e80 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:33.596604 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56929a-322b-4814-abe2-08530a1f1505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:33.597325 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56929a-322b-4814-abe2-08530a1f1505 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:33.597639 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56929a-322b-4814-abe2-08530a1f1505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:33.597913 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56929a-322b-4814-abe2-08530a1f1505 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:33.598861 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef56929a-322b-4814-abe2-08530a1f1505 admin admin] RBAC: Adding query filter params (role.id=bc362f875c6d4cee83ba65b8d134462d, scope.project.id=bc314fbc91c54810b27f9fcad7129c64, user.id=e186d6728a2341399252238c559002f6) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:33.599214 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef56929a-322b-4814-abe2-08530a1f1505 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:33.601273 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef56929a-322b-4814-abe2-08530a1f1505 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:33.608266 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 629/1258] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 16:01:33 2021] GET /identity/v3/role_assignments?user.id=e186d6728a2341399252238c559002f6&scope.project.id=bc314fbc91c54810b27f9fcad7129c64&role.id=bc362f875c6d4cee83ba65b8d134462d => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:36.129551 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e50a28-93d0-45f4-9736-53e151760d63 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:36.130137 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e50a28-93d0-45f4-9736-53e151760d63 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:36.130243 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e50a28-93d0-45f4-9736-53e151760d63 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:36.132291 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 630/1259] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:01:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:01:36.139036 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad109c3e-6e09-4900-8b20-1b3b00520f1c None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:36.139603 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad109c3e-6e09-4900-8b20-1b3b00520f1c None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:36.139603 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad109c3e-6e09-4900-8b20-1b3b00520f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:36.159279 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-ad109c3e-6e09-4900-8b20-1b3b00520f1c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:01:36.160700 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-ad109c3e-6e09-4900-8b20-1b3b00520f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:01:36.169854 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 630/1260] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:01:36 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:01:36.195184 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e50a28-93d0-45f4-9736-53e151760d63 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:36.208889 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e50a28-93d0-45f4-9736-53e151760d63 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:36.213282 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a477a-74f6-4e13-ae40-60ec42a320c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:36.214084 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a477a-74f6-4e13-ae40-60ec42a320c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:36.214372 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a477a-74f6-4e13-ae40-60ec42a320c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:36.214655 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a477a-74f6-4e13-ae40-60ec42a320c7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:36.225412 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a477a-74f6-4e13-ae40-60ec42a320c7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:01:36.232660 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-195a477a-74f6-4e13-ae40-60ec42a320c7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:01:36.233921 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 631/1261] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 16:01:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:36.240776 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad109c3e-6e09-4900-8b20-1b3b00520f1c None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:36.251356 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad109c3e-6e09-4900-8b20-1b3b00520f1c None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:36.256354 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d42eb-25cd-4aa5-aae3-7c78fc248141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:36.257066 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d42eb-25cd-4aa5-aae3-7c78fc248141 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:36.257363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d42eb-25cd-4aa5-aae3-7c78fc248141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:36.257669 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d42eb-25cd-4aa5-aae3-7c78fc248141 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:36.258564 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d42eb-25cd-4aa5-aae3-7c78fc248141 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:36.258931 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d42eb-25cd-4aa5-aae3-7c78fc248141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:36.260680 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d42eb-25cd-4aa5-aae3-7c78fc248141 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:36.271862 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 631/1262] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 16:01:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:36.279137 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a477a-74f6-4e13-ae40-60ec42a320c7 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:36.289878 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a477a-74f6-4e13-ae40-60ec42a320c7 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:36.295121 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611db80-e8ad-4d5d-a8d6-70e8be1218d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:36.295774 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611db80-e8ad-4d5d-a8d6-70e8be1218d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:36.296056 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611db80-e8ad-4d5d-a8d6-70e8be1218d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:36.296338 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611db80-e8ad-4d5d-a8d6-70e8be1218d5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:36.307251 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611db80-e8ad-4d5d-a8d6-70e8be1218d5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:36.310070 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611db80-e8ad-4d5d-a8d6-70e8be1218d5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:36.329656 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-4611db80-e8ad-4d5d-a8d6-70e8be1218d5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:01:36.330923 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 632/1263] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 16:01:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:01:36.337266 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d42eb-25cd-4aa5-aae3-7c78fc248141 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:36.347319 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d42eb-25cd-4aa5-aae3-7c78fc248141 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:36.352577 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83184fc-4a3a-4f0a-8764-906826df6fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:36.353252 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83184fc-4a3a-4f0a-8764-906826df6fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:36.353577 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83184fc-4a3a-4f0a-8764-906826df6fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:36.353867 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83184fc-4a3a-4f0a-8764-906826df6fb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:36.354674 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83184fc-4a3a-4f0a-8764-906826df6fb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:36.354982 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83184fc-4a3a-4f0a-8764-906826df6fb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:36.356752 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83184fc-4a3a-4f0a-8764-906826df6fb6 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:36.369209 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 632/1264] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 16:01:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:36.375980 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611db80-e8ad-4d5d-a8d6-70e8be1218d5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:36.385795 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611db80-e8ad-4d5d-a8d6-70e8be1218d5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:36.391248 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baec110-d80d-434c-b94f-2f1f7dd9c1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:36.392038 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baec110-d80d-434c-b94f-2f1f7dd9c1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:36.392323 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baec110-d80d-434c-b94f-2f1f7dd9c1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:36.392600 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baec110-d80d-434c-b94f-2f1f7dd9c1b8 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:36.400123 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baec110-d80d-434c-b94f-2f1f7dd9c1b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:36.402153 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baec110-d80d-434c-b94f-2f1f7dd9c1b8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:36.416847 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-6baec110-d80d-434c-b94f-2f1f7dd9c1b8 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 16:01:36.418666 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 633/1265] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 16:01:36 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:01:36.425099 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83184fc-4a3a-4f0a-8764-906826df6fb6 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:36.436749 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83184fc-4a3a-4f0a-8764-906826df6fb6 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:36.441594 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bdee8-c2a0-4ac3-a26c-55a26bb826e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:36.442262 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bdee8-c2a0-4ac3-a26c-55a26bb826e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:36.442540 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bdee8-c2a0-4ac3-a26c-55a26bb826e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:36.442809 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bdee8-c2a0-4ac3-a26c-55a26bb826e7 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:36.443641 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827bdee8-c2a0-4ac3-a26c-55a26bb826e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:36.443942 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827bdee8-c2a0-4ac3-a26c-55a26bb826e7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:36.445835 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827bdee8-c2a0-4ac3-a26c-55a26bb826e7 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:36.464285 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 633/1266] 10.222.0.36 () {56 vars in 1164 bytes} [Wed Dec 15 16:01:36 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:36.470628 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baec110-d80d-434c-b94f-2f1f7dd9c1b8 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:36.480394 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baec110-d80d-434c-b94f-2f1f7dd9c1b8 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:36.485499 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a87ec-711f-4e03-a37a-a0c0567fe1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:36.486380 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a87ec-711f-4e03-a37a-a0c0567fe1be admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:36.486665 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a87ec-711f-4e03-a37a-a0c0567fe1be admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:36.487112 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a87ec-711f-4e03-a37a-a0c0567fe1be admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:36.499141 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a87ec-711f-4e03-a37a-a0c0567fe1be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:36.501079 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a87ec-711f-4e03-a37a-a0c0567fe1be admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:36.518614 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-1e9a87ec-711f-4e03-a37a-a0c0567fe1be admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:01:36.519856 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 634/1267] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 16:01:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:36.526111 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bdee8-c2a0-4ac3-a26c-55a26bb826e7 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:36.536639 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bdee8-c2a0-4ac3-a26c-55a26bb826e7 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:36.541279 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca9fee-ee38-4927-9735-c8aab795ad1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:36.541933 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca9fee-ee38-4927-9735-c8aab795ad1d admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:36.542234 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca9fee-ee38-4927-9735-c8aab795ad1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:36.542493 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca9fee-ee38-4927-9735-c8aab795ad1d admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:36.543843 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca9fee-ee38-4927-9735-c8aab795ad1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:36.544385 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca9fee-ee38-4927-9735-c8aab795ad1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:36.546098 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca9fee-ee38-4927-9735-c8aab795ad1d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:36.557853 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 634/1268] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 16:01:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:01:36.565207 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a87ec-711f-4e03-a37a-a0c0567fe1be admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:36.575675 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a87ec-711f-4e03-a37a-a0c0567fe1be admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:36.581029 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60251f52-bdf0-4a52-8986-d20ba02a2c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:36.582051 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60251f52-bdf0-4a52-8986-d20ba02a2c99 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:36.582366 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60251f52-bdf0-4a52-8986-d20ba02a2c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:36.582727 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60251f52-bdf0-4a52-8986-d20ba02a2c99 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:36.590349 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60251f52-bdf0-4a52-8986-d20ba02a2c99 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:36.592381 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60251f52-bdf0-4a52-8986-d20ba02a2c99 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:36.606077 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-60251f52-bdf0-4a52-8986-d20ba02a2c99 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:01:36.608524 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 635/1269] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 16:01:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:36.613972 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca9fee-ee38-4927-9735-c8aab795ad1d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:36.624906 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca9fee-ee38-4927-9735-c8aab795ad1d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:36.629921 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f45ec-580d-494d-b795-dc3a46e32ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:36.630668 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f45ec-580d-494d-b795-dc3a46e32ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:36.631011 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f45ec-580d-494d-b795-dc3a46e32ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:36.631230 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f45ec-580d-494d-b795-dc3a46e32ca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:36.632139 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f45ec-580d-494d-b795-dc3a46e32ca8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:36.632450 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f45ec-580d-494d-b795-dc3a46e32ca8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:36.634307 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f45ec-580d-494d-b795-dc3a46e32ca8 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:36.652429 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 635/1270] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 16:01:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:01:36.653944 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60251f52-bdf0-4a52-8986-d20ba02a2c99 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:36.666017 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60251f52-bdf0-4a52-8986-d20ba02a2c99 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:36.671884 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35dd02-c5f9-4563-94a9-32df23f61b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:36.672909 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35dd02-c5f9-4563-94a9-32df23f61b0f admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:36.673272 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35dd02-c5f9-4563-94a9-32df23f61b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:36.673583 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35dd02-c5f9-4563-94a9-32df23f61b0f admin admin] PATH_INFO: `/v3/projects/bc314fbc91c54810b27f9fcad7129c64/users/e186d6728a2341399252238c559002f6/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:36.675972 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35dd02-c5f9-4563-94a9-32df23f61b0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc314fbc91c54810b27f9fcad7129c64, user_id=e186d6728a2341399252238c559002f6, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:36.678927 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35dd02-c5f9-4563-94a9-32df23f61b0f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:36.695145 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 636/1271] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Dec 15 16:01:36 2021] PUT /identity/v3/projects/bc314fbc91c54810b27f9fcad7129c64/users/e186d6728a2341399252238c559002f6/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:01:39.026695 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8326a4-a8b8-415c-9ed0-fa807e9ca157 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:39.027255 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8326a4-a8b8-415c-9ed0-fa807e9ca157 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:39.027255 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8326a4-a8b8-415c-9ed0-fa807e9ca157 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:39.029733 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 636/1272] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:01:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:01:39.035720 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ed709-1bec-4a6c-938d-e8b9a7a203c6 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:39.036114 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ed709-1bec-4a6c-938d-e8b9a7a203c6 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:39.036264 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ed709-1bec-4a6c-938d-e8b9a7a203c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:39.053182 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-476ed709-1bec-4a6c-938d-e8b9a7a203c6 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:01:39.054396 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-476ed709-1bec-4a6c-938d-e8b9a7a203c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:01:39.109892 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 637/1273] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:01:39 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:01:39.134587 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8326a4-a8b8-415c-9ed0-fa807e9ca157 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:39.147689 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8326a4-a8b8-415c-9ed0-fa807e9ca157 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:39.152029 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e6ef0-5903-4fcf-9b6f-fbbc72d4d623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:39.152828 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e6ef0-5903-4fcf-9b6f-fbbc72d4d623 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:39.153105 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e6ef0-5903-4fcf-9b6f-fbbc72d4d623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:39.153375 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e6ef0-5903-4fcf-9b6f-fbbc72d4d623 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:39.163424 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e6ef0-5903-4fcf-9b6f-fbbc72d4d623 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 16:01:39.170111 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-067e6ef0-5903-4fcf-9b6f-fbbc72d4d623 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 16:01:39.171237 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 637/1274] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Dec 15 16:01:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:39.177589 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ed709-1bec-4a6c-938d-e8b9a7a203c6 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:39.187064 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ed709-1bec-4a6c-938d-e8b9a7a203c6 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:39.191782 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513df32-97b9-4c57-bf7b-f1aa929f5184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:39.192426 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513df32-97b9-4c57-bf7b-f1aa929f5184 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:39.192705 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513df32-97b9-4c57-bf7b-f1aa929f5184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:39.192978 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513df32-97b9-4c57-bf7b-f1aa929f5184 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:39.193770 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513df32-97b9-4c57-bf7b-f1aa929f5184 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:39.194077 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513df32-97b9-4c57-bf7b-f1aa929f5184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:39.195675 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513df32-97b9-4c57-bf7b-f1aa929f5184 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:39.204299 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 638/1275] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Dec 15 16:01:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:39.210271 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e6ef0-5903-4fcf-9b6f-fbbc72d4d623 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:39.220394 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e6ef0-5903-4fcf-9b6f-fbbc72d4d623 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:39.224885 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6a124-93aa-4e64-8d5a-9479fb96337e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:39.225668 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6a124-93aa-4e64-8d5a-9479fb96337e admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:39.225952 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6a124-93aa-4e64-8d5a-9479fb96337e admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:39.226226 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6a124-93aa-4e64-8d5a-9479fb96337e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:39.236263 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6a124-93aa-4e64-8d5a-9479fb96337e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:39.238264 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6a124-93aa-4e64-8d5a-9479fb96337e admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:39.255067 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-c9f6a124-93aa-4e64-8d5a-9479fb96337e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:01:39.256182 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 638/1276] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 16:01:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:39.262600 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513df32-97b9-4c57-bf7b-f1aa929f5184 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:39.271998 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513df32-97b9-4c57-bf7b-f1aa929f5184 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:39.276458 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe954e-e4c2-436a-8b1f-dbf7570331c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:39.277137 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe954e-e4c2-436a-8b1f-dbf7570331c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:39.277369 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe954e-e4c2-436a-8b1f-dbf7570331c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:39.277701 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe954e-e4c2-436a-8b1f-dbf7570331c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:39.278420 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe954e-e4c2-436a-8b1f-dbf7570331c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:39.278725 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe954e-e4c2-436a-8b1f-dbf7570331c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:39.280557 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe954e-e4c2-436a-8b1f-dbf7570331c6 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:39.291843 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 639/1277] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 16:01:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:39.297443 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6a124-93aa-4e64-8d5a-9479fb96337e admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:39.306592 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6a124-93aa-4e64-8d5a-9479fb96337e admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:39.311503 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69260943-a4a8-43ae-be33-a2a8663da53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:39.312253 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69260943-a4a8-43ae-be33-a2a8663da53d admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:39.312534 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69260943-a4a8-43ae-be33-a2a8663da53d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:39.312804 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69260943-a4a8-43ae-be33-a2a8663da53d admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:39.319772 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69260943-a4a8-43ae-be33-a2a8663da53d admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:39.321777 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69260943-a4a8-43ae-be33-a2a8663da53d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:39.335859 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-69260943-a4a8-43ae-be33-a2a8663da53d admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 16:01:39.336972 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 639/1278] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 16:01:39 2021] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:39.343163 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe954e-e4c2-436a-8b1f-dbf7570331c6 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:39.352702 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe954e-e4c2-436a-8b1f-dbf7570331c6 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:39.357662 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05278ea2-64e6-41c4-8eb5-ad9ca553c77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:39.358301 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05278ea2-64e6-41c4-8eb5-ad9ca553c77c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:39.358581 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05278ea2-64e6-41c4-8eb5-ad9ca553c77c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:39.358853 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05278ea2-64e6-41c4-8eb5-ad9ca553c77c admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:39.359681 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05278ea2-64e6-41c4-8eb5-ad9ca553c77c admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:39.359986 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05278ea2-64e6-41c4-8eb5-ad9ca553c77c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:39.361850 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05278ea2-64e6-41c4-8eb5-ad9ca553c77c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:39.379149 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 640/1279] 10.222.0.36 () {56 vars in 1164 bytes} [Wed Dec 15 16:01:39 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:39.385635 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69260943-a4a8-43ae-be33-a2a8663da53d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:39.396133 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69260943-a4a8-43ae-be33-a2a8663da53d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:39.400664 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cab0b-6a90-410a-a9e1-5561f6f6a127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:39.401284 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cab0b-6a90-410a-a9e1-5561f6f6a127 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:39.401600 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cab0b-6a90-410a-a9e1-5561f6f6a127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:39.401878 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cab0b-6a90-410a-a9e1-5561f6f6a127 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:39.410020 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38cab0b-6a90-410a-a9e1-5561f6f6a127 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:39.411797 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38cab0b-6a90-410a-a9e1-5561f6f6a127 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:39.421182 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 640/1280] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Dec 15 16:01:39 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:01:39.426984 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05278ea2-64e6-41c4-8eb5-ad9ca553c77c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:39.436821 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05278ea2-64e6-41c4-8eb5-ad9ca553c77c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:39.441268 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5d23f-91f3-4b51-a1fc-f641354c61e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:39.442048 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5d23f-91f3-4b51-a1fc-f641354c61e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:39.442330 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5d23f-91f3-4b51-a1fc-f641354c61e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:39.442604 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5d23f-91f3-4b51-a1fc-f641354c61e2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:39.452512 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5d23f-91f3-4b51-a1fc-f641354c61e2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:39.454496 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5d23f-91f3-4b51-a1fc-f641354c61e2 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:39.470670 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-3fe5d23f-91f3-4b51-a1fc-f641354c61e2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 16:01:39.471813 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 641/1281] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Dec 15 16:01:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:39.482655 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cab0b-6a90-410a-a9e1-5561f6f6a127 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:39.491543 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cab0b-6a90-410a-a9e1-5561f6f6a127 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:39.496127 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179385d-d6ab-48ed-9448-ec5b519473e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:39.497737 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179385d-d6ab-48ed-9448-ec5b519473e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:39.498026 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179385d-d6ab-48ed-9448-ec5b519473e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:39.498305 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179385d-d6ab-48ed-9448-ec5b519473e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:39.499036 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179385d-d6ab-48ed-9448-ec5b519473e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:39.499346 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179385d-d6ab-48ed-9448-ec5b519473e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:39.500922 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179385d-d6ab-48ed-9448-ec5b519473e8 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:39.512038 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 641/1282] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Dec 15 16:01:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:39.517829 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5d23f-91f3-4b51-a1fc-f641354c61e2 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:39.527285 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5d23f-91f3-4b51-a1fc-f641354c61e2 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:39.532263 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f449df-c287-42f9-8f94-33bb2a310472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:39.533027 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f449df-c287-42f9-8f94-33bb2a310472 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:39.533307 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f449df-c287-42f9-8f94-33bb2a310472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:39.533613 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f449df-c287-42f9-8f94-33bb2a310472 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:39.540348 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f449df-c287-42f9-8f94-33bb2a310472 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:39.542321 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f449df-c287-42f9-8f94-33bb2a310472 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:39.555317 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING keystone.server.flask.application [None req-67f449df-c287-42f9-8f94-33bb2a310472 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 16:01:39.556412 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 642/1283] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Dec 15 16:01:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:39.563073 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179385d-d6ab-48ed-9448-ec5b519473e8 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:39.572406 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179385d-d6ab-48ed-9448-ec5b519473e8 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:39.577122 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11a221-95e3-4d1a-99a0-f6ba20c82be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:39.577784 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11a221-95e3-4d1a-99a0-f6ba20c82be3 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:39.578043 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11a221-95e3-4d1a-99a0-f6ba20c82be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:39.578314 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11a221-95e3-4d1a-99a0-f6ba20c82be3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:39.579124 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11a221-95e3-4d1a-99a0-f6ba20c82be3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:39.579401 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11a221-95e3-4d1a-99a0-f6ba20c82be3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:39.581211 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11a221-95e3-4d1a-99a0-f6ba20c82be3 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:39.592889 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 642/1284] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Dec 15 16:01:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:39.599007 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f449df-c287-42f9-8f94-33bb2a310472 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:39.609338 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f449df-c287-42f9-8f94-33bb2a310472 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:39.613751 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8c205-2bcc-431e-bc52-1e7e9df84879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:39.614360 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8c205-2bcc-431e-bc52-1e7e9df84879 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:39.614638 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8c205-2bcc-431e-bc52-1e7e9df84879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:39.614908 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8c205-2bcc-431e-bc52-1e7e9df84879 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:39.615727 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8c205-2bcc-431e-bc52-1e7e9df84879 admin admin] RBAC: Adding query filter params (role.id=bc362f875c6d4cee83ba65b8d134462d, scope.project.id=bc314fbc91c54810b27f9fcad7129c64, user.id=e186d6728a2341399252238c559002f6) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:39.616033 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8c205-2bcc-431e-bc52-1e7e9df84879 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:39.617854 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8c205-2bcc-431e-bc52-1e7e9df84879 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:39.624093 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 643/1285] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Dec 15 16:01:39 2021] GET /identity/v3/role_assignments?user.id=e186d6728a2341399252238c559002f6&scope.project.id=bc314fbc91c54810b27f9fcad7129c64&role.id=bc362f875c6d4cee83ba65b8d134462d => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:01:42.045406 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedc215-5fca-462c-bfe8-b60865396fd6 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:42.045794 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedc215-5fca-462c-bfe8-b60865396fd6 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:42.045952 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedc215-5fca-462c-bfe8-b60865396fd6 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:42.047697 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 643/1286] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:01:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:01:42.053290 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52fc17-a69e-4f13-8fc0-2557e8bc7cbc None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:42.053703 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52fc17-a69e-4f13-8fc0-2557e8bc7cbc None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:42.053879 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52fc17-a69e-4f13-8fc0-2557e8bc7cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:42.070847 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-5a52fc17-a69e-4f13-8fc0-2557e8bc7cbc None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:01:42.072040 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-5a52fc17-a69e-4f13-8fc0-2557e8bc7cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:01:42.079737 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 644/1287] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:01:42 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:01:42.103537 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afedc215-5fca-462c-bfe8-b60865396fd6 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:42.115987 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afedc215-5fca-462c-bfe8-b60865396fd6 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:42.120282 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ac25f-bf62-480b-905c-7f9c1e47dd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:42.121038 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ac25f-bf62-480b-905c-7f9c1e47dd67 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:42.121315 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ac25f-bf62-480b-905c-7f9c1e47dd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:42.121611 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ac25f-bf62-480b-905c-7f9c1e47dd67 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:42.122299 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ac25f-bf62-480b-905c-7f9c1e47dd67 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:42.123886 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ac25f-bf62-480b-905c-7f9c1e47dd67 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:42.134453 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-9c6ac25f-bf62-480b-905c-7f9c1e47dd67 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 15 16:01:42.135541 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 644/1288] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Dec 15 16:01:42 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 16:01:42.141860 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52fc17-a69e-4f13-8fc0-2557e8bc7cbc None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:42.150537 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52fc17-a69e-4f13-8fc0-2557e8bc7cbc None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:42.155878 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67454e2-28ca-46be-ac4b-844b5aaa04ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:42.156508 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67454e2-28ca-46be-ac4b-844b5aaa04ae admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:42.156794 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67454e2-28ca-46be-ac4b-844b5aaa04ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:42.157073 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67454e2-28ca-46be-ac4b-844b5aaa04ae admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:42.157817 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67454e2-28ca-46be-ac4b-844b5aaa04ae admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:42.158126 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67454e2-28ca-46be-ac4b-844b5aaa04ae admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:42.159714 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67454e2-28ca-46be-ac4b-844b5aaa04ae admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:42.164341 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 645/1289] 10.222.0.36 () {56 vars in 1137 bytes} [Wed Dec 15 16:01:42 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:42.170561 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ac25f-bf62-480b-905c-7f9c1e47dd67 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:42.179647 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ac25f-bf62-480b-905c-7f9c1e47dd67 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:42.184145 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb48fb-d62c-45dd-9ea4-06a668c7cb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:42.184775 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb48fb-d62c-45dd-9ea4-06a668c7cb69 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:42.185219 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb48fb-d62c-45dd-9ea4-06a668c7cb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:42.185533 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb48fb-d62c-45dd-9ea4-06a668c7cb69 admin admin] PATH_INFO: `/v3/services` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:42.186227 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb48fb-d62c-45dd-9ea4-06a668c7cb69 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:42.186529 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb48fb-d62c-45dd-9ea4-06a668c7cb69 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:42.188052 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb48fb-d62c-45dd-9ea4-06a668c7cb69 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:42.192387 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 645/1290] 10.222.0.36 () {56 vars in 1137 bytes} [Wed Dec 15 16:01:42 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:01:44.504813 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41465408-4480-49e4-8c4b-830182b28030 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:44.505337 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41465408-4480-49e4-8c4b-830182b28030 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:44.505337 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41465408-4480-49e4-8c4b-830182b28030 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:44.507130 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 646/1291] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:01:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:01:44.513565 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c22c93-28d5-478a-a2f2-0ccb15f622ea None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:44.514003 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c22c93-28d5-478a-a2f2-0ccb15f622ea None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:44.514290 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c22c93-28d5-478a-a2f2-0ccb15f622ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:44.532025 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-58c22c93-28d5-478a-a2f2-0ccb15f622ea None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:01:44.533207 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-58c22c93-28d5-478a-a2f2-0ccb15f622ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:01:44.540802 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 646/1292] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:01:44 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:01:44.565058 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41465408-4480-49e4-8c4b-830182b28030 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:44.577852 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41465408-4480-49e4-8c4b-830182b28030 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:44.582226 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443240d-a823-455c-9997-03c47901ee62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:44.582860 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443240d-a823-455c-9997-03c47901ee62 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:44.583150 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443240d-a823-455c-9997-03c47901ee62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:44.583429 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443240d-a823-455c-9997-03c47901ee62 admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:44.584170 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443240d-a823-455c-9997-03c47901ee62 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:44.585806 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443240d-a823-455c-9997-03c47901ee62 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:44.598421 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 647/1293] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Dec 15 16:01:44 2021] POST /identity/v3/services => generated 246 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:01:46.939647 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111a4ea-eb98-4aa1-9851-1acd229e4ea8 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:46.940181 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111a4ea-eb98-4aa1-9851-1acd229e4ea8 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:46.940181 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111a4ea-eb98-4aa1-9851-1acd229e4ea8 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:46.941988 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 647/1294] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:01:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:01:46.947443 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ec1be-5950-41bf-8eda-34dfd12fa3ab None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:46.947820 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ec1be-5950-41bf-8eda-34dfd12fa3ab None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:46.947996 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ec1be-5950-41bf-8eda-34dfd12fa3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:46.965500 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-241ec1be-5950-41bf-8eda-34dfd12fa3ab None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:01:46.966859 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-241ec1be-5950-41bf-8eda-34dfd12fa3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:01:46.984138 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 648/1295] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:01:46 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:01:47.007835 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111a4ea-eb98-4aa1-9851-1acd229e4ea8 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:47.019794 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111a4ea-eb98-4aa1-9851-1acd229e4ea8 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:47.024088 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1412aed-faa6-4485-a9a8-1c33cafa7879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:47.024848 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1412aed-faa6-4485-a9a8-1c33cafa7879 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:47.025128 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1412aed-faa6-4485-a9a8-1c33cafa7879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:47.025420 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1412aed-faa6-4485-a9a8-1c33cafa7879 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:47.026116 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1412aed-faa6-4485-a9a8-1c33cafa7879 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:47.027708 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1412aed-faa6-4485-a9a8-1c33cafa7879 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:47.038783 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-d1412aed-faa6-4485-a9a8-1c33cafa7879 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 15 16:01:47.039897 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 648/1296] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Dec 15 16:01:47 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:47.048255 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ec1be-5950-41bf-8eda-34dfd12fa3ab None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:47.057238 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ec1be-5950-41bf-8eda-34dfd12fa3ab None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:47.062737 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382728c-2e42-4840-817c-86d05797a3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:47.063392 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382728c-2e42-4840-817c-86d05797a3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:47.063677 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382728c-2e42-4840-817c-86d05797a3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:47.063959 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382728c-2e42-4840-817c-86d05797a3e4 admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:47.064671 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382728c-2e42-4840-817c-86d05797a3e4 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:47.064980 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382728c-2e42-4840-817c-86d05797a3e4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:47.066614 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382728c-2e42-4840-817c-86d05797a3e4 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:47.071587 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 649/1297] 10.222.0.36 () {56 vars in 1137 bytes} [Wed Dec 15 16:01:47 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:47.077768 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1412aed-faa6-4485-a9a8-1c33cafa7879 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:47.087115 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1412aed-faa6-4485-a9a8-1c33cafa7879 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:47.091598 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dc85a-6336-4985-b5a1-58d6d67907ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:47.092215 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dc85a-6336-4985-b5a1-58d6d67907ed admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:47.092494 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dc85a-6336-4985-b5a1-58d6d67907ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:47.092826 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dc85a-6336-4985-b5a1-58d6d67907ed admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:47.093636 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4dc85a-6336-4985-b5a1-58d6d67907ed admin admin] RBAC: Adding query filter params (interface=public, service_id=564a83be36ec43749bf63cbca12f11f2, region_id=RegionOne) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:47.093944 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4dc85a-6336-4985-b5a1-58d6d67907ed admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:47.095500 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4dc85a-6336-4985-b5a1-58d6d67907ed admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:47.100257 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 649/1298] 10.222.0.36 () {56 vars in 1272 bytes} [Wed Dec 15 16:01:47 2021] GET /identity/v3/endpoints?service_id=564a83be36ec43749bf63cbca12f11f2&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:47.105707 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382728c-2e42-4840-817c-86d05797a3e4 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:47.115820 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382728c-2e42-4840-817c-86d05797a3e4 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:47.120358 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49120427-aa42-4d42-9c59-5a320a3a0621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:47.120986 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49120427-aa42-4d42-9c59-5a320a3a0621 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:47.121270 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49120427-aa42-4d42-9c59-5a320a3a0621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:47.121580 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49120427-aa42-4d42-9c59-5a320a3a0621 admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:47.123040 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49120427-aa42-4d42-9c59-5a320a3a0621 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:47.124812 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49120427-aa42-4d42-9c59-5a320a3a0621 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:47.132493 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 650/1299] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Dec 15 16:01:47 2021] GET /identity/v3/services => generated 2191 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:01:49.489894 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bec436-e075-4378-b277-674faef313af None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:49.490448 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bec436-e075-4378-b277-674faef313af None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:49.490448 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bec436-e075-4378-b277-674faef313af None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:49.492194 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 650/1300] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:01:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:01:49.498299 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b86b7-f9f8-4d42-9880-208784c30317 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:49.498723 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b86b7-f9f8-4d42-9880-208784c30317 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:49.498850 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b86b7-f9f8-4d42-9880-208784c30317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:49.516665 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-529b86b7-f9f8-4d42-9880-208784c30317 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:01:49.517910 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-529b86b7-f9f8-4d42-9880-208784c30317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:01:49.525441 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 651/1301] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:01:49 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:01:49.549600 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bec436-e075-4378-b277-674faef313af None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:49.562055 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bec436-e075-4378-b277-674faef313af None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:49.566461 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675d9a3-6b46-4253-a9ab-a8d7cb980c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:49.567217 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675d9a3-6b46-4253-a9ab-a8d7cb980c82 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:49.567506 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675d9a3-6b46-4253-a9ab-a8d7cb980c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:49.567782 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675d9a3-6b46-4253-a9ab-a8d7cb980c82 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:49.568440 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675d9a3-6b46-4253-a9ab-a8d7cb980c82 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:49.570073 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675d9a3-6b46-4253-a9ab-a8d7cb980c82 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:49.581272 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING keystone.server.flask.application [None req-e675d9a3-6b46-4253-a9ab-a8d7cb980c82 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 15 16:01:49.582392 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 651/1302] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Dec 15 16:01:49 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 16:01:49.588391 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b86b7-f9f8-4d42-9880-208784c30317 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:49.597421 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b86b7-f9f8-4d42-9880-208784c30317 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:49.601877 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6041f5-f229-40ff-92a7-e325cc87cbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:49.602512 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6041f5-f229-40ff-92a7-e325cc87cbda admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:49.602792 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6041f5-f229-40ff-92a7-e325cc87cbda admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:49.603062 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6041f5-f229-40ff-92a7-e325cc87cbda admin admin] PATH_INFO: `/v3/services` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:49.603758 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6041f5-f229-40ff-92a7-e325cc87cbda admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:01:49.604057 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6041f5-f229-40ff-92a7-e325cc87cbda admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:49.605658 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6041f5-f229-40ff-92a7-e325cc87cbda admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:49.610753 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 652/1303] 10.222.0.36 () {56 vars in 1137 bytes} [Wed Dec 15 16:01:49 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:01:49.616393 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675d9a3-6b46-4253-a9ab-a8d7cb980c82 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:01:49.627017 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675d9a3-6b46-4253-a9ab-a8d7cb980c82 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:01:49.631535 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71ccd9-deca-47c0-8be4-340e4207a308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:01:49.632140 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71ccd9-deca-47c0-8be4-340e4207a308 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:01:49.632425 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71ccd9-deca-47c0-8be4-340e4207a308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:01:49.632703 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71ccd9-deca-47c0-8be4-340e4207a308 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:01:49.633472 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71ccd9-deca-47c0-8be4-340e4207a308 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:01:49.635014 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71ccd9-deca-47c0-8be4-340e4207a308 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:01:49.654527 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 652/1304] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Dec 15 16:01:49 2021] POST /identity/v3/endpoints => generated 331 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:02:52.337810 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d081d-0672-485e-aeef-cc50ae086e88 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:02:52.338392 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d081d-0672-485e-aeef-cc50ae086e88 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:02:52.338392 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d081d-0672-485e-aeef-cc50ae086e88 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:02:52.340124 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 653/1305] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:02:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:02:52.351190 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a683a-1236-4ac4-8bfa-177f4c4de528 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:02:52.351796 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a683a-1236-4ac4-8bfa-177f4c4de528 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:02:52.351796 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a683a-1236-4ac4-8bfa-177f4c4de528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:02:52.444216 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-3b0a683a-1236-4ac4-8bfa-177f4c4de528 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:02:52.445447 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-3b0a683a-1236-4ac4-8bfa-177f4c4de528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:02:52.561971 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 653/1306] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:02:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:02:52.594157 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d081d-0672-485e-aeef-cc50ae086e88 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:02:52.596672 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-343d081d-0672-485e-aeef-cc50ae086e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:02:52.773628 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d081d-0672-485e-aeef-cc50ae086e88 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:02:52.919394 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca28ab2-539a-4d98-92f3-6f44adfa3154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:02:52.920107 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca28ab2-539a-4d98-92f3-6f44adfa3154 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:02:52.920388 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca28ab2-539a-4d98-92f3-6f44adfa3154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:02:52.920664 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca28ab2-539a-4d98-92f3-6f44adfa3154 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:02:52.921422 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca28ab2-539a-4d98-92f3-6f44adfa3154 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:02:52.923265 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca28ab2-539a-4d98-92f3-6f44adfa3154 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:02:52.946733 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 654/1307] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Dec 15 16:02:52 2021] GET /identity/v3/projects => generated 2553 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:02:55.454369 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559932a-821c-4ff7-b826-23a1fc6fff9c None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:02:55.454804 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559932a-821c-4ff7-b826-23a1fc6fff9c None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:02:55.454908 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559932a-821c-4ff7-b826-23a1fc6fff9c None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:02:55.456881 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 654/1308] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:02:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:02:55.462753 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fddf2-7471-4f60-b5bc-e1c4c7210235 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:02:55.463212 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fddf2-7471-4f60-b5bc-e1c4c7210235 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:02:55.463419 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fddf2-7471-4f60-b5bc-e1c4c7210235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:02:55.542446 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-589fddf2-7471-4f60-b5bc-e1c4c7210235 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:02:55.543700 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-589fddf2-7471-4f60-b5bc-e1c4c7210235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:02:55.645008 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 655/1309] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:02:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:02:55.696583 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee284e-1714-4f35-a020-8bab8264b706 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:02:55.696873 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee284e-1714-4f35-a020-8bab8264b706 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:02:55.697152 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee284e-1714-4f35-a020-8bab8264b706 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:02:55.698986 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 655/1310] 10.222.0.36 () {54 vars in 964 bytes} [Wed Dec 15 16:02:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:02:55.706128 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af2158-8d3d-40bf-9a93-4c6342116029 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:02:55.706418 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af2158-8d3d-40bf-9a93-4c6342116029 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:02:55.706700 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af2158-8d3d-40bf-9a93-4c6342116029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:02:55.779598 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-09af2158-8d3d-40bf-9a93-4c6342116029 None None] MFA Rules not processed for user `f2f08f47d4e6442a92901fb7d8bed0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:02:55.780842 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-09af2158-8d3d-40bf-9a93-4c6342116029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:02:55.853762 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 656/1311] 10.222.0.36 () {58 vars in 1061 bytes} [Wed Dec 15 16:02:55 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:02:55.863146 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee284e-1714-4f35-a020-8bab8264b706 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:02:55.864801 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-e1ee284e-1714-4f35-a020-8bab8264b706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:02:55.969455 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee284e-1714-4f35-a020-8bab8264b706 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:02:56.057106 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e474eb-4c81-461a-8756-7b9ae36cca46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:02:56.057784 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e474eb-4c81-461a-8756-7b9ae36cca46 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:02:56.058069 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e474eb-4c81-461a-8756-7b9ae36cca46 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:02:56.058345 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e474eb-4c81-461a-8756-7b9ae36cca46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:02:56.059989 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f2e474eb-4c81-461a-8756-7b9ae36cca46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:02:56.165503 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e474eb-4c81-461a-8756-7b9ae36cca46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:02:56.166868 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e474eb-4c81-461a-8756-7b9ae36cca46 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:02:56.184841 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 656/1312] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:02:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:02:58.826832 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e38b5e-b187-4aad-9956-8e6b6817b087 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:02:58.827407 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e38b5e-b187-4aad-9956-8e6b6817b087 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:02:58.827407 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e38b5e-b187-4aad-9956-8e6b6817b087 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:02:58.829136 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 657/1313] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:02:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:02:58.834813 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb4f8d-0b44-4f41-82d9-f51fe5df5911 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:02:58.835236 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb4f8d-0b44-4f41-82d9-f51fe5df5911 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:02:58.835350 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb4f8d-0b44-4f41-82d9-f51fe5df5911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:02:58.898494 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-dcdb4f8d-0b44-4f41-82d9-f51fe5df5911 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:02:58.899669 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-dcdb4f8d-0b44-4f41-82d9-f51fe5df5911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:02:58.989946 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 657/1314] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:02:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:02:59.046672 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f7ebf-078a-4d35-a6cf-32e463f1a86b None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:02:59.047014 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f7ebf-078a-4d35-a6cf-32e463f1a86b None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:02:59.047349 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f7ebf-078a-4d35-a6cf-32e463f1a86b None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:02:59.049561 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 658/1315] 10.222.0.36 () {54 vars in 964 bytes} [Wed Dec 15 16:02:59 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:02:59.056715 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d529894-80e0-4dd7-9898-14799db91afb None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:02:59.057005 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d529894-80e0-4dd7-9898-14799db91afb None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:02:59.057278 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d529894-80e0-4dd7-9898-14799db91afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:02:59.130429 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-2d529894-80e0-4dd7-9898-14799db91afb None None] MFA Rules not processed for user `f2f08f47d4e6442a92901fb7d8bed0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:02:59.131541 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-2d529894-80e0-4dd7-9898-14799db91afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:02:59.202478 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 658/1316] 10.222.0.36 () {58 vars in 1061 bytes} [Wed Dec 15 16:02:59 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:02:59.211915 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f7ebf-078a-4d35-a6cf-32e463f1a86b None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:02:59.213464 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-7a2f7ebf-078a-4d35-a6cf-32e463f1a86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:02:59.311617 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f7ebf-078a-4d35-a6cf-32e463f1a86b None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:02:59.382755 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c91f5-316f-4eb7-b880-57382cd7d83c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:02:59.383325 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c91f5-316f-4eb7-b880-57382cd7d83c service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:02:59.383611 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c91f5-316f-4eb7-b880-57382cd7d83c service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:02:59.383890 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c91f5-316f-4eb7-b880-57382cd7d83c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:02:59.385549 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-9e1c91f5-316f-4eb7-b880-57382cd7d83c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:02:59.490287 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c91f5-316f-4eb7-b880-57382cd7d83c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:02:59.491735 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c91f5-316f-4eb7-b880-57382cd7d83c service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:02:59.509314 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 659/1317] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:02:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:03:02.432749 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10224d-d37f-46ef-a3ca-503f836433f4 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:02.433305 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10224d-d37f-46ef-a3ca-503f836433f4 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:02.433305 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10224d-d37f-46ef-a3ca-503f836433f4 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:02.435077 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 659/1318] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:03:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:03:02.444438 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07205e-4bb2-4fef-9c88-c9004a6fe7e5 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:02.444917 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07205e-4bb2-4fef-9c88-c9004a6fe7e5 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:02.445020 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07205e-4bb2-4fef-9c88-c9004a6fe7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:02.508270 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-dd07205e-4bb2-4fef-9c88-c9004a6fe7e5 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:03:02.509566 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-dd07205e-4bb2-4fef-9c88-c9004a6fe7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:02.606159 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 660/1319] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:03:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:03:02.642675 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10224d-d37f-46ef-a3ca-503f836433f4 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:03:02.644188 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-3a10224d-d37f-46ef-a3ca-503f836433f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:02.767685 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10224d-d37f-46ef-a3ca-503f836433f4 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:03:02.855734 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73152145-3845-45a3-9bcf-d9a3c4694b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:03:02.856570 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73152145-3845-45a3-9bcf-d9a3c4694b7b admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:02.856850 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73152145-3845-45a3-9bcf-d9a3c4694b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:02.857120 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73152145-3845-45a3-9bcf-d9a3c4694b7b admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:02.866478 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73152145-3845-45a3-9bcf-d9a3c4694b7b admin admin] RBAC: Authorizing `identity:get_project(project_id=f6644073b15349a5b18a70868298c841)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:03:02.868532 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73152145-3845-45a3-9bcf-d9a3c4694b7b admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:03:02.870235 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 660/1320] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 16:03:02 2021] GET /identity/v3/projects/f6644073b15349a5b18a70868298c841 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:03:02.882817 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07205e-4bb2-4fef-9c88-c9004a6fe7e5 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:03:02.884015 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-dd07205e-4bb2-4fef-9c88-c9004a6fe7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:02.970794 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07205e-4bb2-4fef-9c88-c9004a6fe7e5 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:03:03.041754 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de7a3f-990b-43d9-b455-e557f4997e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:03:03.042219 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de7a3f-990b-43d9-b455-e557f4997e14 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:03.042500 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de7a3f-990b-43d9-b455-e557f4997e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:03.042775 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de7a3f-990b-43d9-b455-e557f4997e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:03.044384 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-c4de7a3f-990b-43d9-b455-e557f4997e14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:03.148830 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de7a3f-990b-43d9-b455-e557f4997e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:03:03.150288 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de7a3f-990b-43d9-b455-e557f4997e14 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:03:03.167355 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 661/1321] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:03:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:03:06.059367 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996cf49-5d9c-43bb-b267-8dae028d7fe8 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:06.059825 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996cf49-5d9c-43bb-b267-8dae028d7fe8 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:06.059957 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996cf49-5d9c-43bb-b267-8dae028d7fe8 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:06.062325 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 661/1322] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:03:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:03:06.068071 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435509e-534f-465b-bb60-ec0bfac524d9 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:06.068500 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435509e-534f-465b-bb60-ec0bfac524d9 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:06.068630 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435509e-534f-465b-bb60-ec0bfac524d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:06.130949 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-6435509e-534f-465b-bb60-ec0bfac524d9 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:03:06.132153 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-6435509e-534f-465b-bb60-ec0bfac524d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:06.224074 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 662/1323] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:03:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:03:06.259153 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996cf49-5d9c-43bb-b267-8dae028d7fe8 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:03:06.260669 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-a996cf49-5d9c-43bb-b267-8dae028d7fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:06.390259 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996cf49-5d9c-43bb-b267-8dae028d7fe8 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:03:06.484017 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507870a-c6b0-4b97-a860-e878ad24f4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:03:06.484866 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507870a-c6b0-4b97-a860-e878ad24f4ac admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:06.485150 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507870a-c6b0-4b97-a860-e878ad24f4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:06.485452 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507870a-c6b0-4b97-a860-e878ad24f4ac admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:06.495022 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507870a-c6b0-4b97-a860-e878ad24f4ac admin admin] RBAC: Authorizing `identity:get_project(project_id=f6644073b15349a5b18a70868298c841)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:03:06.497101 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507870a-c6b0-4b97-a860-e878ad24f4ac admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:03:06.499721 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 662/1324] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 16:03:06 2021] GET /identity/v3/projects/f6644073b15349a5b18a70868298c841 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:03:06.511917 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435509e-534f-465b-bb60-ec0bfac524d9 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:03:06.513119 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-6435509e-534f-465b-bb60-ec0bfac524d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:06.599375 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435509e-534f-465b-bb60-ec0bfac524d9 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:03:06.668802 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6cb63-4b1f-4f90-9ccf-78054911e0b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:03:06.669367 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6cb63-4b1f-4f90-9ccf-78054911e0b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:06.669674 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6cb63-4b1f-4f90-9ccf-78054911e0b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:06.669946 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6cb63-4b1f-4f90-9ccf-78054911e0b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:06.672477 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-31f6cb63-4b1f-4f90-9ccf-78054911e0b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:06.778706 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6cb63-4b1f-4f90-9ccf-78054911e0b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:03:06.780718 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6cb63-4b1f-4f90-9ccf-78054911e0b4 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:03:06.799186 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 663/1325] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:03:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:03:09.905365 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365deb18-21d3-4afc-9bdc-7186d9dbe0b3 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:09.905948 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365deb18-21d3-4afc-9bdc-7186d9dbe0b3 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:09.905948 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365deb18-21d3-4afc-9bdc-7186d9dbe0b3 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:09.907938 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 663/1326] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:03:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:03:09.914080 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77196334-7dbb-4020-b72f-9fedcf37f04e None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:09.914493 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77196334-7dbb-4020-b72f-9fedcf37f04e None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:09.914641 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77196334-7dbb-4020-b72f-9fedcf37f04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:09.979805 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-77196334-7dbb-4020-b72f-9fedcf37f04e None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:03:09.981003 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-77196334-7dbb-4020-b72f-9fedcf37f04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:10.075790 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 664/1327] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:03:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:03:10.113689 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365deb18-21d3-4afc-9bdc-7186d9dbe0b3 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:03:10.115282 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-365deb18-21d3-4afc-9bdc-7186d9dbe0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:10.215577 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365deb18-21d3-4afc-9bdc-7186d9dbe0b3 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:03:10.286739 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e925592-0ae0-42da-b6cc-b8aa87a8cc16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:03:10.287385 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e925592-0ae0-42da-b6cc-b8aa87a8cc16 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:10.287670 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e925592-0ae0-42da-b6cc-b8aa87a8cc16 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:10.287948 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e925592-0ae0-42da-b6cc-b8aa87a8cc16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:10.289614 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-1e925592-0ae0-42da-b6cc-b8aa87a8cc16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:10.395993 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e925592-0ae0-42da-b6cc-b8aa87a8cc16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:03:10.397358 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e925592-0ae0-42da-b6cc-b8aa87a8cc16 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:03:10.415055 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 664/1328] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:03:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:03:12.859914 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa85c52-c6b9-43e2-8f88-006f5f3c9359 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:12.860443 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa85c52-c6b9-43e2-8f88-006f5f3c9359 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:12.860443 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa85c52-c6b9-43e2-8f88-006f5f3c9359 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:12.862290 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 665/1329] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:03:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:03:12.868119 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2f557-66fd-449f-8032-a8468cd5c527 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:12.868545 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2f557-66fd-449f-8032-a8468cd5c527 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:12.868656 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2f557-66fd-449f-8032-a8468cd5c527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:12.933648 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-08c2f557-66fd-449f-8032-a8468cd5c527 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:03:12.934868 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-08c2f557-66fd-449f-8032-a8468cd5c527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:13.027995 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 665/1330] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:03:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:03:13.066728 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa85c52-c6b9-43e2-8f88-006f5f3c9359 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:03:13.068275 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-5aa85c52-c6b9-43e2-8f88-006f5f3c9359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:13.169218 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa85c52-c6b9-43e2-8f88-006f5f3c9359 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:03:13.239021 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17007f5b-b1a9-4943-8302-d114d979d749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:03:13.239661 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17007f5b-b1a9-4943-8302-d114d979d749 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:13.239943 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17007f5b-b1a9-4943-8302-d114d979d749 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:13.240214 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17007f5b-b1a9-4943-8302-d114d979d749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:13.241848 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-17007f5b-b1a9-4943-8302-d114d979d749 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:13.345508 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17007f5b-b1a9-4943-8302-d114d979d749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:03:13.346973 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17007f5b-b1a9-4943-8302-d114d979d749 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:03:13.364740 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 666/1331] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:03:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:03:15.803477 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dee654-ce1a-4a3a-bd9c-f001dc1bd3dd None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:15.803998 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dee654-ce1a-4a3a-bd9c-f001dc1bd3dd None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:15.803998 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dee654-ce1a-4a3a-bd9c-f001dc1bd3dd None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:15.805741 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 666/1332] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:03:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:03:15.812353 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727496d-6f5c-47b6-a225-348569a5426e None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:15.812823 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727496d-6f5c-47b6-a225-348569a5426e None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:15.813333 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727496d-6f5c-47b6-a225-348569a5426e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:15.876015 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-0727496d-6f5c-47b6-a225-348569a5426e None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:03:15.877213 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-0727496d-6f5c-47b6-a225-348569a5426e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:15.971928 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 667/1333] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:03:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:03:16.005610 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dee654-ce1a-4a3a-bd9c-f001dc1bd3dd None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:03:16.007145 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-03dee654-ce1a-4a3a-bd9c-f001dc1bd3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:16.128807 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dee654-ce1a-4a3a-bd9c-f001dc1bd3dd None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:03:16.217010 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917c21b-7002-4cd9-8b77-03f66cb9cd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:03:16.218016 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917c21b-7002-4cd9-8b77-03f66cb9cd50 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:16.218291 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917c21b-7002-4cd9-8b77-03f66cb9cd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:16.218562 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917c21b-7002-4cd9-8b77-03f66cb9cd50 admin admin] PATH_INFO: `/v3/projects/f6644073b15349a5b18a70868298c841` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:16.228317 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917c21b-7002-4cd9-8b77-03f66cb9cd50 admin admin] RBAC: Authorizing `identity:get_project(project_id=f6644073b15349a5b18a70868298c841)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:03:16.230416 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917c21b-7002-4cd9-8b77-03f66cb9cd50 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:03:16.238353 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 667/1334] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Dec 15 16:03:16 2021] GET /identity/v3/projects/f6644073b15349a5b18a70868298c841 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:03:16.244894 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727496d-6f5c-47b6-a225-348569a5426e None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:03:16.246135 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-0727496d-6f5c-47b6-a225-348569a5426e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:16.334698 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727496d-6f5c-47b6-a225-348569a5426e None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:03:16.405526 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9363cc-3012-458b-9150-76c35525f590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:03:16.406557 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9363cc-3012-458b-9150-76c35525f590 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:16.407570 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9363cc-3012-458b-9150-76c35525f590 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:16.407570 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9363cc-3012-458b-9150-76c35525f590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:16.412992 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-dd9363cc-3012-458b-9150-76c35525f590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:16.531781 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9363cc-3012-458b-9150-76c35525f590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:03:16.533605 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9363cc-3012-458b-9150-76c35525f590 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:03:16.552803 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 668/1335] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:03:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:03:19.429938 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c96602-96e7-4925-a0d9-2420466db89b None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:19.430417 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c96602-96e7-4925-a0d9-2420466db89b None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:19.430619 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c96602-96e7-4925-a0d9-2420466db89b None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:19.433446 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 668/1336] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:03:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:03:19.439907 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181c936-91c9-4aa4-888d-6f5f43f257f0 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:19.440523 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181c936-91c9-4aa4-888d-6f5f43f257f0 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:19.440523 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181c936-91c9-4aa4-888d-6f5f43f257f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:19.505411 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-4181c936-91c9-4aa4-888d-6f5f43f257f0 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:03:19.506628 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-4181c936-91c9-4aa4-888d-6f5f43f257f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:19.598914 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 669/1337] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:03:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:03:19.635842 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c96602-96e7-4925-a0d9-2420466db89b None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:03:19.637413 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-43c96602-96e7-4925-a0d9-2420466db89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:19.737970 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c96602-96e7-4925-a0d9-2420466db89b None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:03:19.810743 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f161b1-2d9b-4c5a-875d-8b754d2f91cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:03:19.811515 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f161b1-2d9b-4c5a-875d-8b754d2f91cd service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:19.811865 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f161b1-2d9b-4c5a-875d-8b754d2f91cd service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:19.812256 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f161b1-2d9b-4c5a-875d-8b754d2f91cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:19.814283 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-28f161b1-2d9b-4c5a-875d-8b754d2f91cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:19.921492 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f161b1-2d9b-4c5a-875d-8b754d2f91cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:03:19.922874 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f161b1-2d9b-4c5a-875d-8b754d2f91cd service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:03:19.940288 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 669/1338] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:03:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:03:22.334125 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adc75d-fd8b-4218-a2b8-8fc3109973e0 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:22.334644 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adc75d-fd8b-4218-a2b8-8fc3109973e0 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:22.334759 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adc75d-fd8b-4218-a2b8-8fc3109973e0 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:22.336470 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 670/1339] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:03:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:03:22.342099 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a75dc-f53e-47f1-b91e-9454e43b2217 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:22.342547 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a75dc-f53e-47f1-b91e-9454e43b2217 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:22.342750 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a75dc-f53e-47f1-b91e-9454e43b2217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:22.407714 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-b88a75dc-f53e-47f1-b91e-9454e43b2217 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:03:22.409146 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-b88a75dc-f53e-47f1-b91e-9454e43b2217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:22.509000 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 670/1340] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:03:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:03:22.552673 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3adc75d-fd8b-4218-a2b8-8fc3109973e0 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:03:22.554229 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-c3adc75d-fd8b-4218-a2b8-8fc3109973e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:22.657914 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3adc75d-fd8b-4218-a2b8-8fc3109973e0 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:03:22.729975 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72b69e-fd72-41b1-9330-93a7f01c44ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:03:22.730618 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72b69e-fd72-41b1-9330-93a7f01c44ca service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:22.730897 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72b69e-fd72-41b1-9330-93a7f01c44ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:22.731169 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72b69e-fd72-41b1-9330-93a7f01c44ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:22.732922 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-5f72b69e-fd72-41b1-9330-93a7f01c44ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:22.793697 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72b69e-fd72-41b1-9330-93a7f01c44ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:03:22.795150 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72b69e-fd72-41b1-9330-93a7f01c44ca service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:03:22.820768 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 671/1341] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:03:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:03:25.478321 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9400c33-5164-4e36-9325-af7f4c6c058d None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:25.478844 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9400c33-5164-4e36-9325-af7f4c6c058d None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:25.478844 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9400c33-5164-4e36-9325-af7f4c6c058d None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:25.480613 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 671/1342] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:03:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:03:25.486924 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1dc18-7495-4070-aec9-733f91ec55c3 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:25.487367 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1dc18-7495-4070-aec9-733f91ec55c3 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:25.487465 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1dc18-7495-4070-aec9-733f91ec55c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:25.532623 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-6fb1dc18-7495-4070-aec9-733f91ec55c3 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:03:25.534249 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-6fb1dc18-7495-4070-aec9-733f91ec55c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:25.543264 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 672/1343] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:03:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:03:25.580640 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9400c33-5164-4e36-9325-af7f4c6c058d None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:03:25.582635 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-a9400c33-5164-4e36-9325-af7f4c6c058d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:25.616663 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9400c33-5164-4e36-9325-af7f4c6c058d None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:03:25.620136 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823f63a-9545-45ac-8cfa-f65659db1b9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:03:25.620759 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823f63a-9545-45ac-8cfa-f65659db1b9a service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:25.621037 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823f63a-9545-45ac-8cfa-f65659db1b9a service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:25.621306 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823f63a-9545-45ac-8cfa-f65659db1b9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:25.630562 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823f63a-9545-45ac-8cfa-f65659db1b9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:03:25.631973 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823f63a-9545-45ac-8cfa-f65659db1b9a service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:03:25.641173 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 672/1344] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:03:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:03:29.938330 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892854a-b333-45d4-8578-882efbcf8f07 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:29.938866 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892854a-b333-45d4-8578-882efbcf8f07 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:29.938984 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892854a-b333-45d4-8578-882efbcf8f07 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:29.940739 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 673/1345] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:03:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:03:29.946711 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f5685-bf40-4e71-a924-bff741f00a90 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:29.947121 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f5685-bf40-4e71-a924-bff741f00a90 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:29.947276 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f5685-bf40-4e71-a924-bff741f00a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:29.965425 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-695f5685-bf40-4e71-a924-bff741f00a90 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:03:29.966740 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-695f5685-bf40-4e71-a924-bff741f00a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:29.974834 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 673/1346] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:03:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:03:30.016719 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892854a-b333-45d4-8578-882efbcf8f07 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:03:30.018508 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-3892854a-b333-45d4-8578-882efbcf8f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:30.033111 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892854a-b333-45d4-8578-882efbcf8f07 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:03:30.036964 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2420a-0e78-4a44-8241-5fc2f39269f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:03:30.037675 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2420a-0e78-4a44-8241-5fc2f39269f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:30.037959 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2420a-0e78-4a44-8241-5fc2f39269f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:30.038233 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2420a-0e78-4a44-8241-5fc2f39269f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:30.048996 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2420a-0e78-4a44-8241-5fc2f39269f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:03:30.050480 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2420a-0e78-4a44-8241-5fc2f39269f0 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:03:30.060071 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 674/1347] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:03:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:03:33.251018 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36053c-5e75-46b2-9b2b-b60b7c136211 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:33.251609 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36053c-5e75-46b2-9b2b-b60b7c136211 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:33.251609 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36053c-5e75-46b2-9b2b-b60b7c136211 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:33.253667 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 674/1348] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:03:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:03:33.259740 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba06f57-3d6c-4fe4-9153-64c6cfc1ab38 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:33.260256 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba06f57-3d6c-4fe4-9153-64c6cfc1ab38 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:33.260369 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba06f57-3d6c-4fe4-9153-64c6cfc1ab38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:33.279487 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-eba06f57-3d6c-4fe4-9153-64c6cfc1ab38 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:03:33.280739 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-eba06f57-3d6c-4fe4-9153-64c6cfc1ab38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:33.289007 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 675/1349] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:03:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:03:33.329349 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36053c-5e75-46b2-9b2b-b60b7c136211 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:03:33.340495 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36053c-5e75-46b2-9b2b-b60b7c136211 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:03:33.344664 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941d14c-9c8b-4877-9d5a-b6fb275cdcf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:03:33.345329 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941d14c-9c8b-4877-9d5a-b6fb275cdcf6 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:33.345648 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941d14c-9c8b-4877-9d5a-b6fb275cdcf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:33.345926 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941d14c-9c8b-4877-9d5a-b6fb275cdcf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:33.355810 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941d14c-9c8b-4877-9d5a-b6fb275cdcf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:03:33.357273 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941d14c-9c8b-4877-9d5a-b6fb275cdcf6 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:03:33.367827 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 675/1350] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:03:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:03:38.066600 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732c089-6157-43af-a127-b4fd28f0b771 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:38.067185 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732c089-6157-43af-a127-b4fd28f0b771 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:38.067185 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732c089-6157-43af-a127-b4fd28f0b771 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:38.068954 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 676/1351] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:03:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:03:38.074707 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332f1e8-6f41-477f-82a5-e0b461e5d0fd None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:38.075151 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332f1e8-6f41-477f-82a5-e0b461e5d0fd None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:38.075255 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332f1e8-6f41-477f-82a5-e0b461e5d0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:38.092916 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-f332f1e8-6f41-477f-82a5-e0b461e5d0fd None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:03:38.094451 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f332f1e8-6f41-477f-82a5-e0b461e5d0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:38.102287 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 676/1352] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:03:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:03:38.143617 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732c089-6157-43af-a127-b4fd28f0b771 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:03:38.153921 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732c089-6157-43af-a127-b4fd28f0b771 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:03:38.157600 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ccb99-1207-451b-a337-070101096c57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:03:38.158234 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ccb99-1207-451b-a337-070101096c57 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:38.158513 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ccb99-1207-451b-a337-070101096c57 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:38.158783 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ccb99-1207-451b-a337-070101096c57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:38.168174 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ccb99-1207-451b-a337-070101096c57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:03:38.169642 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ccb99-1207-451b-a337-070101096c57 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:03:38.179832 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 677/1353] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:03:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:03:43.115064 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd273033-9d9c-4a42-95db-ed284499b1bf None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:43.115931 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd273033-9d9c-4a42-95db-ed284499b1bf None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:43.116375 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd273033-9d9c-4a42-95db-ed284499b1bf None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:43.118578 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 677/1354] 10.222.0.36 () {54 vars in 921 bytes} [Wed Dec 15 16:03:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:03:43.126268 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2b6b1-b4f4-4115-a488-f55466e14930 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:43.127181 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2b6b1-b4f4-4115-a488-f55466e14930 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:43.127676 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2b6b1-b4f4-4115-a488-f55466e14930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:43.240690 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-e6e2b6b1-b4f4-4115-a488-f55466e14930 None None] MFA Rules not processed for user `e186d6728a2341399252238c559002f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:03:43.242269 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-e6e2b6b1-b4f4-4115-a488-f55466e14930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:43.319870 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 678/1355] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Dec 15 16:03:43 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:03:47.438168 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b7d34-87a8-4e0e-9055-5b9edc6a9f12 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:47.438747 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b7d34-87a8-4e0e-9055-5b9edc6a9f12 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:47.438747 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b7d34-87a8-4e0e-9055-5b9edc6a9f12 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:47.440710 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 678/1356] 10.222.0.36 () {54 vars in 921 bytes} [Wed Dec 15 16:03:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:03:47.445870 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae130f-b3b2-4ac1-9443-c267bbd06bac None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:47.446691 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae130f-b3b2-4ac1-9443-c267bbd06bac None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:47.447188 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae130f-b3b2-4ac1-9443-c267bbd06bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:47.466852 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-60ae130f-b3b2-4ac1-9443-c267bbd06bac None None] MFA Rules not processed for user `e186d6728a2341399252238c559002f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:03:47.468090 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-60ae130f-b3b2-4ac1-9443-c267bbd06bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:47.477180 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 679/1357] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Dec 15 16:03:47 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:03:49.029915 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4a12e-fc0f-4e23-8d81-60d9c37579c3 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:49.030444 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4a12e-fc0f-4e23-8d81-60d9c37579c3 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:49.030444 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4a12e-fc0f-4e23-8d81-60d9c37579c3 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:49.032570 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 679/1358] 10.222.0.36 () {54 vars in 921 bytes} [Wed Dec 15 16:03:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:03:49.040903 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb06aa-bc08-4c19-a835-2f707ecba0f3 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:49.041375 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb06aa-bc08-4c19-a835-2f707ecba0f3 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:49.041810 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb06aa-bc08-4c19-a835-2f707ecba0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:49.063301 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-6fbb06aa-bc08-4c19-a835-2f707ecba0f3 None None] MFA Rules not processed for user `e186d6728a2341399252238c559002f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:03:49.064756 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-6fbb06aa-bc08-4c19-a835-2f707ecba0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:49.073711 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 680/1359] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Dec 15 16:03:49 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:03:52.898441 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60895ae3-bcf9-4ec2-bcac-4e0b439f1230 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:52.899048 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60895ae3-bcf9-4ec2-bcac-4e0b439f1230 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:52.899048 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60895ae3-bcf9-4ec2-bcac-4e0b439f1230 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:52.900885 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 680/1360] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:03:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:03:52.907439 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44a72-3ce6-44fc-8d32-b5ec2f52abe0 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:52.907872 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44a72-3ce6-44fc-8d32-b5ec2f52abe0 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:52.907982 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44a72-3ce6-44fc-8d32-b5ec2f52abe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:52.927002 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-e2f44a72-3ce6-44fc-8d32-b5ec2f52abe0 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:03:52.928190 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-e2f44a72-3ce6-44fc-8d32-b5ec2f52abe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:52.936069 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 681/1361] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:03:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:03:52.986525 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde84b27-e895-4d55-abc0-14b92ddd0b89 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:52.986964 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde84b27-e895-4d55-abc0-14b92ddd0b89 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:52.987342 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde84b27-e895-4d55-abc0-14b92ddd0b89 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:52.989219 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 681/1362] 10.222.0.36 () {54 vars in 961 bytes} [Wed Dec 15 16:03:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:03:52.994950 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608f350-a129-4cbd-8eec-eef0f572769f None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:52.995235 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608f350-a129-4cbd-8eec-eef0f572769f None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:52.995677 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608f350-a129-4cbd-8eec-eef0f572769f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:53.044511 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-6608f350-a129-4cbd-8eec-eef0f572769f None None] MFA Rules not processed for user `bc13934328e742f9a1a85d1c84ab83dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:03:53.047912 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-6608f350-a129-4cbd-8eec-eef0f572769f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:53.137234 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 682/1363] 10.222.0.36 () {58 vars in 1058 bytes} [Wed Dec 15 16:03:52 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:03:53.145283 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde84b27-e895-4d55-abc0-14b92ddd0b89 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:03:53.160860 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde84b27-e895-4d55-abc0-14b92ddd0b89 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:03:53.167491 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195444f-f3d6-4434-ab23-f84134979541 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:03:53.168308 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195444f-f3d6-4434-ab23-f84134979541 service nova] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:53.168717 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195444f-f3d6-4434-ab23-f84134979541 service nova] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:53.169089 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195444f-f3d6-4434-ab23-f84134979541 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:53.178981 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195444f-f3d6-4434-ab23-f84134979541 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:03:53.180885 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195444f-f3d6-4434-ab23-f84134979541 service nova] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:03:53.191876 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 682/1364] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:03:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:03:55.778219 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c2079-29ec-403c-9d73-dd8ede24bbf9 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:55.778784 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c2079-29ec-403c-9d73-dd8ede24bbf9 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:55.778784 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c2079-29ec-403c-9d73-dd8ede24bbf9 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:55.780505 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 683/1365] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:03:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:03:55.787157 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0127221-9539-40de-82d1-1e19ed1eef7a None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:55.787603 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0127221-9539-40de-82d1-1e19ed1eef7a None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:55.787698 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0127221-9539-40de-82d1-1e19ed1eef7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:55.805894 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-e0127221-9539-40de-82d1-1e19ed1eef7a None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:03:55.807067 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-e0127221-9539-40de-82d1-1e19ed1eef7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:55.815241 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 683/1366] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:03:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:03:55.862533 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c2079-29ec-403c-9d73-dd8ede24bbf9 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:03:55.877115 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c2079-29ec-403c-9d73-dd8ede24bbf9 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:03:55.882745 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a03a22-cd5d-463c-9bb5-15908e939a0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:03:55.883370 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a03a22-cd5d-463c-9bb5-15908e939a0f service nova] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:55.883653 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a03a22-cd5d-463c-9bb5-15908e939a0f service nova] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:55.883928 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a03a22-cd5d-463c-9bb5-15908e939a0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:55.892815 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a03a22-cd5d-463c-9bb5-15908e939a0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:03:55.894447 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a03a22-cd5d-463c-9bb5-15908e939a0f service nova] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:03:55.905854 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 684/1367] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:03:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:03:58.610544 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23db140-143d-4934-83e1-ba190e5f544a None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:58.611087 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23db140-143d-4934-83e1-ba190e5f544a None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:58.611087 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23db140-143d-4934-83e1-ba190e5f544a None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:58.612858 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 684/1368] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:03:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:03:58.618968 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62894911-369c-4459-ba64-3c130ae2e71c None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:58.619416 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62894911-369c-4459-ba64-3c130ae2e71c None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:58.619517 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62894911-369c-4459-ba64-3c130ae2e71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:58.639113 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-62894911-369c-4459-ba64-3c130ae2e71c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:03:58.640240 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-62894911-369c-4459-ba64-3c130ae2e71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:58.648579 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 685/1369] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:03:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:03:58.699019 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddbaf0-22fc-4c34-8490-6ea471a21002 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:58.699304 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddbaf0-22fc-4c34-8490-6ea471a21002 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:58.699582 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddbaf0-22fc-4c34-8490-6ea471a21002 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:58.701343 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 685/1370] 10.222.0.36 () {54 vars in 961 bytes} [Wed Dec 15 16:03:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:03:58.707505 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588ed3d-7488-478e-8e75-7357b12396e1 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:58.708210 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588ed3d-7488-478e-8e75-7357b12396e1 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:58.708865 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588ed3d-7488-478e-8e75-7357b12396e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:58.729223 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-2588ed3d-7488-478e-8e75-7357b12396e1 None None] MFA Rules not processed for user `bc13934328e742f9a1a85d1c84ab83dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:03:58.730472 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-2588ed3d-7488-478e-8e75-7357b12396e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:03:58.742086 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 686/1371] 10.222.0.36 () {58 vars in 1058 bytes} [Wed Dec 15 16:03:58 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:03:58.751463 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddbaf0-22fc-4c34-8490-6ea471a21002 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:03:58.766735 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddbaf0-22fc-4c34-8490-6ea471a21002 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:03:58.773054 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab3435-9aa3-4322-a7ee-c30fae05e83e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:03:58.773743 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab3435-9aa3-4322-a7ee-c30fae05e83e service nova] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:03:58.774029 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab3435-9aa3-4322-a7ee-c30fae05e83e service nova] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:03:58.774322 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab3435-9aa3-4322-a7ee-c30fae05e83e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:03:58.784321 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab3435-9aa3-4322-a7ee-c30fae05e83e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:03:58.786258 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab3435-9aa3-4322-a7ee-c30fae05e83e service nova] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:03:58.795895 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 686/1372] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:03:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:04:01.010620 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca2790-6ca2-449b-a62b-a7e6cbfd50c6 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:01.011160 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca2790-6ca2-449b-a62b-a7e6cbfd50c6 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:01.011160 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca2790-6ca2-449b-a62b-a7e6cbfd50c6 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:01.012912 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 687/1373] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:04:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:04:01.018987 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0b43e-7775-4b1a-92ef-38eea7f5858c None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:01.019441 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0b43e-7775-4b1a-92ef-38eea7f5858c None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:01.019737 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0b43e-7775-4b1a-92ef-38eea7f5858c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:01.042664 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-40c0b43e-7775-4b1a-92ef-38eea7f5858c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:01.043872 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-40c0b43e-7775-4b1a-92ef-38eea7f5858c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:01.056151 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 687/1374] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:04:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:04:01.113829 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69266a-cdc0-430c-8b74-2e7bcb41fbc8 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:01.114111 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69266a-cdc0-430c-8b74-2e7bcb41fbc8 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:01.114582 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69266a-cdc0-430c-8b74-2e7bcb41fbc8 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:01.116322 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 688/1375] 10.222.0.36 () {54 vars in 963 bytes} [Wed Dec 15 16:04:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:04:01.121848 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63356ad-2999-42e3-9f18-f46354095f38 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:01.122139 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63356ad-2999-42e3-9f18-f46354095f38 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:01.122417 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63356ad-2999-42e3-9f18-f46354095f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:01.170711 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-e63356ad-2999-42e3-9f18-f46354095f38 None None] MFA Rules not processed for user `0d18ec9bcc0e481aa000833ec1c0988d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:01.172064 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-e63356ad-2999-42e3-9f18-f46354095f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:01.231763 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 688/1376] 10.222.0.36 () {58 vars in 1060 bytes} [Wed Dec 15 16:04:01 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:04:01.239796 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69266a-cdc0-430c-8b74-2e7bcb41fbc8 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:04:01.250562 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69266a-cdc0-430c-8b74-2e7bcb41fbc8 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:04:01.254143 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5552a-86d1-4407-a0e3-d0aea4f0a5ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:04:01.254775 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5552a-86d1-4407-a0e3-d0aea4f0a5ff service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:01.255053 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5552a-86d1-4407-a0e3-d0aea4f0a5ff service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:01.255506 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5552a-86d1-4407-a0e3-d0aea4f0a5ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:01.264905 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5552a-86d1-4407-a0e3-d0aea4f0a5ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:04:01.267143 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5552a-86d1-4407-a0e3-d0aea4f0a5ff service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:04:01.276914 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 689/1377] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:04:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:04:01.303430 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6ea1a-503a-4c17-ba07-3b9114268c40 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:01.303905 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6ea1a-503a-4c17-ba07-3b9114268c40 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:01.303989 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6ea1a-503a-4c17-ba07-3b9114268c40 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:01.306423 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 689/1378] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:04:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:04:01.317258 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb434501-a234-4b55-9966-e048484005e7 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:01.317258 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb434501-a234-4b55-9966-e048484005e7 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:01.317258 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb434501-a234-4b55-9966-e048484005e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:01.335816 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-cb434501-a234-4b55-9966-e048484005e7 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:01.337094 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-cb434501-a234-4b55-9966-e048484005e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:01.345889 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 690/1379] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:04:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:04:01.392973 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6ea1a-503a-4c17-ba07-3b9114268c40 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:04:01.407882 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6ea1a-503a-4c17-ba07-3b9114268c40 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:04:01.413662 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf749d-893c-4fd1-9588-ed6eb8050d41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:04:01.414296 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf749d-893c-4fd1-9588-ed6eb8050d41 service nova] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:01.414581 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf749d-893c-4fd1-9588-ed6eb8050d41 service nova] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:01.414855 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf749d-893c-4fd1-9588-ed6eb8050d41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:01.423842 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf749d-893c-4fd1-9588-ed6eb8050d41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:04:01.425468 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf749d-893c-4fd1-9588-ed6eb8050d41 service nova] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:04:01.435189 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 690/1380] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:04:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:04:03.873210 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1a17f-d4a9-4150-b79d-2dd5b58db2ee None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:03.873734 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1a17f-d4a9-4150-b79d-2dd5b58db2ee None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:03.873734 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1a17f-d4a9-4150-b79d-2dd5b58db2ee None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:03.875786 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 691/1381] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:04:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:04:03.881280 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13803bc3-fc88-4266-bc8d-9bbf802ab363 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:03.881708 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13803bc3-fc88-4266-bc8d-9bbf802ab363 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:03.881874 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13803bc3-fc88-4266-bc8d-9bbf802ab363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:03.899226 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-13803bc3-fc88-4266-bc8d-9bbf802ab363 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:03.900387 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-13803bc3-fc88-4266-bc8d-9bbf802ab363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:03.908683 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 691/1382] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:04:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:04:03.954700 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1a17f-d4a9-4150-b79d-2dd5b58db2ee None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:04:03.969469 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1a17f-d4a9-4150-b79d-2dd5b58db2ee None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:04:03.974762 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cde5b-65d2-464b-a83c-535eebb596a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:04:03.975382 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cde5b-65d2-464b-a83c-535eebb596a0 service nova] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:03.975690 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cde5b-65d2-464b-a83c-535eebb596a0 service nova] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:03.975962 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cde5b-65d2-464b-a83c-535eebb596a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:03.983740 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cde5b-65d2-464b-a83c-535eebb596a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:04:03.986001 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cde5b-65d2-464b-a83c-535eebb596a0 service nova] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:04:03.995321 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 692/1383] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:04:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:04:06.424653 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1c765-a8cc-42b3-bec8-f21c8b3c8685 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:06.425237 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1c765-a8cc-42b3-bec8-f21c8b3c8685 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:06.425237 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1c765-a8cc-42b3-bec8-f21c8b3c8685 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:06.426945 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 692/1384] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:04:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:04:06.432657 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fff18-87a6-4d8e-8fea-3ee2dbaef029 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:06.433084 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fff18-87a6-4d8e-8fea-3ee2dbaef029 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:06.433199 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fff18-87a6-4d8e-8fea-3ee2dbaef029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:06.451261 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-ee0fff18-87a6-4d8e-8fea-3ee2dbaef029 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:06.452441 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-ee0fff18-87a6-4d8e-8fea-3ee2dbaef029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:06.461441 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 693/1385] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:04:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:04:06.507621 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1c765-a8cc-42b3-bec8-f21c8b3c8685 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:04:06.522754 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1c765-a8cc-42b3-bec8-f21c8b3c8685 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:04:06.528370 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c1162-a659-4d74-b82e-d14fd916b145 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:04:06.529080 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c1162-a659-4d74-b82e-d14fd916b145 service nova] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:06.529622 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c1162-a659-4d74-b82e-d14fd916b145 service nova] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:06.529972 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c1162-a659-4d74-b82e-d14fd916b145 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:06.539613 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c1162-a659-4d74-b82e-d14fd916b145 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:04:06.541264 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c1162-a659-4d74-b82e-d14fd916b145 service nova] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:04:06.551223 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 693/1386] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:04:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:04:09.009310 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40db78f-a2eb-4cab-9213-56d6d84e5ae0 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:09.009921 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40db78f-a2eb-4cab-9213-56d6d84e5ae0 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:09.009921 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40db78f-a2eb-4cab-9213-56d6d84e5ae0 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:09.011782 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 694/1387] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:04:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:04:09.019019 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8debbeb-8686-4b78-9575-263735b287a6 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:09.019670 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8debbeb-8686-4b78-9575-263735b287a6 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:09.019786 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8debbeb-8686-4b78-9575-263735b287a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:09.044708 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-d8debbeb-8686-4b78-9575-263735b287a6 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:09.046006 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-d8debbeb-8686-4b78-9575-263735b287a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:09.055521 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 694/1388] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:04:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:04:09.117143 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40db78f-a2eb-4cab-9213-56d6d84e5ae0 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:04:09.136759 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40db78f-a2eb-4cab-9213-56d6d84e5ae0 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:04:09.144414 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bf3cf-b0c6-44ca-8827-92c51e816968 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:04:09.145327 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bf3cf-b0c6-44ca-8827-92c51e816968 service nova] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:09.145736 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bf3cf-b0c6-44ca-8827-92c51e816968 service nova] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:09.146126 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bf3cf-b0c6-44ca-8827-92c51e816968 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:09.159211 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487bf3cf-b0c6-44ca-8827-92c51e816968 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:04:09.161894 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487bf3cf-b0c6-44ca-8827-92c51e816968 service nova] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:04:09.177131 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 695/1389] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:04:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:04:11.869314 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf6ea8-d7ec-4a22-809a-ff91672d3177 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:11.869901 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf6ea8-d7ec-4a22-809a-ff91672d3177 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:11.869901 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf6ea8-d7ec-4a22-809a-ff91672d3177 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:11.871760 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 695/1390] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:04:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:04:11.878464 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c730e-f8f6-4623-a729-19d6acc6ae24 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:11.878939 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c730e-f8f6-4623-a729-19d6acc6ae24 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:11.879213 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c730e-f8f6-4623-a729-19d6acc6ae24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:11.902042 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-a89c730e-f8f6-4623-a729-19d6acc6ae24 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:11.903634 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-a89c730e-f8f6-4623-a729-19d6acc6ae24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:11.915436 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 696/1391] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:04:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:04:11.963153 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf6ea8-d7ec-4a22-809a-ff91672d3177 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:04:11.978240 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf6ea8-d7ec-4a22-809a-ff91672d3177 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:04:11.983958 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74792b3-de1c-4fac-a29f-53aaf6c65a42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:04:11.984880 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74792b3-de1c-4fac-a29f-53aaf6c65a42 service nova] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:11.985245 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74792b3-de1c-4fac-a29f-53aaf6c65a42 service nova] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:11.985641 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74792b3-de1c-4fac-a29f-53aaf6c65a42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:11.996470 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74792b3-de1c-4fac-a29f-53aaf6c65a42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:04:11.998623 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74792b3-de1c-4fac-a29f-53aaf6c65a42 service nova] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:04:12.010868 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 696/1392] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:04:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:04:14.499682 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6430866-788a-4d48-ab1a-aafca03cf597 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:14.500320 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6430866-788a-4d48-ab1a-aafca03cf597 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:14.500320 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6430866-788a-4d48-ab1a-aafca03cf597 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:14.502170 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 697/1393] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:04:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:04:14.507974 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012e132-323f-4551-9d4b-6dc38e008a68 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:14.508431 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012e132-323f-4551-9d4b-6dc38e008a68 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:14.508598 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012e132-323f-4551-9d4b-6dc38e008a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:14.525883 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-0012e132-323f-4551-9d4b-6dc38e008a68 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:14.527055 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-0012e132-323f-4551-9d4b-6dc38e008a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:14.535226 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 697/1394] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:04:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:04:14.580778 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6430866-788a-4d48-ab1a-aafca03cf597 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:04:14.595651 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6430866-788a-4d48-ab1a-aafca03cf597 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:04:14.601194 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dfeed-300c-4d80-93a5-984a52a42e5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:04:14.601855 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dfeed-300c-4d80-93a5-984a52a42e5e service nova] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:14.602156 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dfeed-300c-4d80-93a5-984a52a42e5e service nova] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:14.602490 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dfeed-300c-4d80-93a5-984a52a42e5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:14.611654 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dfeed-300c-4d80-93a5-984a52a42e5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:04:14.613242 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dfeed-300c-4d80-93a5-984a52a42e5e service nova] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:04:14.622631 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 698/1395] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:04:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:04:16.481256 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a097f9-b51e-4f41-9003-ef0be7a2ec4f None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:16.481891 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a097f9-b51e-4f41-9003-ef0be7a2ec4f None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:16.481891 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a097f9-b51e-4f41-9003-ef0be7a2ec4f None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:16.483614 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 698/1396] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:04:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:04:16.490292 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c59ef1-e970-4776-86bb-d61be2642728 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:16.490723 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c59ef1-e970-4776-86bb-d61be2642728 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:16.490874 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c59ef1-e970-4776-86bb-d61be2642728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:16.508857 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-04c59ef1-e970-4776-86bb-d61be2642728 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:16.510059 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-04c59ef1-e970-4776-86bb-d61be2642728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:16.518468 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 699/1397] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:04:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:04:16.578646 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945a147-3bf9-48e3-98ba-e3e555ff6905 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:16.579169 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945a147-3bf9-48e3-98ba-e3e555ff6905 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:16.579578 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945a147-3bf9-48e3-98ba-e3e555ff6905 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:16.581341 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 699/1398] 10.222.0.36 () {54 vars in 962 bytes} [Wed Dec 15 16:04:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:04:16.586996 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d3b08-3d38-4053-928b-19eb9399d3e6 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:16.587912 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d3b08-3d38-4053-928b-19eb9399d3e6 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:16.588195 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d3b08-3d38-4053-928b-19eb9399d3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:16.641237 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-f81d3b08-3d38-4053-928b-19eb9399d3e6 None None] MFA Rules not processed for user `9072bd35fdf046669c196133f485d334`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:16.642589 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-f81d3b08-3d38-4053-928b-19eb9399d3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:16.702158 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 700/1399] 10.222.0.36 () {58 vars in 1059 bytes} [Wed Dec 15 16:04:16 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:04:16.710751 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945a147-3bf9-48e3-98ba-e3e555ff6905 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:04:16.721756 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945a147-3bf9-48e3-98ba-e3e555ff6905 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:04:16.725203 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee30da9-c3c8-43bb-8d0a-d76be63e9ab6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9072bd35fdf046669c196133f485d334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:04:16.725862 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee30da9-c3c8-43bb-8d0a-d76be63e9ab6 service glance] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:16.726145 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee30da9-c3c8-43bb-8d0a-d76be63e9ab6 service glance] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:16.726418 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee30da9-c3c8-43bb-8d0a-d76be63e9ab6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:16.736119 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee30da9-c3c8-43bb-8d0a-d76be63e9ab6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:04:16.737502 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee30da9-c3c8-43bb-8d0a-d76be63e9ab6 service glance] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:04:16.746640 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 700/1400] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:04:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:04:17.010018 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695d42f-fbed-4438-986b-4bbfeadcfd33 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:17.010207 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695d42f-fbed-4438-986b-4bbfeadcfd33 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:17.010530 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695d42f-fbed-4438-986b-4bbfeadcfd33 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:17.012316 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 701/1401] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:04:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:04:17.018520 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ba324-3477-4969-8081-019c2428953d None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:17.018809 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ba324-3477-4969-8081-019c2428953d None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:17.019090 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ba324-3477-4969-8081-019c2428953d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:17.040217 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-252ba324-3477-4969-8081-019c2428953d None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:17.040217 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-252ba324-3477-4969-8081-019c2428953d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:17.054158 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 701/1402] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:04:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:04:17.097188 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695d42f-fbed-4438-986b-4bbfeadcfd33 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:04:17.112001 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695d42f-fbed-4438-986b-4bbfeadcfd33 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:04:17.117822 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45672b6-d2c6-4af5-b801-8c411e7dbff9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:04:17.118455 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45672b6-d2c6-4af5-b801-8c411e7dbff9 service nova] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:17.118737 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45672b6-d2c6-4af5-b801-8c411e7dbff9 service nova] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:17.119010 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45672b6-d2c6-4af5-b801-8c411e7dbff9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:17.127939 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45672b6-d2c6-4af5-b801-8c411e7dbff9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:04:17.129549 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45672b6-d2c6-4af5-b801-8c411e7dbff9 service nova] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:04:17.139239 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 702/1403] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:04:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:04:17.186861 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114d1b7-ad4d-4165-ab8f-582a20b2ab2d None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:17.187149 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114d1b7-ad4d-4165-ab8f-582a20b2ab2d None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:17.187418 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114d1b7-ad4d-4165-ab8f-582a20b2ab2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:17.245805 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-e114d1b7-ad4d-4165-ab8f-582a20b2ab2d None None] MFA Rules not processed for user `b2f47cbf62d44a6ba7e6a6f0f2305630`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:17.247386 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-e114d1b7-ad4d-4165-ab8f-582a20b2ab2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:17.315403 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 702/1404] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Dec 15 16:04:17 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:04:17.360561 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397682e-3fe6-4f64-92bf-79df5984dd62 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:17.361504 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397682e-3fe6-4f64-92bf-79df5984dd62 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:17.361504 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397682e-3fe6-4f64-92bf-79df5984dd62 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:17.363751 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 703/1405] 10.222.0.36 () {54 vars in 942 bytes} [Wed Dec 15 16:04:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:04:17.371781 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01a61b-1f9d-41eb-9d7e-aab7fa031283 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:17.372149 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01a61b-1f9d-41eb-9d7e-aab7fa031283 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:17.372435 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01a61b-1f9d-41eb-9d7e-aab7fa031283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:17.423940 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-7d01a61b-1f9d-41eb-9d7e-aab7fa031283 None None] MFA Rules not processed for user `5e3f652f76424e27a1d4329212d9b66d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:17.425125 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-7d01a61b-1f9d-41eb-9d7e-aab7fa031283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:17.493348 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 703/1406] 10.222.0.36 () {58 vars in 1039 bytes} [Wed Dec 15 16:04:17 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:04:17.502998 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397682e-3fe6-4f64-92bf-79df5984dd62 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:04:17.516062 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397682e-3fe6-4f64-92bf-79df5984dd62 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:04:17.520896 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac4d94-810c-43fe-94fd-61e7e4907457 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e3f652f76424e27a1d4329212d9b66d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:04:17.521706 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac4d94-810c-43fe-94fd-61e7e4907457 service swift] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:17.521989 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac4d94-810c-43fe-94fd-61e7e4907457 service swift] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:17.522264 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac4d94-810c-43fe-94fd-61e7e4907457 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:17.530580 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac4d94-810c-43fe-94fd-61e7e4907457 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:04:17.532772 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac4d94-810c-43fe-94fd-61e7e4907457 service swift] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:04:17.542829 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 704/1407] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Dec 15 16:04:17 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:04:19.611171 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f76c3b-fc33-4ac2-a36b-4f947432dbad None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:19.611818 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f76c3b-fc33-4ac2-a36b-4f947432dbad None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:19.611818 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f76c3b-fc33-4ac2-a36b-4f947432dbad None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:19.617745 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 704/1408] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:04:19 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:04:19.619211 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc7070-7616-4d94-a706-cb23a0caaa19 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:19.619623 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc7070-7616-4d94-a706-cb23a0caaa19 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:19.619817 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc7070-7616-4d94-a706-cb23a0caaa19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:19.637727 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-aacc7070-7616-4d94-a706-cb23a0caaa19 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:19.638978 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-aacc7070-7616-4d94-a706-cb23a0caaa19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:19.647751 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 705/1409] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:04:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:04:19.695716 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f76c3b-fc33-4ac2-a36b-4f947432dbad None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:04:19.715083 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f76c3b-fc33-4ac2-a36b-4f947432dbad None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:04:19.721789 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46100e-95b6-461c-9012-13501b24b91e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:04:19.722429 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46100e-95b6-461c-9012-13501b24b91e service nova] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:19.722708 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46100e-95b6-461c-9012-13501b24b91e service nova] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:19.722981 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46100e-95b6-461c-9012-13501b24b91e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:19.732107 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46100e-95b6-461c-9012-13501b24b91e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:04:19.733722 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46100e-95b6-461c-9012-13501b24b91e service nova] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:04:19.754379 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 705/1410] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:04:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:04:22.224346 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8b009-74a1-4488-b927-8f25922e58e3 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:22.224941 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8b009-74a1-4488-b927-8f25922e58e3 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:22.224941 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8b009-74a1-4488-b927-8f25922e58e3 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:22.226672 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 706/1411] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:04:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:04:22.232326 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072ca0a-4cef-4d42-9c78-b0c95281ca53 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:22.232776 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072ca0a-4cef-4d42-9c78-b0c95281ca53 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:22.232866 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072ca0a-4cef-4d42-9c78-b0c95281ca53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:22.252126 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-d072ca0a-4cef-4d42-9c78-b0c95281ca53 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:22.253330 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-d072ca0a-4cef-4d42-9c78-b0c95281ca53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:22.261338 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 706/1412] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:04:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:04:22.309978 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8b009-74a1-4488-b927-8f25922e58e3 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:04:22.325368 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8b009-74a1-4488-b927-8f25922e58e3 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:04:22.331784 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1b4da-740a-4140-950b-98f38a6af70c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:04:22.332442 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1b4da-740a-4140-950b-98f38a6af70c service nova] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:22.332841 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1b4da-740a-4140-950b-98f38a6af70c service nova] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:22.333123 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1b4da-740a-4140-950b-98f38a6af70c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:22.342359 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1b4da-740a-4140-950b-98f38a6af70c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:04:22.343996 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1b4da-740a-4140-950b-98f38a6af70c service nova] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:04:22.354771 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 707/1413] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:04:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:04:40.232704 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420f2b8-341f-40fb-9d8d-c2ecf2906874 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:40.233240 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420f2b8-341f-40fb-9d8d-c2ecf2906874 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:40.233240 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420f2b8-341f-40fb-9d8d-c2ecf2906874 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:40.235026 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 707/1414] 10.222.0.36 () {54 vars in 918 bytes} [Wed Dec 15 16:04:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:04:40.241776 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03be30-b281-432f-8bb2-2eb3e789332e None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:40.242188 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03be30-b281-432f-8bb2-2eb3e789332e None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:40.242329 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03be30-b281-432f-8bb2-2eb3e789332e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:40.260507 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-bc03be30-b281-432f-8bb2-2eb3e789332e None None] MFA Rules not processed for user `e186d6728a2341399252238c559002f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:40.261787 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-bc03be30-b281-432f-8bb2-2eb3e789332e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:40.270377 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 708/1415] 10.222.0.36 () {58 vars in 1015 bytes} [Wed Dec 15 16:04:40 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:04:40.285023 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364a4fe-1bd8-4d99-9d23-b9a8bf773d48 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:40.285318 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364a4fe-1bd8-4d99-9d23-b9a8bf773d48 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:40.285631 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364a4fe-1bd8-4d99-9d23-b9a8bf773d48 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:40.287617 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 708/1416] 10.222.0.36 () {54 vars in 918 bytes} [Wed Dec 15 16:04:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:04:40.292820 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af279b5f-b3b7-46ac-aaaa-2c7a9a756bb7 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:40.293051 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af279b5f-b3b7-46ac-aaaa-2c7a9a756bb7 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:40.293325 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af279b5f-b3b7-46ac-aaaa-2c7a9a756bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:40.311822 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-af279b5f-b3b7-46ac-aaaa-2c7a9a756bb7 None None] MFA Rules not processed for user `bc13934328e742f9a1a85d1c84ab83dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:40.312990 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-af279b5f-b3b7-46ac-aaaa-2c7a9a756bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:40.322757 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 709/1417] 10.222.0.36 () {58 vars in 1015 bytes} [Wed Dec 15 16:04:40 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:04:43.065252 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f5958-b20d-4fb6-afc0-c6977908f523 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:43.065847 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f5958-b20d-4fb6-afc0-c6977908f523 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:43.065847 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f5958-b20d-4fb6-afc0-c6977908f523 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:43.067577 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 709/1418] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:04:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:04:43.073511 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87448c-0399-4dc9-a920-62ab4ca0ad42 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:43.073977 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87448c-0399-4dc9-a920-62ab4ca0ad42 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:43.074197 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87448c-0399-4dc9-a920-62ab4ca0ad42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:43.091616 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-6d87448c-0399-4dc9-a920-62ab4ca0ad42 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:43.092821 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-6d87448c-0399-4dc9-a920-62ab4ca0ad42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:43.101229 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 710/1419] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:04:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:04:43.148721 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f5958-b20d-4fb6-afc0-c6977908f523 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:04:43.164498 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f5958-b20d-4fb6-afc0-c6977908f523 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:04:43.169856 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa08a1-f068-450a-9ddf-750f59775428 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:04:43.170489 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa08a1-f068-450a-9ddf-750f59775428 service nova] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:43.170771 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa08a1-f068-450a-9ddf-750f59775428 service nova] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:43.171047 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa08a1-f068-450a-9ddf-750f59775428 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:43.179374 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa08a1-f068-450a-9ddf-750f59775428 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:04:43.180956 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa08a1-f068-450a-9ddf-750f59775428 service nova] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:04:43.190209 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 710/1420] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:04:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:04:44.763660 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2acec-946a-4bd4-b53e-653fb8ee1cea None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:44.764202 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2acec-946a-4bd4-b53e-653fb8ee1cea None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:44.764202 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2acec-946a-4bd4-b53e-653fb8ee1cea None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:44.765975 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 711/1421] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 16:04:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:04:44.771482 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ae819-45a3-4dde-b298-e4e9774fbfa2 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:44.771909 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ae819-45a3-4dde-b298-e4e9774fbfa2 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:44.772048 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ae819-45a3-4dde-b298-e4e9774fbfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:44.790535 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-c01ae819-45a3-4dde-b298-e4e9774fbfa2 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:44.791720 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c01ae819-45a3-4dde-b298-e4e9774fbfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:44.799998 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 711/1422] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 16:04:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:04:44.952451 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2acec-946a-4bd4-b53e-653fb8ee1cea None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:04:44.966407 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2acec-946a-4bd4-b53e-653fb8ee1cea None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:04:44.971990 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e4112-044d-43e4-89bc-1035fe766399 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:04:44.972607 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e4112-044d-43e4-89bc-1035fe766399 service nova] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:44.972890 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e4112-044d-43e4-89bc-1035fe766399 service nova] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:44.973164 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e4112-044d-43e4-89bc-1035fe766399 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:44.981092 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e4112-044d-43e4-89bc-1035fe766399 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:04:44.982727 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e4112-044d-43e4-89bc-1035fe766399 service nova] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:04:44.992481 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 712/1423] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:04:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:04:46.534271 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b52d7-efd1-4657-98b4-1a1bc998661c None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:46.534880 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b52d7-efd1-4657-98b4-1a1bc998661c None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:46.534880 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b52d7-efd1-4657-98b4-1a1bc998661c None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:46.536570 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 712/1424] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 16:04:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:04:46.542426 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fa677-4d8a-496e-a16e-0df9e6eec817 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:46.542903 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fa677-4d8a-496e-a16e-0df9e6eec817 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:46.543019 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fa677-4d8a-496e-a16e-0df9e6eec817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:46.561242 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-9c3fa677-4d8a-496e-a16e-0df9e6eec817 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:46.562453 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-9c3fa677-4d8a-496e-a16e-0df9e6eec817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:46.570249 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 713/1425] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 16:04:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:04:46.724977 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b52d7-efd1-4657-98b4-1a1bc998661c None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:04:46.739726 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b52d7-efd1-4657-98b4-1a1bc998661c None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:04:46.744992 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d10a8-bae7-4b9c-842b-c41c8c8ddfc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:04:46.745676 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d10a8-bae7-4b9c-842b-c41c8c8ddfc6 service nova] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:46.745957 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d10a8-bae7-4b9c-842b-c41c8c8ddfc6 service nova] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:46.746229 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d10a8-bae7-4b9c-842b-c41c8c8ddfc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:46.754093 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d10a8-bae7-4b9c-842b-c41c8c8ddfc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:04:46.755667 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d10a8-bae7-4b9c-842b-c41c8c8ddfc6 service nova] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:04:46.764571 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 713/1426] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:04:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:04:48.270025 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c59e7f-5804-49ad-a7f9-adb9a6f745e3 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:48.270590 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c59e7f-5804-49ad-a7f9-adb9a6f745e3 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:48.270590 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c59e7f-5804-49ad-a7f9-adb9a6f745e3 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:48.272305 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 714/1427] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 16:04:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:04:48.277845 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f99db-5e4a-4f9b-8350-56df2647b12a None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:48.278272 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f99db-5e4a-4f9b-8350-56df2647b12a None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:48.278385 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f99db-5e4a-4f9b-8350-56df2647b12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:48.296329 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-a19f99db-5e4a-4f9b-8350-56df2647b12a None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:48.297475 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-a19f99db-5e4a-4f9b-8350-56df2647b12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:48.305132 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 714/1428] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 16:04:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:04:48.457942 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c59e7f-5804-49ad-a7f9-adb9a6f745e3 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:04:48.472485 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c59e7f-5804-49ad-a7f9-adb9a6f745e3 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:04:48.477860 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baceac5-1b3e-433e-b506-fc5346ffecf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:04:48.478487 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baceac5-1b3e-433e-b506-fc5346ffecf6 service nova] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:48.478769 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baceac5-1b3e-433e-b506-fc5346ffecf6 service nova] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:48.479048 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baceac5-1b3e-433e-b506-fc5346ffecf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:48.488476 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baceac5-1b3e-433e-b506-fc5346ffecf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:04:48.490095 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baceac5-1b3e-433e-b506-fc5346ffecf6 service nova] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:04:48.499255 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 715/1429] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:04:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:04:50.026773 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d2e99-27c8-4348-9dfb-c3bd6d1641e3 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:50.027351 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d2e99-27c8-4348-9dfb-c3bd6d1641e3 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:50.027351 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d2e99-27c8-4348-9dfb-c3bd6d1641e3 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:50.029098 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 715/1430] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 16:04:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:04:50.039079 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63879c59-4274-4e2d-bc22-eb00c22dbc15 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:50.039577 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63879c59-4274-4e2d-bc22-eb00c22dbc15 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:50.039699 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63879c59-4274-4e2d-bc22-eb00c22dbc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:50.057988 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-63879c59-4274-4e2d-bc22-eb00c22dbc15 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:50.059188 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-63879c59-4274-4e2d-bc22-eb00c22dbc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:50.067384 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 716/1431] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 16:04:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:04:50.224316 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d2e99-27c8-4348-9dfb-c3bd6d1641e3 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:04:50.238167 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d2e99-27c8-4348-9dfb-c3bd6d1641e3 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:04:50.243417 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39146b80-134d-4fbb-8955-c704632708e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:04:50.244038 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39146b80-134d-4fbb-8955-c704632708e4 service nova] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:50.244316 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39146b80-134d-4fbb-8955-c704632708e4 service nova] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:50.244589 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39146b80-134d-4fbb-8955-c704632708e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:50.252963 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39146b80-134d-4fbb-8955-c704632708e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:04:50.254555 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39146b80-134d-4fbb-8955-c704632708e4 service nova] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:04:50.263456 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 716/1432] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:04:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:04:51.727118 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0e760-7d88-45e9-9247-98ce6a3a82ea None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:51.727639 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0e760-7d88-45e9-9247-98ce6a3a82ea None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:51.727639 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0e760-7d88-45e9-9247-98ce6a3a82ea None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:51.729376 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 717/1433] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 16:04:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:04:51.734795 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3bb7a-1765-4c5f-9917-acbf42ab25db None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:51.735221 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3bb7a-1765-4c5f-9917-acbf42ab25db None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:51.735423 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3bb7a-1765-4c5f-9917-acbf42ab25db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:51.753475 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-eac3bb7a-1765-4c5f-9917-acbf42ab25db None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:51.754656 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-eac3bb7a-1765-4c5f-9917-acbf42ab25db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:51.762204 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 717/1434] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 16:04:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:04:51.913612 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0e760-7d88-45e9-9247-98ce6a3a82ea None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:04:51.927959 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0e760-7d88-45e9-9247-98ce6a3a82ea None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:04:51.933239 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa5830-5948-4fb8-9033-0255978939db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:04:51.933890 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa5830-5948-4fb8-9033-0255978939db service nova] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:51.934175 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa5830-5948-4fb8-9033-0255978939db service nova] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:51.934451 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa5830-5948-4fb8-9033-0255978939db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:51.943070 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa5830-5948-4fb8-9033-0255978939db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:04:51.944651 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa5830-5948-4fb8-9033-0255978939db service nova] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:04:51.953708 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 718/1435] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:04:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:04:53.453167 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66da1b-2b5b-4638-a8a1-b858e006b416 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:53.453752 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66da1b-2b5b-4638-a8a1-b858e006b416 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:53.453752 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66da1b-2b5b-4638-a8a1-b858e006b416 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:53.455648 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 718/1436] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 16:04:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:04:53.461097 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674627d7-4739-44a9-81fa-68be2c3457b6 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:53.461572 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674627d7-4739-44a9-81fa-68be2c3457b6 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:53.461677 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674627d7-4739-44a9-81fa-68be2c3457b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:53.479672 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-674627d7-4739-44a9-81fa-68be2c3457b6 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:53.480844 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-674627d7-4739-44a9-81fa-68be2c3457b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:53.489151 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 719/1437] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 16:04:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:04:53.640063 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66da1b-2b5b-4638-a8a1-b858e006b416 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:04:53.654465 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66da1b-2b5b-4638-a8a1-b858e006b416 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:04:53.660370 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3f363-0e79-4c41-abee-b585ec5baf6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:04:53.660983 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3f363-0e79-4c41-abee-b585ec5baf6e service nova] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:53.661264 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3f363-0e79-4c41-abee-b585ec5baf6e service nova] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:53.661570 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3f363-0e79-4c41-abee-b585ec5baf6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:53.669655 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3f363-0e79-4c41-abee-b585ec5baf6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:04:53.671221 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3f363-0e79-4c41-abee-b585ec5baf6e service nova] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:04:53.680196 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 719/1438] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:04:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:04:55.142481 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e97b5c-4d6b-4ae0-9a3e-27324db07645 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:55.143563 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e97b5c-4d6b-4ae0-9a3e-27324db07645 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:55.143563 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e97b5c-4d6b-4ae0-9a3e-27324db07645 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:55.145290 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 720/1439] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 16:04:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:04:55.150790 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b410020-21af-4b19-91ec-62c3adcd2aec None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:55.151191 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b410020-21af-4b19-91ec-62c3adcd2aec None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:55.151371 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b410020-21af-4b19-91ec-62c3adcd2aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:55.169278 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-5b410020-21af-4b19-91ec-62c3adcd2aec None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:55.170503 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-5b410020-21af-4b19-91ec-62c3adcd2aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:55.179133 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 720/1440] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 16:04:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:04:55.335357 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e97b5c-4d6b-4ae0-9a3e-27324db07645 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:04:55.349920 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e97b5c-4d6b-4ae0-9a3e-27324db07645 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:04:55.355242 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0e752-d141-476b-9071-30f339b9be90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:04:55.355878 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0e752-d141-476b-9071-30f339b9be90 service nova] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:55.356140 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0e752-d141-476b-9071-30f339b9be90 service nova] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:55.356412 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0e752-d141-476b-9071-30f339b9be90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:55.364669 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0e752-d141-476b-9071-30f339b9be90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:04:55.366344 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0e752-d141-476b-9071-30f339b9be90 service nova] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:04:55.375444 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 721/1441] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:04:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:04:56.837769 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ae0de-3102-4a59-ae26-a8e2fcb89dec None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:56.838378 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ae0de-3102-4a59-ae26-a8e2fcb89dec None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:56.838378 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ae0de-3102-4a59-ae26-a8e2fcb89dec None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:56.840195 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 721/1442] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 16:04:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:04:56.846382 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5be8c7-592e-417d-a421-59f6ff4c69dc None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:56.846865 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5be8c7-592e-417d-a421-59f6ff4c69dc None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:56.847191 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5be8c7-592e-417d-a421-59f6ff4c69dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:56.865346 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-9b5be8c7-592e-417d-a421-59f6ff4c69dc None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:56.866551 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-9b5be8c7-592e-417d-a421-59f6ff4c69dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:56.874151 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 722/1443] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 16:04:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:04:57.027650 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ae0de-3102-4a59-ae26-a8e2fcb89dec None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:04:57.042248 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ae0de-3102-4a59-ae26-a8e2fcb89dec None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:04:57.047670 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10871701-f11f-43fb-8279-19dbe23e1577 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:04:57.048296 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10871701-f11f-43fb-8279-19dbe23e1577 service nova] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:57.048575 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10871701-f11f-43fb-8279-19dbe23e1577 service nova] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:57.049440 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10871701-f11f-43fb-8279-19dbe23e1577 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:57.057630 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10871701-f11f-43fb-8279-19dbe23e1577 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:04:57.059193 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10871701-f11f-43fb-8279-19dbe23e1577 service nova] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:04:57.068416 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 722/1444] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:04:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:04:59.291163 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a198a-9568-42c0-8177-b9abbaa8fdb9 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:59.291723 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a198a-9568-42c0-8177-b9abbaa8fdb9 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:59.291723 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a198a-9568-42c0-8177-b9abbaa8fdb9 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:59.293523 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 723/1445] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:04:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:04:59.300018 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb731f6-893d-41e4-a30b-225d904bd6d7 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:59.300468 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb731f6-893d-41e4-a30b-225d904bd6d7 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:59.300572 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb731f6-893d-41e4-a30b-225d904bd6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:59.317888 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-9fb731f6-893d-41e4-a30b-225d904bd6d7 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:04:59.319058 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-9fb731f6-893d-41e4-a30b-225d904bd6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:04:59.326576 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 723/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:04:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:04:59.367295 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a198a-9568-42c0-8177-b9abbaa8fdb9 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:04:59.378679 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a198a-9568-42c0-8177-b9abbaa8fdb9 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:04:59.382213 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944dc69-dddb-4b1d-a4a7-eb1460d1be22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:04:59.382839 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944dc69-dddb-4b1d-a4a7-eb1460d1be22 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:04:59.383125 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944dc69-dddb-4b1d-a4a7-eb1460d1be22 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:04:59.383402 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944dc69-dddb-4b1d-a4a7-eb1460d1be22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:04:59.392406 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944dc69-dddb-4b1d-a4a7-eb1460d1be22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:04:59.394463 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944dc69-dddb-4b1d-a4a7-eb1460d1be22 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:04:59.403888 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 724/1447] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:04:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:05:01.888989 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1022380-4369-4b20-97a0-2569de1eb18e None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:01.889590 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1022380-4369-4b20-97a0-2569de1eb18e None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:01.889590 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1022380-4369-4b20-97a0-2569de1eb18e None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:01.891326 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 724/1448] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:05:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:05:01.897329 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53f908-a86a-49d8-8c7e-2ceb9920e878 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:01.897749 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53f908-a86a-49d8-8c7e-2ceb9920e878 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:01.897913 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53f908-a86a-49d8-8c7e-2ceb9920e878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:01.915445 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-3f53f908-a86a-49d8-8c7e-2ceb9920e878 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:05:01.916619 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-3f53f908-a86a-49d8-8c7e-2ceb9920e878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:05:01.924815 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 725/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:05:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:05:01.964009 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1022380-4369-4b20-97a0-2569de1eb18e None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:05:01.974264 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1022380-4369-4b20-97a0-2569de1eb18e None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:05:01.977683 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be76d67-e185-4e05-82aa-801705c0031c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:05:01.978297 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be76d67-e185-4e05-82aa-801705c0031c service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:01.978575 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be76d67-e185-4e05-82aa-801705c0031c service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:01.978845 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be76d67-e185-4e05-82aa-801705c0031c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:01.987827 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be76d67-e185-4e05-82aa-801705c0031c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:05:01.989233 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be76d67-e185-4e05-82aa-801705c0031c service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:05:01.998177 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 725/1450] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:05:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:05:04.740113 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606c932-d894-42b2-9709-8e9a8360cdbf None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:04.740686 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606c932-d894-42b2-9709-8e9a8360cdbf None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:04.740686 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606c932-d894-42b2-9709-8e9a8360cdbf None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:04.742458 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 726/1451] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:05:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:05:04.748350 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370db8b-7a1d-4168-b681-8bbee83c6e75 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:04.748762 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370db8b-7a1d-4168-b681-8bbee83c6e75 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:04.748945 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370db8b-7a1d-4168-b681-8bbee83c6e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:04.767122 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-1370db8b-7a1d-4168-b681-8bbee83c6e75 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:05:04.769073 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-1370db8b-7a1d-4168-b681-8bbee83c6e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:05:04.776691 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 726/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:05:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:05:04.816722 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606c932-d894-42b2-9709-8e9a8360cdbf None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:05:04.827238 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606c932-d894-42b2-9709-8e9a8360cdbf None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:05:04.831306 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8517d86-7825-473c-9f12-4b4ee220de8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:05:04.831932 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8517d86-7825-473c-9f12-4b4ee220de8b service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:04.832214 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8517d86-7825-473c-9f12-4b4ee220de8b service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:04.832489 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8517d86-7825-473c-9f12-4b4ee220de8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:04.841271 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8517d86-7825-473c-9f12-4b4ee220de8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:05:04.842887 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8517d86-7825-473c-9f12-4b4ee220de8b service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:05:04.852033 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 727/1453] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:05:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:05:07.319877 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b5af1-25a3-401b-8684-a6e92979731f None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:07.320402 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b5af1-25a3-401b-8684-a6e92979731f None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:07.320499 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b5af1-25a3-401b-8684-a6e92979731f None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:07.322294 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 727/1454] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:05:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:05:07.328162 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd9dba-6389-435d-9012-856da05f7375 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:07.328580 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd9dba-6389-435d-9012-856da05f7375 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:07.328722 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd9dba-6389-435d-9012-856da05f7375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:07.354611 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-73bd9dba-6389-435d-9012-856da05f7375 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:05:07.355845 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-73bd9dba-6389-435d-9012-856da05f7375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:05:07.364165 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 728/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:05:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:05:07.405674 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b5af1-25a3-401b-8684-a6e92979731f None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:05:07.416882 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b5af1-25a3-401b-8684-a6e92979731f None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:05:07.420286 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8d0e8-7551-4bdb-a9e0-af4383163631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:05:07.420903 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8d0e8-7551-4bdb-a9e0-af4383163631 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:07.421180 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8d0e8-7551-4bdb-a9e0-af4383163631 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:07.421498 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8d0e8-7551-4bdb-a9e0-af4383163631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:07.430401 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a8d0e8-7551-4bdb-a9e0-af4383163631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:05:07.431829 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a8d0e8-7551-4bdb-a9e0-af4383163631 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:05:07.441159 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 728/1456] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:05:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:05:10.005923 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42af60c-6be3-4933-8adf-a74678f01329 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:10.006519 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42af60c-6be3-4933-8adf-a74678f01329 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:10.006519 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42af60c-6be3-4933-8adf-a74678f01329 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:10.008209 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 729/1457] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:05:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:05:10.014189 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5fb45-fa3e-4c38-82e8-f2494d90ebd8 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:10.014581 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5fb45-fa3e-4c38-82e8-f2494d90ebd8 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:10.014741 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5fb45-fa3e-4c38-82e8-f2494d90ebd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:10.032188 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-29c5fb45-fa3e-4c38-82e8-f2494d90ebd8 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:05:10.033417 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-29c5fb45-fa3e-4c38-82e8-f2494d90ebd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:05:10.043076 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 729/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:05:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:05:10.082221 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42af60c-6be3-4933-8adf-a74678f01329 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:05:10.092707 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42af60c-6be3-4933-8adf-a74678f01329 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:05:10.096696 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd32b35-a771-4579-a4cb-a3fc98910816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:05:10.097319 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd32b35-a771-4579-a4cb-a3fc98910816 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:10.097631 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd32b35-a771-4579-a4cb-a3fc98910816 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:10.097907 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd32b35-a771-4579-a4cb-a3fc98910816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:10.106569 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd32b35-a771-4579-a4cb-a3fc98910816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:05:10.108009 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd32b35-a771-4579-a4cb-a3fc98910816 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:05:10.117738 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 730/1459] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:05:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:05:12.528356 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc37da-ca0a-4499-84a4-09c63f03130e None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:12.528917 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc37da-ca0a-4499-84a4-09c63f03130e None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:12.528917 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc37da-ca0a-4499-84a4-09c63f03130e None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:12.530701 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 730/1460] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:05:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:05:12.536742 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60314203-fe2e-45ce-88e5-a062d5f2346a None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:12.537186 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60314203-fe2e-45ce-88e5-a062d5f2346a None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:12.537291 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60314203-fe2e-45ce-88e5-a062d5f2346a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:12.556263 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-60314203-fe2e-45ce-88e5-a062d5f2346a None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:05:12.557473 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-60314203-fe2e-45ce-88e5-a062d5f2346a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:05:12.566017 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 731/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:05:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:05:12.604199 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc37da-ca0a-4499-84a4-09c63f03130e None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:05:12.615970 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc37da-ca0a-4499-84a4-09c63f03130e None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:05:12.619500 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a41cf1-03a9-4c4e-b03b-703907f925b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:05:12.620132 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a41cf1-03a9-4c4e-b03b-703907f925b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:12.620415 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a41cf1-03a9-4c4e-b03b-703907f925b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:12.620687 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a41cf1-03a9-4c4e-b03b-703907f925b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:12.630174 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a41cf1-03a9-4c4e-b03b-703907f925b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:05:12.631608 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a41cf1-03a9-4c4e-b03b-703907f925b8 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:05:12.640604 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 731/1462] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:05:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:05:15.102724 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2a5b9-7453-4407-96e1-f5ef79b74e96 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:15.103297 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2a5b9-7453-4407-96e1-f5ef79b74e96 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:15.103297 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2a5b9-7453-4407-96e1-f5ef79b74e96 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:15.105025 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 732/1463] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:05:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:05:15.110866 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cc10c-4a77-4aef-a36a-c5d621c4690c None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:15.111264 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cc10c-4a77-4aef-a36a-c5d621c4690c None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:15.111443 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cc10c-4a77-4aef-a36a-c5d621c4690c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:15.134559 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-be1cc10c-4a77-4aef-a36a-c5d621c4690c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:05:15.135773 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-be1cc10c-4a77-4aef-a36a-c5d621c4690c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:05:15.146731 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 732/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:05:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:05:15.186865 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2a5b9-7453-4407-96e1-f5ef79b74e96 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:05:15.197489 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2a5b9-7453-4407-96e1-f5ef79b74e96 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:05:15.200953 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2f534-116d-4943-99f8-7de02d7f35d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:05:15.201606 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2f534-116d-4943-99f8-7de02d7f35d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:15.201888 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2f534-116d-4943-99f8-7de02d7f35d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:15.202163 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2f534-116d-4943-99f8-7de02d7f35d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:15.210947 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2f534-116d-4943-99f8-7de02d7f35d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:05:15.212377 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2f534-116d-4943-99f8-7de02d7f35d8 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:05:15.222134 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 733/1465] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:05:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:05:17.665724 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0af0e7-2e14-401d-b8dd-42dde0eb3f90 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:17.666250 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0af0e7-2e14-401d-b8dd-42dde0eb3f90 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:17.666250 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0af0e7-2e14-401d-b8dd-42dde0eb3f90 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:17.667990 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 733/1466] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:05:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:05:17.674021 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d582db-50eb-441d-b318-bdfd87d6063f None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:17.674430 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d582db-50eb-441d-b318-bdfd87d6063f None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:17.675152 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d582db-50eb-441d-b318-bdfd87d6063f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:17.693212 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-66d582db-50eb-441d-b318-bdfd87d6063f None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:05:17.694433 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-66d582db-50eb-441d-b318-bdfd87d6063f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:05:17.703201 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 734/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:05:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:05:17.745196 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0af0e7-2e14-401d-b8dd-42dde0eb3f90 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:05:17.756292 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0af0e7-2e14-401d-b8dd-42dde0eb3f90 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:05:17.759773 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6770ec-99d1-4018-a971-c77eb9bbba09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:05:17.760474 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6770ec-99d1-4018-a971-c77eb9bbba09 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:17.760758 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6770ec-99d1-4018-a971-c77eb9bbba09 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:17.761030 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6770ec-99d1-4018-a971-c77eb9bbba09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:17.769764 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6770ec-99d1-4018-a971-c77eb9bbba09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:05:17.771171 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6770ec-99d1-4018-a971-c77eb9bbba09 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:05:17.780129 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 734/1468] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:05:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:05:20.147823 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5df6b-c22a-448f-8882-e422d173337c None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:20.148379 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5df6b-c22a-448f-8882-e422d173337c None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:20.148379 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5df6b-c22a-448f-8882-e422d173337c None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:20.150201 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 735/1469] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:05:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:05:20.156191 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96819dea-662e-4bd6-9da6-d0f97089bf00 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:20.156633 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96819dea-662e-4bd6-9da6-d0f97089bf00 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:20.156751 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96819dea-662e-4bd6-9da6-d0f97089bf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:20.174210 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-96819dea-662e-4bd6-9da6-d0f97089bf00 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:05:20.176011 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-96819dea-662e-4bd6-9da6-d0f97089bf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:05:20.184384 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 735/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:05:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:05:20.222088 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5df6b-c22a-448f-8882-e422d173337c None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:05:20.232709 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5df6b-c22a-448f-8882-e422d173337c None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:05:20.236200 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b1d0a-8ee0-42c1-98a7-f5487f2b01f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:05:20.236875 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b1d0a-8ee0-42c1-98a7-f5487f2b01f2 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:20.237677 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b1d0a-8ee0-42c1-98a7-f5487f2b01f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:20.237948 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b1d0a-8ee0-42c1-98a7-f5487f2b01f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:20.246542 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b1d0a-8ee0-42c1-98a7-f5487f2b01f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:05:20.247956 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b1d0a-8ee0-42c1-98a7-f5487f2b01f2 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:05:20.257834 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 736/1471] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:05:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:05:22.623726 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d11aa1-c758-4b42-a0b6-d24ebbbfae68 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:22.624308 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d11aa1-c758-4b42-a0b6-d24ebbbfae68 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:22.624308 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d11aa1-c758-4b42-a0b6-d24ebbbfae68 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:22.626045 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 736/1472] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:05:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:05:22.632605 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f2532-fba1-4883-a741-4143d5008112 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:22.633028 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f2532-fba1-4883-a741-4143d5008112 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:22.633164 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f2532-fba1-4883-a741-4143d5008112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:22.651101 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-d76f2532-fba1-4883-a741-4143d5008112 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:05:22.652320 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-d76f2532-fba1-4883-a741-4143d5008112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:05:22.659971 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 737/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:05:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:05:22.700560 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d11aa1-c758-4b42-a0b6-d24ebbbfae68 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:05:22.714405 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d11aa1-c758-4b42-a0b6-d24ebbbfae68 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:05:22.717795 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b1837-e3f6-43b5-888f-d585c9a81493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:05:22.718423 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b1837-e3f6-43b5-888f-d585c9a81493 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:22.718702 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b1837-e3f6-43b5-888f-d585c9a81493 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:22.718974 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b1837-e3f6-43b5-888f-d585c9a81493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:22.727926 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b1837-e3f6-43b5-888f-d585c9a81493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:05:22.729348 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b1837-e3f6-43b5-888f-d585c9a81493 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:05:22.738542 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 737/1474] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:05:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:05:41.011063 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683f341-f25a-4373-891d-f8304e3ab56a None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:41.011659 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683f341-f25a-4373-891d-f8304e3ab56a None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:41.011659 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683f341-f25a-4373-891d-f8304e3ab56a None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:41.013379 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 738/1475] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:05:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:05:41.019120 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874d1ee-8601-425b-bfc3-11b9d7757d41 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:41.019660 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874d1ee-8601-425b-bfc3-11b9d7757d41 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:41.019920 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874d1ee-8601-425b-bfc3-11b9d7757d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:41.037018 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-3874d1ee-8601-425b-bfc3-11b9d7757d41 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:05:41.038239 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-3874d1ee-8601-425b-bfc3-11b9d7757d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:05:41.046378 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 738/1476] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:05:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:05:41.095118 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb38bcd-d121-462d-b6ea-5ef348aad17a None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:41.095404 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb38bcd-d121-462d-b6ea-5ef348aad17a None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:41.095684 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb38bcd-d121-462d-b6ea-5ef348aad17a None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:41.097442 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 739/1477] 10.222.0.36 () {54 vars in 962 bytes} [Wed Dec 15 16:05:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:05:41.102744 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc6d49-ce64-4d46-a141-0554c68d7053 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:41.103039 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc6d49-ce64-4d46-a141-0554c68d7053 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:41.103316 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc6d49-ce64-4d46-a141-0554c68d7053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:41.121542 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-89bc6d49-ce64-4d46-a141-0554c68d7053 None None] MFA Rules not processed for user `9072bd35fdf046669c196133f485d334`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:05:41.122743 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-89bc6d49-ce64-4d46-a141-0554c68d7053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:05:41.129748 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 739/1478] 10.222.0.36 () {58 vars in 1059 bytes} [Wed Dec 15 16:05:41 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:05:41.137348 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb38bcd-d121-462d-b6ea-5ef348aad17a None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:05:41.147639 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb38bcd-d121-462d-b6ea-5ef348aad17a None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:05:41.151082 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17283291-8a2e-4811-a950-c7a2c96ca4cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9072bd35fdf046669c196133f485d334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:05:41.151727 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17283291-8a2e-4811-a950-c7a2c96ca4cf service glance] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:41.152031 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17283291-8a2e-4811-a950-c7a2c96ca4cf service glance] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:41.152302 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17283291-8a2e-4811-a950-c7a2c96ca4cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:41.161061 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17283291-8a2e-4811-a950-c7a2c96ca4cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:05:41.162539 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17283291-8a2e-4811-a950-c7a2c96ca4cf service glance] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:05:41.171862 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 740/1479] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:05:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:05:43.601972 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bd128-5142-46fb-873f-85f9ee9b800e None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:43.602531 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bd128-5142-46fb-873f-85f9ee9b800e None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:43.602531 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bd128-5142-46fb-873f-85f9ee9b800e None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:43.604296 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 740/1480] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:05:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:05:43.610115 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e4afa-a441-4bbd-83d9-2149fa860aa1 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:43.610523 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e4afa-a441-4bbd-83d9-2149fa860aa1 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:43.610697 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e4afa-a441-4bbd-83d9-2149fa860aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:43.628616 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-e79e4afa-a441-4bbd-83d9-2149fa860aa1 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:05:43.629838 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-e79e4afa-a441-4bbd-83d9-2149fa860aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:05:43.637515 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 741/1481] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:05:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:05:43.662207 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bd128-5142-46fb-873f-85f9ee9b800e None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:05:43.674569 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bd128-5142-46fb-873f-85f9ee9b800e None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:05:43.679654 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59609f9-a2a4-41ab-8495-ab7292fa8095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:05:43.680289 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59609f9-a2a4-41ab-8495-ab7292fa8095 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:43.680580 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59609f9-a2a4-41ab-8495-ab7292fa8095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:43.680864 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59609f9-a2a4-41ab-8495-ab7292fa8095 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:43.681668 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59609f9-a2a4-41ab-8495-ab7292fa8095 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:05:43.683536 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59609f9-a2a4-41ab-8495-ab7292fa8095 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:05:43.702095 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 741/1482] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Dec 15 16:05:43 2021] GET /identity/v3/projects => generated 2553 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:05:46.072011 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716995c-f334-49e3-8b97-4ae1346a3b47 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:46.072493 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716995c-f334-49e3-8b97-4ae1346a3b47 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:46.072600 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716995c-f334-49e3-8b97-4ae1346a3b47 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:46.074377 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 742/1483] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:05:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:05:46.080157 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c1680-9338-406e-a1e5-be8af6cb9049 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:46.080593 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c1680-9338-406e-a1e5-be8af6cb9049 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:46.080703 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c1680-9338-406e-a1e5-be8af6cb9049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:46.099944 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-de1c1680-9338-406e-a1e5-be8af6cb9049 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:05:46.101152 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-de1c1680-9338-406e-a1e5-be8af6cb9049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:05:46.109040 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 742/1484] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:05:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:05:46.153268 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716995c-f334-49e3-8b97-4ae1346a3b47 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:05:46.168070 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716995c-f334-49e3-8b97-4ae1346a3b47 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:05:46.173346 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735e280-a828-44ce-a4a3-237aad367725 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:05:46.173991 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e280-a828-44ce-a4a3-237aad367725 service nova] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:46.174275 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e280-a828-44ce-a4a3-237aad367725 service nova] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:46.174550 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e280-a828-44ce-a4a3-237aad367725 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:46.182677 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735e280-a828-44ce-a4a3-237aad367725 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:05:46.184256 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735e280-a828-44ce-a4a3-237aad367725 service nova] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:05:46.193621 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 743/1485] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:05:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:05:48.718330 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2967e0b-96da-4916-9661-ec64e0b817b8 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:48.718868 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2967e0b-96da-4916-9661-ec64e0b817b8 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:48.718868 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2967e0b-96da-4916-9661-ec64e0b817b8 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:48.720671 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 743/1486] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:05:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:05:48.727580 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c8f3e-6afd-4196-8350-b169e568939f None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:48.728016 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c8f3e-6afd-4196-8350-b169e568939f None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:48.728120 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c8f3e-6afd-4196-8350-b169e568939f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:48.745542 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-953c8f3e-6afd-4196-8350-b169e568939f None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:05:48.746721 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-953c8f3e-6afd-4196-8350-b169e568939f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:05:48.755026 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 744/1487] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:05:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:05:48.792631 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2967e0b-96da-4916-9661-ec64e0b817b8 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:05:48.803161 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2967e0b-96da-4916-9661-ec64e0b817b8 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:05:48.806653 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab104e-4976-446d-aa71-6a8ef643636a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:05:48.807298 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab104e-4976-446d-aa71-6a8ef643636a service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:48.807581 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab104e-4976-446d-aa71-6a8ef643636a service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:48.807851 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab104e-4976-446d-aa71-6a8ef643636a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:48.816342 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab104e-4976-446d-aa71-6a8ef643636a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:05:48.818413 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab104e-4976-446d-aa71-6a8ef643636a service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:05:48.827341 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 744/1488] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:05:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:05:51.323710 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cb1c8-f40b-4f10-bae4-bc50cffe5074 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:51.324248 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cb1c8-f40b-4f10-bae4-bc50cffe5074 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:51.324248 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cb1c8-f40b-4f10-bae4-bc50cffe5074 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:51.326063 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 745/1489] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:05:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:05:51.331690 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f31d4f-5ac9-4752-a17c-67f5bfeca79f None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:51.332097 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f31d4f-5ac9-4752-a17c-67f5bfeca79f None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:51.332808 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f31d4f-5ac9-4752-a17c-67f5bfeca79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:51.350262 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-81f31d4f-5ac9-4752-a17c-67f5bfeca79f None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:05:51.351465 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-81f31d4f-5ac9-4752-a17c-67f5bfeca79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:05:51.359140 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 745/1490] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:05:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:05:51.399814 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cb1c8-f40b-4f10-bae4-bc50cffe5074 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:05:51.410311 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cb1c8-f40b-4f10-bae4-bc50cffe5074 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:05:51.413838 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48c7af-d769-4065-a470-90d0a520579e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:05:51.414464 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48c7af-d769-4065-a470-90d0a520579e service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:51.414748 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48c7af-d769-4065-a470-90d0a520579e service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:51.415023 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48c7af-d769-4065-a470-90d0a520579e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:51.424050 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48c7af-d769-4065-a470-90d0a520579e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:05:51.425534 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48c7af-d769-4065-a470-90d0a520579e service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:05:51.435280 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 746/1491] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:05:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:05:53.903722 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e753ee4-2e38-45af-8cc5-f8ac4f19c27e None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:53.904366 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e753ee4-2e38-45af-8cc5-f8ac4f19c27e None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:53.904366 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e753ee4-2e38-45af-8cc5-f8ac4f19c27e None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:53.906114 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 746/1492] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:05:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:05:53.912854 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b315b2-6139-478a-a9ef-25f4c9c67909 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:53.913362 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b315b2-6139-478a-a9ef-25f4c9c67909 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:53.913533 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b315b2-6139-478a-a9ef-25f4c9c67909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:53.933754 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-38b315b2-6139-478a-a9ef-25f4c9c67909 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:05:53.934960 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-38b315b2-6139-478a-a9ef-25f4c9c67909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:05:53.942639 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 747/1493] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:05:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:05:53.987665 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e753ee4-2e38-45af-8cc5-f8ac4f19c27e None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:05:53.998014 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e753ee4-2e38-45af-8cc5-f8ac4f19c27e None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:05:54.001462 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1afa8-0fb6-4ead-a17f-ad33f023394b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:05:54.002099 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1afa8-0fb6-4ead-a17f-ad33f023394b service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:54.002378 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1afa8-0fb6-4ead-a17f-ad33f023394b service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:54.002649 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1afa8-0fb6-4ead-a17f-ad33f023394b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:54.011914 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1afa8-0fb6-4ead-a17f-ad33f023394b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:05:54.013329 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1afa8-0fb6-4ead-a17f-ad33f023394b service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:05:54.022918 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 747/1494] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:05:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:05:56.699072 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93cf10-825b-49e1-8d7e-9ae3c78e004f None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:56.699652 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93cf10-825b-49e1-8d7e-9ae3c78e004f None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:56.699652 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93cf10-825b-49e1-8d7e-9ae3c78e004f None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:56.701426 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 748/1495] 10.222.0.36 () {54 vars in 926 bytes} [Wed Dec 15 16:05:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:05:56.708791 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597128e-92aa-4629-a755-52fe1bbca0b3 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:56.709293 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597128e-92aa-4629-a755-52fe1bbca0b3 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:56.709440 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597128e-92aa-4629-a755-52fe1bbca0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:56.727256 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-e597128e-92aa-4629-a755-52fe1bbca0b3 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:05:56.728425 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-e597128e-92aa-4629-a755-52fe1bbca0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:05:56.736154 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 748/1496] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Dec 15 16:05:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:05:56.776751 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93cf10-825b-49e1-8d7e-9ae3c78e004f None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:05:56.788065 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93cf10-825b-49e1-8d7e-9ae3c78e004f None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:05:56.791791 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063eb09-14cc-4150-95bb-5380135e36b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:05:56.792416 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063eb09-14cc-4150-95bb-5380135e36b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:05:56.792696 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063eb09-14cc-4150-95bb-5380135e36b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:05:56.792971 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063eb09-14cc-4150-95bb-5380135e36b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:05:56.801893 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063eb09-14cc-4150-95bb-5380135e36b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:05:56.803368 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063eb09-14cc-4150-95bb-5380135e36b2 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:05:56.812557 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 749/1497] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:05:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:07:09.273438 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c611e12-3b0d-47d8-87ab-407b1d9762dd None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:09.274031 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c611e12-3b0d-47d8-87ab-407b1d9762dd None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:09.274031 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c611e12-3b0d-47d8-87ab-407b1d9762dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:09.292087 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-7c611e12-3b0d-47d8-87ab-407b1d9762dd None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:09.293206 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-7c611e12-3b0d-47d8-87ab-407b1d9762dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:09.301126 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 749/1498] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:07:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:07:09.309670 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c83ab4-ee60-43c0-87e8-001e7b75ceea None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:09.310136 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c83ab4-ee60-43c0-87e8-001e7b75ceea None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:09.310239 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c83ab4-ee60-43c0-87e8-001e7b75ceea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:09.327506 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-08c83ab4-ee60-43c0-87e8-001e7b75ceea None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:09.328666 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-08c83ab4-ee60-43c0-87e8-001e7b75ceea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:09.336459 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 750/1499] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:07:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:07:09.340679 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c611e12-3b0d-47d8-87ab-407b1d9762dd None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:09.350387 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c611e12-3b0d-47d8-87ab-407b1d9762dd None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:09.354819 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a19ed-9e40-4f87-9332-d0bcc4511e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:09.355457 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a19ed-9e40-4f87-9332-d0bcc4511e76 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:09.355739 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a19ed-9e40-4f87-9332-d0bcc4511e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:09.356015 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a19ed-9e40-4f87-9332-d0bcc4511e76 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:09.356737 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a19ed-9e40-4f87-9332-d0bcc4511e76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:07:09.357043 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a19ed-9e40-4f87-9332-d0bcc4511e76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:09.358681 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a19ed-9e40-4f87-9332-d0bcc4511e76 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:09.370241 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 750/1500] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:07:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:07:09.378094 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c83ab4-ee60-43c0-87e8-001e7b75ceea None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:09.387032 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c83ab4-ee60-43c0-87e8-001e7b75ceea None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:09.391535 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d4a15-47f6-49f3-9ae1-db4b7c86dd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:09.392163 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d4a15-47f6-49f3-9ae1-db4b7c86dd3d admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:09.392444 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d4a15-47f6-49f3-9ae1-db4b7c86dd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:09.392720 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d4a15-47f6-49f3-9ae1-db4b7c86dd3d admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:09.393432 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d4a15-47f6-49f3-9ae1-db4b7c86dd3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:09.395319 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d4a15-47f6-49f3-9ae1-db4b7c86dd3d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:09.430613 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 751/1501] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:07:09 2021] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:07:09.434749 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a19ed-9e40-4f87-9332-d0bcc4511e76 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:09.444595 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a19ed-9e40-4f87-9332-d0bcc4511e76 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:09.498349 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27796c37-d0c8-4838-86e4-143bba100c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:09.499007 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27796c37-d0c8-4838-86e4-143bba100c8a admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:09.499288 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27796c37-d0c8-4838-86e4-143bba100c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:09.499563 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27796c37-d0c8-4838-86e4-143bba100c8a admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:09.500269 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27796c37-d0c8-4838-86e4-143bba100c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:09.502220 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27796c37-d0c8-4838-86e4-143bba100c8a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:09.521316 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 751/1502] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:07:09 2021] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:07:09.525423 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d4a15-47f6-49f3-9ae1-db4b7c86dd3d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:09.535331 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d4a15-47f6-49f3-9ae1-db4b7c86dd3d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:09.540453 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6b079-6502-4d33-ab14-190b54624662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:09.541093 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6b079-6502-4d33-ab14-190b54624662 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:09.541371 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6b079-6502-4d33-ab14-190b54624662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:09.541667 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6b079-6502-4d33-ab14-190b54624662 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:09.542456 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6b079-6502-4d33-ab14-190b54624662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:09.544241 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6b079-6502-4d33-ab14-190b54624662 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:09.556571 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 752/1503] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:07:09 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:07:09.560644 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27796c37-d0c8-4838-86e4-143bba100c8a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:09.570624 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27796c37-d0c8-4838-86e4-143bba100c8a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:09.575135 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e062b19-82cf-4a66-a2f8-ed018ca1f7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:09.575777 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e062b19-82cf-4a66-a2f8-ed018ca1f7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:09.576063 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e062b19-82cf-4a66-a2f8-ed018ca1f7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:09.576340 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e062b19-82cf-4a66-a2f8-ed018ca1f7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:09.577076 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e062b19-82cf-4a66-a2f8-ed018ca1f7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:09.578707 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e062b19-82cf-4a66-a2f8-ed018ca1f7f4 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:09.592555 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 752/1504] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:07:09 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:07:09.596741 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6b079-6502-4d33-ab14-190b54624662 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:09.606383 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6b079-6502-4d33-ab14-190b54624662 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:09.611606 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7973c5-300f-4387-8510-751298107789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:09.612563 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7973c5-300f-4387-8510-751298107789 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:09.612852 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7973c5-300f-4387-8510-751298107789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:09.613132 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7973c5-300f-4387-8510-751298107789 admin admin] PATH_INFO: `/v3/projects/03b0d12ac1de467897a9421f64cdc50c/users/7956443ca17545a08590c933e76fc8ee/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:09.627983 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7973c5-300f-4387-8510-751298107789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b0d12ac1de467897a9421f64cdc50c, user_id=7956443ca17545a08590c933e76fc8ee, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:09.631013 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7973c5-300f-4387-8510-751298107789 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:09.643943 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 753/1505] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:07:09 2021] PUT /identity/v3/projects/03b0d12ac1de467897a9421f64cdc50c/users/7956443ca17545a08590c933e76fc8ee/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:07:09.655759 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba05f1-a233-421b-899e-139032773ff3 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:09.656061 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba05f1-a233-421b-899e-139032773ff3 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:09.656370 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba05f1-a233-421b-899e-139032773ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:09.682580 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-7cba05f1-a233-421b-899e-139032773ff3 None None] MFA Rules not processed for user `7956443ca17545a08590c933e76fc8ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:09.683785 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-7cba05f1-a233-421b-899e-139032773ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:09.747257 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 753/1506] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:07:09 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:07:09.760546 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7973c5-300f-4387-8510-751298107789 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:09.827209 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7973c5-300f-4387-8510-751298107789 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:09.832612 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ce8a9-1ac7-4109-bf7f-69098387fb56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:09.834002 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ce8a9-1ac7-4109-bf7f-69098387fb56 service nova] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:09.834281 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ce8a9-1ac7-4109-bf7f-69098387fb56 service nova] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:09.834557 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ce8a9-1ac7-4109-bf7f-69098387fb56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:09.842274 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ce8a9-1ac7-4109-bf7f-69098387fb56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:09.843887 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ce8a9-1ac7-4109-bf7f-69098387fb56 service nova] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:09.853469 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 754/1507] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:07:09 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:07:09.919670 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d64000-67eb-4766-ae14-63579e63b3ed None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:09.919970 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d64000-67eb-4766-ae14-63579e63b3ed None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:09.920253 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d64000-67eb-4766-ae14-63579e63b3ed None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:09.921965 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 754/1508] 10.222.0.36 () {52 vars in 829 bytes} [Wed Dec 15 16:07:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:07:09.925539 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ce8a9-1ac7-4109-bf7f-69098387fb56 service nova] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:09.984672 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ce8a9-1ac7-4109-bf7f-69098387fb56 service nova] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:09.989249 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f952d31-ebe3-4f79-8e41-b2caafd7671a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:09.990594 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f952d31-ebe3-4f79-8e41-b2caafd7671a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:09.990878 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f952d31-ebe3-4f79-8e41-b2caafd7671a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:09.991287 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f952d31-ebe3-4f79-8e41-b2caafd7671a admin admin] PATH_INFO: `/v3/users/7956443ca17545a08590c933e76fc8ee` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:09.992488 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f952d31-ebe3-4f79-8e41-b2caafd7671a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7956443ca17545a08590c933e76fc8ee)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:09.993550 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING py.warnings [None req-4f952d31-ebe3-4f79-8e41-b2caafd7671a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:07:09.993550 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: warnings.warn(msg) Dec 15 16:07:09.993550 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: Dec 15 16:07:09.994762 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f952d31-ebe3-4f79-8e41-b2caafd7671a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:10.061307 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4f952d31-ebe3-4f79-8e41-b2caafd7671a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7956443ca17545a08590c933e76fc8ee'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:07:10.061994 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4f952d31-ebe3-4f79-8e41-b2caafd7671a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7956443ca17545a08590c933e76fc8ee'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:07:10.074192 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4f952d31-ebe3-4f79-8e41-b2caafd7671a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7956443ca17545a08590c933e76fc8ee'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:07:10.074945 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4f952d31-ebe3-4f79-8e41-b2caafd7671a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7956443ca17545a08590c933e76fc8ee'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:07:10.094337 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4f952d31-ebe3-4f79-8e41-b2caafd7671a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7956443ca17545a08590c933e76fc8ee'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:07:10.108526 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 755/1509] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:07:09 2021] DELETE /identity/v3/users/7956443ca17545a08590c933e76fc8ee => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:07:10.113010 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6e531-faff-445b-81d2-d431042d7bb5 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:10.113295 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6e531-faff-445b-81d2-d431042d7bb5 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:10.113596 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6e531-faff-445b-81d2-d431042d7bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:10.130976 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-23c6e531-faff-445b-81d2-d431042d7bb5 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:07:10.132166 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-23c6e531-faff-445b-81d2-d431042d7bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:10.187158 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 755/1510] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:07:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:07:10.197113 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f952d31-ebe3-4f79-8e41-b2caafd7671a admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:10.198590 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-4f952d31-ebe3-4f79-8e41-b2caafd7671a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:10.253927 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f952d31-ebe3-4f79-8e41-b2caafd7671a admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:10.257622 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfa0d9-f1ef-4f49-bc0f-277dab45480b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:10.258269 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfa0d9-f1ef-4f49-bc0f-277dab45480b service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:10.258551 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfa0d9-f1ef-4f49-bc0f-277dab45480b service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:10.258828 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfa0d9-f1ef-4f49-bc0f-277dab45480b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:10.267551 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfa0d9-f1ef-4f49-bc0f-277dab45480b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:10.268992 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfa0d9-f1ef-4f49-bc0f-277dab45480b service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:10.278789 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 756/1511] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:07:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:07:10.617272 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6e531-faff-445b-81d2-d431042d7bb5 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:07:10.618781 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-23c6e531-faff-445b-81d2-d431042d7bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:07:10.630789 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6e531-faff-445b-81d2-d431042d7bb5 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:07:10.635927 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388cb75-7f89-4f60-8750-2b8f2e7d3ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:07:10.637051 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388cb75-7f89-4f60-8750-2b8f2e7d3ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:07:10.637334 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388cb75-7f89-4f60-8750-2b8f2e7d3ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:07:10.637633 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388cb75-7f89-4f60-8750-2b8f2e7d3ad1 admin admin] PATH_INFO: `/v3/projects/03b0d12ac1de467897a9421f64cdc50c` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:07:10.638820 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388cb75-7f89-4f60-8750-2b8f2e7d3ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03b0d12ac1de467897a9421f64cdc50c)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:07:10.639890 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING py.warnings [None req-4388cb75-7f89-4f60-8750-2b8f2e7d3ad1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:07:10.639890 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: warnings.warn(msg) Dec 15 16:07:10.639890 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: Dec 15 16:07:10.641019 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388cb75-7f89-4f60-8750-2b8f2e7d3ad1 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:07:10.702050 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4388cb75-7f89-4f60-8750-2b8f2e7d3ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03b0d12ac1de467897a9421f64cdc50c', 'request_id': 'req-4388cb75-7f89-4f60-8750-2b8f2e7d3ad1'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:07:10.711271 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4388cb75-7f89-4f60-8750-2b8f2e7d3ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03b0d12ac1de467897a9421f64cdc50c', 'request_id': 'req-4388cb75-7f89-4f60-8750-2b8f2e7d3ad1'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:07:10.717647 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4388cb75-7f89-4f60-8750-2b8f2e7d3ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03b0d12ac1de467897a9421f64cdc50c', 'request_id': 'req-4388cb75-7f89-4f60-8750-2b8f2e7d3ad1'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:07:10.737002 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4388cb75-7f89-4f60-8750-2b8f2e7d3ad1 admin admin] The token cache is being invalidate because project 03b0d12ac1de467897a9421f64cdc50c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:07:10.737284 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4388cb75-7f89-4f60-8750-2b8f2e7d3ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:07:10.737961 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4388cb75-7f89-4f60-8750-2b8f2e7d3ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:07:10.740200 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 756/1512] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:07:10 2021] DELETE /identity/v3/projects/03b0d12ac1de467897a9421f64cdc50c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:08:37.967811 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb288b-7472-4a31-8b2e-21466559e78d None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:37.968414 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb288b-7472-4a31-8b2e-21466559e78d None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:37.968414 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb288b-7472-4a31-8b2e-21466559e78d None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:37.970192 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 757/1513] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 16:08:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:37.975466 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed14fdf-ef19-4d32-a75d-becbea1f9fca None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:37.975872 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed14fdf-ef19-4d32-a75d-becbea1f9fca None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:37.976047 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed14fdf-ef19-4d32-a75d-becbea1f9fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:37.985475 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb69211-2d96-47ea-9a9a-2ad33f18c9d1 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:37.985763 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb69211-2d96-47ea-9a9a-2ad33f18c9d1 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:37.986065 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb69211-2d96-47ea-9a9a-2ad33f18c9d1 None None] PATH_INFO: `/v3` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:37.987278 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 758/1514] 10.222.0.46 () {54 vars in 925 bytes} [Wed Dec 15 16:08:37 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:08:37.994121 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996226a-8fa0-429c-aee7-a487f354a63c None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:37.994408 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996226a-8fa0-429c-aee7-a487f354a63c None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:37.994865 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996226a-8fa0-429c-aee7-a487f354a63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:37.995954 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-eed14fdf-ef19-4d32-a75d-becbea1f9fca None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:37.998252 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-eed14fdf-ef19-4d32-a75d-becbea1f9fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:38.013498 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-4996226a-8fa0-429c-aee7-a487f354a63c None None] MFA Rules not processed for user `e186d6728a2341399252238c559002f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:38.014761 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-4996226a-8fa0-429c-aee7-a487f354a63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:38.059300 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 16:08:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:08:38.081436 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 759/1516] 10.222.0.46 () {58 vars in 1015 bytes} [Wed Dec 15 16:08:37 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:08:38.226695 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed14fdf-ef19-4d32-a75d-becbea1f9fca None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:38.227982 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-eed14fdf-ef19-4d32-a75d-becbea1f9fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:38.298113 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed14fdf-ef19-4d32-a75d-becbea1f9fca None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:38.303550 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7145f1b-5106-40ab-975b-e2eba800f15b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:38.304188 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7145f1b-5106-40ab-975b-e2eba800f15b service nova] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:38.304472 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7145f1b-5106-40ab-975b-e2eba800f15b service nova] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:38.304748 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7145f1b-5106-40ab-975b-e2eba800f15b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:38.312762 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7145f1b-5106-40ab-975b-e2eba800f15b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:38.314389 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7145f1b-5106-40ab-975b-e2eba800f15b service nova] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:38.323470 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 758/1517] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:08:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:08:39.840552 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a11d0-3602-4e74-a52c-a8bc56e3bb0b None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:39.841111 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a11d0-3602-4e74-a52c-a8bc56e3bb0b None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:39.841111 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a11d0-3602-4e74-a52c-a8bc56e3bb0b None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:39.843492 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 760/1518] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 16:08:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:39.848992 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6edf6-7ebf-436b-99a2-d144ecb53be6 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:39.849415 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6edf6-7ebf-436b-99a2-d144ecb53be6 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:39.849578 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6edf6-7ebf-436b-99a2-d144ecb53be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:39.868215 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-dfc6edf6-7ebf-436b-99a2-d144ecb53be6 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:39.869401 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-dfc6edf6-7ebf-436b-99a2-d144ecb53be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:39.877292 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 759/1519] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 16:08:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:08:40.034014 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a11d0-3602-4e74-a52c-a8bc56e3bb0b None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:40.049320 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a11d0-3602-4e74-a52c-a8bc56e3bb0b None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:40.054749 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1cdf6-81ed-4a1e-a3b7-69253cb7cf2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:40.055387 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1cdf6-81ed-4a1e-a3b7-69253cb7cf2b service nova] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:40.055670 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1cdf6-81ed-4a1e-a3b7-69253cb7cf2b service nova] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:40.055949 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1cdf6-81ed-4a1e-a3b7-69253cb7cf2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:40.064487 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1cdf6-81ed-4a1e-a3b7-69253cb7cf2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:40.066159 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1cdf6-81ed-4a1e-a3b7-69253cb7cf2b service nova] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:40.075480 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 761/1520] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:08:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:08:41.865863 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080afe98-ce5a-4382-bbaa-a8f6f5c4bc5b None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:41.866337 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080afe98-ce5a-4382-bbaa-a8f6f5c4bc5b None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:41.866446 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080afe98-ce5a-4382-bbaa-a8f6f5c4bc5b None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:41.868165 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 760/1521] 10.222.0.36 () {54 vars in 960 bytes} [Wed Dec 15 16:08:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:41.874311 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc386bf3-2fa7-4f62-9d3d-52a4b9aa0506 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:41.874733 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc386bf3-2fa7-4f62-9d3d-52a4b9aa0506 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:41.874863 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc386bf3-2fa7-4f62-9d3d-52a4b9aa0506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:41.893161 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-fc386bf3-2fa7-4f62-9d3d-52a4b9aa0506 None None] MFA Rules not processed for user `e186d6728a2341399252238c559002f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:41.894396 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-fc386bf3-2fa7-4f62-9d3d-52a4b9aa0506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:41.902927 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 762/1522] 10.222.0.36 () {58 vars in 1057 bytes} [Wed Dec 15 16:08:41 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:08:41.911292 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080afe98-ce5a-4382-bbaa-a8f6f5c4bc5b None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:41.925522 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080afe98-ce5a-4382-bbaa-a8f6f5c4bc5b None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:41.930350 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2404cc2-cd2b-44c3-9e15-a5603dd97779 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e186d6728a2341399252238c559002f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:41.930995 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2404cc2-cd2b-44c3-9e15-a5603dd97779 service placement] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:41.931274 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2404cc2-cd2b-44c3-9e15-a5603dd97779 service placement] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:41.931543 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2404cc2-cd2b-44c3-9e15-a5603dd97779 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:41.940315 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2404cc2-cd2b-44c3-9e15-a5603dd97779 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:41.941969 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2404cc2-cd2b-44c3-9e15-a5603dd97779 service placement] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:41.951613 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 761/1523] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:08:41 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:08:52.016020 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89875e4b-a51e-4d69-bad9-99987bccbb26 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:52.016598 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89875e4b-a51e-4d69-bad9-99987bccbb26 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:52.016598 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89875e4b-a51e-4d69-bad9-99987bccbb26 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:52.018371 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 763/1524] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 16:08:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:52.023864 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392561f-317e-4785-9a87-3ec140e6ce1c None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:52.024266 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392561f-317e-4785-9a87-3ec140e6ce1c None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:52.024420 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392561f-317e-4785-9a87-3ec140e6ce1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:52.043422 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-5392561f-317e-4785-9a87-3ec140e6ce1c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:52.044635 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-5392561f-317e-4785-9a87-3ec140e6ce1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:52.052440 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 762/1525] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 16:08:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:08:52.209182 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89875e4b-a51e-4d69-bad9-99987bccbb26 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:52.223429 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89875e4b-a51e-4d69-bad9-99987bccbb26 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:52.228748 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2df24-d297-46b3-97ef-83feb8bcd430 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:52.229370 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2df24-d297-46b3-97ef-83feb8bcd430 service nova] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:52.229684 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2df24-d297-46b3-97ef-83feb8bcd430 service nova] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:52.229959 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2df24-d297-46b3-97ef-83feb8bcd430 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:52.238515 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2df24-d297-46b3-97ef-83feb8bcd430 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:52.240108 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2df24-d297-46b3-97ef-83feb8bcd430 service nova] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:52.249849 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 764/1526] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:08:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:08:53.742643 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ad290-e866-448e-bd7a-416c4e05f0b7 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:53.743177 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ad290-e866-448e-bd7a-416c4e05f0b7 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:53.743177 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ad290-e866-448e-bd7a-416c4e05f0b7 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:53.744940 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 763/1527] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 16:08:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:53.750408 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35977ec-5642-4c9d-a2d9-fbc6d44e0829 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:53.750841 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35977ec-5642-4c9d-a2d9-fbc6d44e0829 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:53.750949 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35977ec-5642-4c9d-a2d9-fbc6d44e0829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:53.769199 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-f35977ec-5642-4c9d-a2d9-fbc6d44e0829 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:53.770362 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-f35977ec-5642-4c9d-a2d9-fbc6d44e0829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:53.778091 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 765/1528] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 16:08:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:08:53.933670 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ad290-e866-448e-bd7a-416c4e05f0b7 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:53.948232 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ad290-e866-448e-bd7a-416c4e05f0b7 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:53.954450 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b78627-901d-4771-8235-02099dc2af8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:53.955104 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b78627-901d-4771-8235-02099dc2af8a service nova] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:53.955383 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b78627-901d-4771-8235-02099dc2af8a service nova] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:53.955712 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b78627-901d-4771-8235-02099dc2af8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:53.964332 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b78627-901d-4771-8235-02099dc2af8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:53.965960 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b78627-901d-4771-8235-02099dc2af8a service nova] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:53.976014 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 764/1529] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:08:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:08:58.306291 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5aace2-6fd1-488a-8d91-d30808b9c6f9 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:58.306893 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5aace2-6fd1-488a-8d91-d30808b9c6f9 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:58.306893 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5aace2-6fd1-488a-8d91-d30808b9c6f9 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:58.308548 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 766/1530] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:08:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:08:58.314719 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e30e3-c00e-44bd-a548-e4d568685a8c None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:58.315167 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e30e3-c00e-44bd-a548-e4d568685a8c None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:58.315270 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e30e3-c00e-44bd-a548-e4d568685a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:58.333669 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-695e30e3-c00e-44bd-a548-e4d568685a8c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:08:58.334862 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-695e30e3-c00e-44bd-a548-e4d568685a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:58.343129 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 765/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:08:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:08:58.379943 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5aace2-6fd1-488a-8d91-d30808b9c6f9 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:08:58.381695 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-8c5aace2-6fd1-488a-8d91-d30808b9c6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:08:58.438073 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5aace2-6fd1-488a-8d91-d30808b9c6f9 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:08:58.441622 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdab8f9-5d3b-4bdd-9f90-6b6dc65a2f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:08:58.442254 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdab8f9-5d3b-4bdd-9f90-6b6dc65a2f59 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:08:58.442533 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdab8f9-5d3b-4bdd-9f90-6b6dc65a2f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:08:58.442805 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdab8f9-5d3b-4bdd-9f90-6b6dc65a2f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:08:58.452327 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdab8f9-5d3b-4bdd-9f90-6b6dc65a2f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:08:58.453803 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdab8f9-5d3b-4bdd-9f90-6b6dc65a2f59 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:08:58.462843 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 767/1532] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:08:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:09:00.821624 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49647e8d-d7c9-4a6d-afb1-69691a0ba416 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:00.822197 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49647e8d-d7c9-4a6d-afb1-69691a0ba416 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:00.822197 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49647e8d-d7c9-4a6d-afb1-69691a0ba416 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:00.823951 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 766/1533] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:09:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:00.830304 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bbc53-6b7c-41b8-9a14-253e66a94797 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:00.830737 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bbc53-6b7c-41b8-9a14-253e66a94797 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:00.830886 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bbc53-6b7c-41b8-9a14-253e66a94797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:00.848601 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-252bbc53-6b7c-41b8-9a14-253e66a94797 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:00.849897 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-252bbc53-6b7c-41b8-9a14-253e66a94797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:00.857679 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 768/1534] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:09:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:00.894783 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49647e8d-d7c9-4a6d-afb1-69691a0ba416 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:00.906403 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49647e8d-d7c9-4a6d-afb1-69691a0ba416 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:00.910396 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f889b3-3f08-4fa9-beba-a2d1dfaa5f21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:00.911309 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f889b3-3f08-4fa9-beba-a2d1dfaa5f21 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:00.911730 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f889b3-3f08-4fa9-beba-a2d1dfaa5f21 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:00.912016 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f889b3-3f08-4fa9-beba-a2d1dfaa5f21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:00.921726 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f889b3-3f08-4fa9-beba-a2d1dfaa5f21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:00.923163 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f889b3-3f08-4fa9-beba-a2d1dfaa5f21 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:00.932350 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 767/1535] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:09:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:09:04.808543 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc75a4-5477-4ba6-b9d3-f4488ff19196 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:04.809116 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc75a4-5477-4ba6-b9d3-f4488ff19196 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:04.809116 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc75a4-5477-4ba6-b9d3-f4488ff19196 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:04.810958 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 769/1536] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:09:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:04.817117 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf605447-b709-4c47-9f82-e51a04b9b0ad None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:04.817521 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf605447-b709-4c47-9f82-e51a04b9b0ad None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:04.817714 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf605447-b709-4c47-9f82-e51a04b9b0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:04.836188 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-bf605447-b709-4c47-9f82-e51a04b9b0ad None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:04.837368 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-bf605447-b709-4c47-9f82-e51a04b9b0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:04.846621 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 768/1537] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:09:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:04.897033 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc75a4-5477-4ba6-b9d3-f4488ff19196 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:04.898737 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-9bdc75a4-5477-4ba6-b9d3-f4488ff19196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:04.953931 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc75a4-5477-4ba6-b9d3-f4488ff19196 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:04.957430 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b82cb-62d7-400a-88c3-23f91d32da49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:04.958065 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b82cb-62d7-400a-88c3-23f91d32da49 service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:04.958340 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b82cb-62d7-400a-88c3-23f91d32da49 service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:04.958621 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b82cb-62d7-400a-88c3-23f91d32da49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:04.967951 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b82cb-62d7-400a-88c3-23f91d32da49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:04.969405 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b82cb-62d7-400a-88c3-23f91d32da49 service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:04.978446 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 770/1538] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:09:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:09:07.341037 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49da2a-fc59-4053-9f6c-1483e4695607 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:07.341596 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49da2a-fc59-4053-9f6c-1483e4695607 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:07.341596 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49da2a-fc59-4053-9f6c-1483e4695607 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:07.343382 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 769/1539] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 16:09:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:07.349119 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ccd07-ae9c-42af-87df-e5757a1c8deb None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:07.349607 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ccd07-ae9c-42af-87df-e5757a1c8deb None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:07.349716 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ccd07-ae9c-42af-87df-e5757a1c8deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:07.372733 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-997ccd07-ae9c-42af-87df-e5757a1c8deb None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:07.375023 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-997ccd07-ae9c-42af-87df-e5757a1c8deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:07.382773 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 771/1540] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 16:09:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:09:07.432393 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32969a31-7cb1-4d50-8a52-5757c4bd154b None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:07.432679 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32969a31-7cb1-4d50-8a52-5757c4bd154b None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:07.432956 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32969a31-7cb1-4d50-8a52-5757c4bd154b None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:07.435329 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 770/1541] 10.222.0.36 () {54 vars in 963 bytes} [Wed Dec 15 16:09:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:09:07.440427 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0458a9f-abc3-4573-855f-0ddb0dc7c76f None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:07.440712 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0458a9f-abc3-4573-855f-0ddb0dc7c76f None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:07.440988 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0458a9f-abc3-4573-855f-0ddb0dc7c76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:07.459058 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-d0458a9f-abc3-4573-855f-0ddb0dc7c76f None None] MFA Rules not processed for user `0d18ec9bcc0e481aa000833ec1c0988d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:09:07.460240 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-d0458a9f-abc3-4573-855f-0ddb0dc7c76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:09:07.467090 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 772/1542] 10.222.0.36 () {58 vars in 1060 bytes} [Wed Dec 15 16:09:07 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:09:07.474856 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32969a31-7cb1-4d50-8a52-5757c4bd154b None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:09:07.485653 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32969a31-7cb1-4d50-8a52-5757c4bd154b None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:09:07.489239 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2f94f-db8c-47db-82b7-ce154cf88c39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:09:07.489881 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2f94f-db8c-47db-82b7-ce154cf88c39 service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:09:07.490161 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2f94f-db8c-47db-82b7-ce154cf88c39 service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:09:07.490429 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2f94f-db8c-47db-82b7-ce154cf88c39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:09:07.499283 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2f94f-db8c-47db-82b7-ce154cf88c39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:09:07.500694 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2f94f-db8c-47db-82b7-ce154cf88c39 service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:09:07.509734 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 771/1543] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:09:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:30.099669 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23168c-4a65-4cab-9e6a-38f70118c9fa None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.100297 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23168c-4a65-4cab-9e6a-38f70118c9fa None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.100502 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23168c-4a65-4cab-9e6a-38f70118c9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.126897 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-1f23168c-4a65-4cab-9e6a-38f70118c9fa None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:30.133652 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-1f23168c-4a65-4cab-9e6a-38f70118c9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:30.140722 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 773/1544] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:30.148882 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0db358-39d2-4f46-957f-419553036461 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.149956 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0db358-39d2-4f46-957f-419553036461 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.149956 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0db358-39d2-4f46-957f-419553036461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.173634 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-0a0db358-39d2-4f46-957f-419553036461 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:30.174976 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-0a0db358-39d2-4f46-957f-419553036461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:30.185627 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 772/1545] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:30.190030 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23168c-4a65-4cab-9e6a-38f70118c9fa None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:30.202407 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23168c-4a65-4cab-9e6a-38f70118c9fa None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:30.207730 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b299794-2eb1-4e8c-b59b-9328a6a81137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:30.208399 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b299794-2eb1-4e8c-b59b-9328a6a81137 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.208684 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b299794-2eb1-4e8c-b59b-9328a6a81137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.209830 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b299794-2eb1-4e8c-b59b-9328a6a81137 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.209946 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b299794-2eb1-4e8c-b59b-9328a6a81137 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:10:30.212311 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b299794-2eb1-4e8c-b59b-9328a6a81137 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:30.212311 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b299794-2eb1-4e8c-b59b-9328a6a81137 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:30.228462 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 774/1546] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:10:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:10:30.236637 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0db358-39d2-4f46-957f-419553036461 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:30.248656 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0db358-39d2-4f46-957f-419553036461 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:30.255153 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994872b-a8a8-43d0-93a0-49e6c446199c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:30.255821 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994872b-a8a8-43d0-93a0-49e6c446199c admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.256109 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994872b-a8a8-43d0-93a0-49e6c446199c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.256390 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994872b-a8a8-43d0-93a0-49e6c446199c admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.257120 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994872b-a8a8-43d0-93a0-49e6c446199c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:30.259087 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994872b-a8a8-43d0-93a0-49e6c446199c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:30.308992 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 773/1547] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:10:30 2021] POST /identity/v3/projects => generated 355 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:30.313151 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b299794-2eb1-4e8c-b59b-9328a6a81137 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:30.330351 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b299794-2eb1-4e8c-b59b-9328a6a81137 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:30.398943 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d24cb0-9003-4f45-9af2-e2c60b5aa0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:30.399704 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d24cb0-9003-4f45-9af2-e2c60b5aa0dd admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.400148 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d24cb0-9003-4f45-9af2-e2c60b5aa0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.400553 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d24cb0-9003-4f45-9af2-e2c60b5aa0dd admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.401576 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d24cb0-9003-4f45-9af2-e2c60b5aa0dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:30.403886 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d24cb0-9003-4f45-9af2-e2c60b5aa0dd admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:30.405970 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b48b1a-8865-4ebc-9d99-a71bd7651c00 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.406264 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b48b1a-8865-4ebc-9d99-a71bd7651c00 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.406541 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b48b1a-8865-4ebc-9d99-a71bd7651c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.437685 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-c5b48b1a-8865-4ebc-9d99-a71bd7651c00 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:30.438914 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c5b48b1a-8865-4ebc-9d99-a71bd7651c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:30.440622 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 775/1548] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:10:30 2021] POST /identity/v3/users => generated 278 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:30.445455 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d24cb0-9003-4f45-9af2-e2c60b5aa0dd admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:30.451506 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 774/1549] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:10:30.461038 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3721d-5434-4dae-a12a-22f4cb2a7144 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.463363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3721d-5434-4dae-a12a-22f4cb2a7144 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.463363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3721d-5434-4dae-a12a-22f4cb2a7144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.466163 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d24cb0-9003-4f45-9af2-e2c60b5aa0dd admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:30.474613 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074ec7e-cbb7-4896-a9f3-b65496e4014f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:30.475310 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074ec7e-cbb7-4896-a9f3-b65496e4014f admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.475766 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074ec7e-cbb7-4896-a9f3-b65496e4014f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.476053 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074ec7e-cbb7-4896-a9f3-b65496e4014f admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.476805 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074ec7e-cbb7-4896-a9f3-b65496e4014f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:30.480106 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074ec7e-cbb7-4896-a9f3-b65496e4014f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:30.489675 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-f3e3721d-5434-4dae-a12a-22f4cb2a7144 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:30.490883 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f3e3721d-5434-4dae-a12a-22f4cb2a7144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:30.503900 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 775/1550] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:10:30.504687 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 776/1551] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:30 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:30.508855 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3721d-5434-4dae-a12a-22f4cb2a7144 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:30.509021 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074ec7e-cbb7-4896-a9f3-b65496e4014f admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:30.522622 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3721d-5434-4dae-a12a-22f4cb2a7144 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:30.523742 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074ec7e-cbb7-4896-a9f3-b65496e4014f admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:30.533988 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57a14f-9ff8-4a58-8f0d-cbfe054359d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:30.534672 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57a14f-9ff8-4a58-8f0d-cbfe054359d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.534956 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57a14f-9ff8-4a58-8f0d-cbfe054359d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.535233 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57a14f-9ff8-4a58-8f0d-cbfe054359d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.535982 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57a14f-9ff8-4a58-8f0d-cbfe054359d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:30.537623 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57a14f-9ff8-4a58-8f0d-cbfe054359d9 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:30.546059 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53742e-e772-40ef-8fcf-b65b1a759024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:30.546796 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53742e-e772-40ef-8fcf-b65b1a759024 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.547082 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53742e-e772-40ef-8fcf-b65b1a759024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.547358 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53742e-e772-40ef-8fcf-b65b1a759024 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.548101 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53742e-e772-40ef-8fcf-b65b1a759024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:10:30.548407 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53742e-e772-40ef-8fcf-b65b1a759024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:30.550051 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53742e-e772-40ef-8fcf-b65b1a759024 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:30.555112 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 776/1552] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:30 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:30.556506 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325e20f-c43d-4517-80e7-a62ab8cd5c2f None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.556805 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325e20f-c43d-4517-80e7-a62ab8cd5c2f None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.557086 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325e20f-c43d-4517-80e7-a62ab8cd5c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.563763 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 777/1553] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:10:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:10:30.569747 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53742e-e772-40ef-8fcf-b65b1a759024 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:30.580577 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53742e-e772-40ef-8fcf-b65b1a759024 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:30.590105 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-e325e20f-c43d-4517-80e7-a62ab8cd5c2f None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:30.591314 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-e325e20f-c43d-4517-80e7-a62ab8cd5c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:30.593758 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75451017-de40-4b50-b68d-8ba1066eb6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:30.594720 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75451017-de40-4b50-b68d-8ba1066eb6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.595004 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75451017-de40-4b50-b68d-8ba1066eb6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.595278 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75451017-de40-4b50-b68d-8ba1066eb6ea admin admin] PATH_INFO: `/v3/projects/634e831b75b845dcb9ff741abc8aa949/users/82c3c2afa8d84f0dbb1b0d423b97e256/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.607742 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 777/1554] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:30.608631 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325e20f-c43d-4517-80e7-a62ab8cd5c2f None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:30.624021 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325e20f-c43d-4517-80e7-a62ab8cd5c2f None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:30.627457 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75451017-de40-4b50-b68d-8ba1066eb6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=634e831b75b845dcb9ff741abc8aa949, user_id=82c3c2afa8d84f0dbb1b0d423b97e256, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:30.631990 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa22353-c6aa-42f5-a629-6200d43217ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:30.632657 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa22353-c6aa-42f5-a629-6200d43217ab admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.632938 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa22353-c6aa-42f5-a629-6200d43217ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.633212 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa22353-c6aa-42f5-a629-6200d43217ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.633951 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa22353-c6aa-42f5-a629-6200d43217ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:30.634074 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75451017-de40-4b50-b68d-8ba1066eb6ea admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:30.636677 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa22353-c6aa-42f5-a629-6200d43217ab admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:30.658802 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 778/1555] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:10:30 2021] PUT /identity/v3/projects/634e831b75b845dcb9ff741abc8aa949/users/82c3c2afa8d84f0dbb1b0d423b97e256/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:30.662945 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653e399-c052-4cbe-9aa5-0049eb1ac1e5 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.662945 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653e399-c052-4cbe-9aa5-0049eb1ac1e5 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.662945 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653e399-c052-4cbe-9aa5-0049eb1ac1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.692591 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 778/1556] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:10:30 2021] POST /identity/v3/projects => generated 393 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:30.693951 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6c157-9217-449d-9583-91e44b6bdd29 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.694348 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6c157-9217-449d-9583-91e44b6bdd29 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.694555 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6c157-9217-449d-9583-91e44b6bdd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.699341 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-d653e399-c052-4cbe-9aa5-0049eb1ac1e5 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:30.700715 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-d653e399-c052-4cbe-9aa5-0049eb1ac1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:30.720159 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-bff6c157-9217-449d-9583-91e44b6bdd29 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:30.721665 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-bff6c157-9217-449d-9583-91e44b6bdd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:30.765061 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 779/1557] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:30.766228 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0bca3-6291-4708-9f24-336999a4d2b4 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.766527 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0bca3-6291-4708-9f24-336999a4d2b4 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.766806 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0bca3-6291-4708-9f24-336999a4d2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.785263 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 779/1558] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:30.785639 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-b1c0bca3-6291-4708-9f24-336999a4d2b4 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:30.786659 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c2ee7-cd6f-47fb-ad5a-28b20b2b5334 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.786779 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-b1c0bca3-6291-4708-9f24-336999a4d2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:30.787007 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c2ee7-cd6f-47fb-ad5a-28b20b2b5334 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.787221 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c2ee7-cd6f-47fb-ad5a-28b20b2b5334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.795707 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 780/1559] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:30.796477 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0bca3-6291-4708-9f24-336999a4d2b4 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:30.805589 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0bca3-6291-4708-9f24-336999a4d2b4 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:30.810546 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b2ebe-60fa-4499-b7ff-e44cfa66c556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:30.811196 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b2ebe-60fa-4499-b7ff-e44cfa66c556 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.811482 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b2ebe-60fa-4499-b7ff-e44cfa66c556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.811760 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b2ebe-60fa-4499-b7ff-e44cfa66c556 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.812456 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b2ebe-60fa-4499-b7ff-e44cfa66c556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:30.813547 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-421c2ee7-cd6f-47fb-ad5a-28b20b2b5334 None None] MFA Rules not processed for user `82c3c2afa8d84f0dbb1b0d423b97e256`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:30.814498 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b2ebe-60fa-4499-b7ff-e44cfa66c556 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:30.814739 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-421c2ee7-cd6f-47fb-ad5a-28b20b2b5334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:30.834209 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 781/1560] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:10:30 2021] POST /identity/v3/users => generated 297 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:30.835463 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305bfbd-6ae2-4139-8929-8b71d6266302 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.835758 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305bfbd-6ae2-4139-8929-8b71d6266302 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.836041 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305bfbd-6ae2-4139-8929-8b71d6266302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.864314 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-0305bfbd-6ae2-4139-8929-8b71d6266302 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:30.865720 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-0305bfbd-6ae2-4139-8929-8b71d6266302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:30.873892 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 782/1561] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:30.878805 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321afa2-69b4-4b2f-9f2c-3289198930ec None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.879211 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321afa2-69b4-4b2f-9f2c-3289198930ec None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.879494 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321afa2-69b4-4b2f-9f2c-3289198930ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.879933 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 780/1562] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:30 2021] POST /identity/v3/auth/tokens => generated 3222 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:30.880969 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d2244-d865-47a3-bdb0-2f3caece2a18 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.881262 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d2244-d865-47a3-bdb0-2f3caece2a18 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.881572 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d2244-d865-47a3-bdb0-2f3caece2a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.899397 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-0321afa2-69b4-4b2f-9f2c-3289198930ec None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:30.899630 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-c09d2244-d865-47a3-bdb0-2f3caece2a18 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:30.901244 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-0321afa2-69b4-4b2f-9f2c-3289198930ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:30.901538 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c09d2244-d865-47a3-bdb0-2f3caece2a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:30.909376 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 783/1563] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:30.910607 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a6ff6-873c-460f-a7b7-fdbd6ce09c52 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.910896 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a6ff6-873c-460f-a7b7-fdbd6ce09c52 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.911174 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a6ff6-873c-460f-a7b7-fdbd6ce09c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.911448 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 781/1564] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:30.912478 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d2244-d865-47a3-bdb0-2f3caece2a18 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:30.922034 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d2244-d865-47a3-bdb0-2f3caece2a18 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:30.926513 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db088b-6d27-4733-8bd8-4e2960663777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:30.927157 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db088b-6d27-4733-8bd8-4e2960663777 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.927438 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db088b-6d27-4733-8bd8-4e2960663777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.927710 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db088b-6d27-4733-8bd8-4e2960663777 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.928434 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db088b-6d27-4733-8bd8-4e2960663777 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:10:30.928764 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db088b-6d27-4733-8bd8-4e2960663777 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:30.930394 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db088b-6d27-4733-8bd8-4e2960663777 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:30.933842 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-805a6ff6-873c-460f-a7b7-fdbd6ce09c52 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:30.935053 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-805a6ff6-873c-460f-a7b7-fdbd6ce09c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:30.950245 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 782/1565] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:10:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:10:30.950468 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 784/1566] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:30.950468 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a6ff6-873c-460f-a7b7-fdbd6ce09c52 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:30.950672 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6d19d-179e-4fdf-9841-6290b096c342 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.950672 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6d19d-179e-4fdf-9841-6290b096c342 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.950672 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6d19d-179e-4fdf-9841-6290b096c342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.959897 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a6ff6-873c-460f-a7b7-fdbd6ce09c52 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:30.964686 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d11d3-de79-48eb-9728-f9517aaf3d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:30.965341 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d11d3-de79-48eb-9728-f9517aaf3d26 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.965651 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d11d3-de79-48eb-9728-f9517aaf3d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.965929 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d11d3-de79-48eb-9728-f9517aaf3d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.966619 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-83b6d19d-179e-4fdf-9841-6290b096c342 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:30.966722 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d11d3-de79-48eb-9728-f9517aaf3d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:30.967810 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-83b6d19d-179e-4fdf-9841-6290b096c342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:30.968396 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d11d3-de79-48eb-9728-f9517aaf3d26 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:30.975698 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 783/1567] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:30.976935 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72d9cc-cdb9-4912-9cc9-a11dc8c5f20f None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.977221 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72d9cc-cdb9-4912-9cc9-a11dc8c5f20f None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.977532 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72d9cc-cdb9-4912-9cc9-a11dc8c5f20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.980151 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 785/1568] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:30 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:30.980973 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d11d3-de79-48eb-9728-f9517aaf3d26 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:30.990664 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d11d3-de79-48eb-9728-f9517aaf3d26 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:30.996040 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7a69a-64ca-4035-85d8-030af085c68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:30.996685 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7a69a-64ca-4035-85d8-030af085c68f admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:30.996965 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7a69a-64ca-4035-85d8-030af085c68f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:30.997242 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7a69a-64ca-4035-85d8-030af085c68f admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:30.997972 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7a69a-64ca-4035-85d8-030af085c68f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:30.998375 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-5b72d9cc-cdb9-4912-9cc9-a11dc8c5f20f None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:30.999566 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-5b72d9cc-cdb9-4912-9cc9-a11dc8c5f20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:30.999887 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7a69a-64ca-4035-85d8-030af085c68f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:31.007347 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 784/1569] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:31.008572 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6173e-7805-44ad-a3ef-52ed505230a6 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.008857 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6173e-7805-44ad-a3ef-52ed505230a6 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.009134 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6173e-7805-44ad-a3ef-52ed505230a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.028603 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 786/1570] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:10:30 2021] POST /identity/v3/projects => generated 357 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:31.029234 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-bfe6173e-7805-44ad-a3ef-52ed505230a6 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:31.030313 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7250035-938c-49a1-8140-3ba7a52c09dd None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.030586 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-bfe6173e-7805-44ad-a3ef-52ed505230a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:31.030755 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7250035-938c-49a1-8140-3ba7a52c09dd None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.030948 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7250035-938c-49a1-8140-3ba7a52c09dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.050665 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-a7250035-938c-49a1-8140-3ba7a52c09dd None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:31.054103 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-a7250035-938c-49a1-8140-3ba7a52c09dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:31.095783 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 785/1571] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:31.096627 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6173e-7805-44ad-a3ef-52ed505230a6 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.105860 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6173e-7805-44ad-a3ef-52ed505230a6 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:31.108448 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 787/1572] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:31.109254 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7250035-938c-49a1-8140-3ba7a52c09dd None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.110672 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f264a-9a2c-4b7a-91a0-96091bd1b10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:31.111305 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f264a-9a2c-4b7a-91a0-96091bd1b10e admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.111582 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f264a-9a2c-4b7a-91a0-96091bd1b10e admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.111851 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f264a-9a2c-4b7a-91a0-96091bd1b10e admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.112607 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f264a-9a2c-4b7a-91a0-96091bd1b10e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:10:31.112951 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f264a-9a2c-4b7a-91a0-96091bd1b10e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:31.114563 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f264a-9a2c-4b7a-91a0-96091bd1b10e admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:31.118420 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7250035-938c-49a1-8140-3ba7a52c09dd None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:31.123601 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0b20a-10a0-40f3-acc6-e0a436a4a962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:31.124235 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0b20a-10a0-40f3-acc6-e0a436a4a962 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.124520 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0b20a-10a0-40f3-acc6-e0a436a4a962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.124794 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0b20a-10a0-40f3-acc6-e0a436a4a962 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.125524 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0b20a-10a0-40f3-acc6-e0a436a4a962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:31.126348 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 786/1573] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:10:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:10:31.127128 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f264a-9a2c-4b7a-91a0-96091bd1b10e admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.127496 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0b20a-10a0-40f3-acc6-e0a436a4a962 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:31.136363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f264a-9a2c-4b7a-91a0-96091bd1b10e admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:31.140850 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4905b3-d241-4a8d-99c2-4c4023741a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:31.141502 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4905b3-d241-4a8d-99c2-4c4023741a59 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.141800 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4905b3-d241-4a8d-99c2-4c4023741a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.142048 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4905b3-d241-4a8d-99c2-4c4023741a59 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.142903 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4905b3-d241-4a8d-99c2-4c4023741a59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:10:31.143351 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4905b3-d241-4a8d-99c2-4c4023741a59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:31.145419 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4905b3-d241-4a8d-99c2-4c4023741a59 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:31.152874 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 788/1574] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:10:31 2021] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:31.152874 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0b20a-10a0-40f3-acc6-e0a436a4a962 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.165558 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 787/1575] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:10:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:10:31.165558 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4905b3-d241-4a8d-99c2-4c4023741a59 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.172078 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4905b3-d241-4a8d-99c2-4c4023741a59 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:31.220154 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0b20a-10a0-40f3-acc6-e0a436a4a962 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:31.224704 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ed392-6f65-46a0-8b4e-750605c14cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:31.225362 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ed392-6f65-46a0-8b4e-750605c14cca admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.225680 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ed392-6f65-46a0-8b4e-750605c14cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.225957 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ed392-6f65-46a0-8b4e-750605c14cca admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.226689 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ed392-6f65-46a0-8b4e-750605c14cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:31.228335 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ed392-6f65-46a0-8b4e-750605c14cca admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:31.229147 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6d891-eb47-4d86-8eb8-9e75b2b875bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:31.229829 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6d891-eb47-4d86-8eb8-9e75b2b875bb admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.230112 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6d891-eb47-4d86-8eb8-9e75b2b875bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.230385 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6d891-eb47-4d86-8eb8-9e75b2b875bb admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.231108 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6d891-eb47-4d86-8eb8-9e75b2b875bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:10:31.231465 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6d891-eb47-4d86-8eb8-9e75b2b875bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:31.233111 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6d891-eb47-4d86-8eb8-9e75b2b875bb admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:31.237987 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 789/1576] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:31 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:31.238765 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ed392-6f65-46a0-8b4e-750605c14cca admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.245145 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 788/1577] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:10:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:10:31.245994 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6d891-eb47-4d86-8eb8-9e75b2b875bb admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.253565 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ed392-6f65-46a0-8b4e-750605c14cca admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:31.255230 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6d891-eb47-4d86-8eb8-9e75b2b875bb admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:31.258114 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2187d2-c5f6-4691-9925-fb461ed7f2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:31.258774 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2187d2-c5f6-4691-9925-fb461ed7f2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.259064 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2187d2-c5f6-4691-9925-fb461ed7f2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.259322 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2187d2-c5f6-4691-9925-fb461ed7f2e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.260800 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2187d2-c5f6-4691-9925-fb461ed7f2e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:31.260934 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f13735-760e-4bbf-a409-13635b852878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:31.261475 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f13735-760e-4bbf-a409-13635b852878 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.261807 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f13735-760e-4bbf-a409-13635b852878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.262088 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f13735-760e-4bbf-a409-13635b852878 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.262748 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2187d2-c5f6-4691-9925-fb461ed7f2e8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:31.262874 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f13735-760e-4bbf-a409-13635b852878 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:10:31.263107 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f13735-760e-4bbf-a409-13635b852878 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:31.264703 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f13735-760e-4bbf-a409-13635b852878 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:31.277930 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 789/1578] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:10:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:10:31.278742 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f13735-760e-4bbf-a409-13635b852878 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.287455 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 790/1579] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:10:31 2021] POST /identity/v3/users => generated 285 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:31.288506 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2187d2-c5f6-4691-9925-fb461ed7f2e8 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.288628 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f13735-760e-4bbf-a409-13635b852878 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:31.294077 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1347b-5953-4b02-a929-598ae1cf43db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:31.294750 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1347b-5953-4b02-a929-598ae1cf43db admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.295035 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1347b-5953-4b02-a929-598ae1cf43db admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.295317 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1347b-5953-4b02-a929-598ae1cf43db admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.296091 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1347b-5953-4b02-a929-598ae1cf43db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:10:31.296402 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1347b-5953-4b02-a929-598ae1cf43db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:31.298095 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1347b-5953-4b02-a929-598ae1cf43db admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:31.300105 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2187d2-c5f6-4691-9925-fb461ed7f2e8 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:31.305177 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b04d2-0a35-4494-abe0-0afe698b6da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:31.305927 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b04d2-0a35-4494-abe0-0afe698b6da9 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.307207 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b04d2-0a35-4494-abe0-0afe698b6da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.307207 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b04d2-0a35-4494-abe0-0afe698b6da9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.307615 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b04d2-0a35-4494-abe0-0afe698b6da9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:31.311039 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b04d2-0a35-4494-abe0-0afe698b6da9 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:31.311189 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 790/1580] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:10:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:10:31.311189 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1347b-5953-4b02-a929-598ae1cf43db admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.333542 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1347b-5953-4b02-a929-598ae1cf43db admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:31.336963 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 791/1581] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:10:31 2021] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:31.338630 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b04d2-0a35-4494-abe0-0afe698b6da9 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.340588 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fdd28-6e96-40ac-921d-7f52a8caac52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:31.341726 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fdd28-6e96-40ac-921d-7f52a8caac52 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.342356 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fdd28-6e96-40ac-921d-7f52a8caac52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.342795 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fdd28-6e96-40ac-921d-7f52a8caac52 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.343897 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fdd28-6e96-40ac-921d-7f52a8caac52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:31.346066 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fdd28-6e96-40ac-921d-7f52a8caac52 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:31.369174 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 791/1582] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:10:31 2021] POST /identity/v3/users => generated 287 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:31.370651 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fdd28-6e96-40ac-921d-7f52a8caac52 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.385738 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fdd28-6e96-40ac-921d-7f52a8caac52 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:31.408871 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b04d2-0a35-4494-abe0-0afe698b6da9 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:31.413801 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909ce88-8167-452b-b7dc-f13c8917ff0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:31.414473 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909ce88-8167-452b-b7dc-f13c8917ff0a admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.414733 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909ce88-8167-452b-b7dc-f13c8917ff0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.415002 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909ce88-8167-452b-b7dc-f13c8917ff0a admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.415783 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909ce88-8167-452b-b7dc-f13c8917ff0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:31.418758 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909ce88-8167-452b-b7dc-f13c8917ff0a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:31.447703 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb4cfa-f073-4fb8-950b-c955105ed0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:31.448438 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 792/1583] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:10:31 2021] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:31.448749 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb4cfa-f073-4fb8-950b-c955105ed0db admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.449032 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb4cfa-f073-4fb8-950b-c955105ed0db admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.449447 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb4cfa-f073-4fb8-950b-c955105ed0db admin admin] PATH_INFO: `/v3/projects/9f1847fe78e7459f800877907c42878d/users/c7af97c50dab46dd85477944b2450a4d/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.450259 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909ce88-8167-452b-b7dc-f13c8917ff0a admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.463784 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb4cfa-f073-4fb8-950b-c955105ed0db admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f1847fe78e7459f800877907c42878d, user_id=c7af97c50dab46dd85477944b2450a4d, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:31.466463 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb4cfa-f073-4fb8-950b-c955105ed0db admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:31.479900 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 792/1584] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:10:31 2021] PUT /identity/v3/projects/9f1847fe78e7459f800877907c42878d/users/c7af97c50dab46dd85477944b2450a4d/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:31.480888 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb4cfa-f073-4fb8-950b-c955105ed0db admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.508795 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909ce88-8167-452b-b7dc-f13c8917ff0a admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:31.541081 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb4cfa-f073-4fb8-950b-c955105ed0db admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:31.545743 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc1e16-03dc-4b69-a278-1b6aa5c96456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:31.546398 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc1e16-03dc-4b69-a278-1b6aa5c96456 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.546684 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc1e16-03dc-4b69-a278-1b6aa5c96456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.546960 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc1e16-03dc-4b69-a278-1b6aa5c96456 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.547668 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc1e16-03dc-4b69-a278-1b6aa5c96456 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:31.549599 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc1e16-03dc-4b69-a278-1b6aa5c96456 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:31.565335 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d630bf6-2d69-4dcf-b617-6017cf0e2d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:31.566028 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d630bf6-2d69-4dcf-b617-6017cf0e2d04 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.566337 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d630bf6-2d69-4dcf-b617-6017cf0e2d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.566608 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d630bf6-2d69-4dcf-b617-6017cf0e2d04 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.567309 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d630bf6-2d69-4dcf-b617-6017cf0e2d04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:31.569217 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d630bf6-2d69-4dcf-b617-6017cf0e2d04 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:31.576604 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 793/1585] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:10:31 2021] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:31.577641 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc1e16-03dc-4b69-a278-1b6aa5c96456 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.598948 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 793/1586] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:10:31 2021] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:31.598948 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d630bf6-2d69-4dcf-b617-6017cf0e2d04 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.643559 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc1e16-03dc-4b69-a278-1b6aa5c96456 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:31.659622 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d630bf6-2d69-4dcf-b617-6017cf0e2d04 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:31.664397 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd67e7-a479-40d9-8a9a-2c19436b4236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:31.665052 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd67e7-a479-40d9-8a9a-2c19436b4236 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.665331 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd67e7-a479-40d9-8a9a-2c19436b4236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.666443 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd67e7-a479-40d9-8a9a-2c19436b4236 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.667289 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd67e7-a479-40d9-8a9a-2c19436b4236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:31.669202 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd67e7-a479-40d9-8a9a-2c19436b4236 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:31.695137 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 794/1587] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:10:31 2021] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:31.696230 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd67e7-a479-40d9-8a9a-2c19436b4236 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.702347 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51aab9-894f-417a-a343-f084e449e52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:31.703182 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51aab9-894f-417a-a343-f084e449e52a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.703473 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51aab9-894f-417a-a343-f084e449e52a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.703908 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51aab9-894f-417a-a343-f084e449e52a admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.704674 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51aab9-894f-417a-a343-f084e449e52a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:31.706313 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51aab9-894f-417a-a343-f084e449e52a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:31.719525 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 794/1588] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:31 2021] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:31.719525 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51aab9-894f-417a-a343-f084e449e52a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.729573 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51aab9-894f-417a-a343-f084e449e52a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:31.758313 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd67e7-a479-40d9-8a9a-2c19436b4236 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:31.763040 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac707f8-dcb3-4af7-854a-ce5a85e0d59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:31.763759 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac707f8-dcb3-4af7-854a-ce5a85e0d59a admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.764049 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac707f8-dcb3-4af7-854a-ce5a85e0d59a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.764355 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac707f8-dcb3-4af7-854a-ce5a85e0d59a admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.765052 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac707f8-dcb3-4af7-854a-ce5a85e0d59a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:31.767026 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac707f8-dcb3-4af7-854a-ce5a85e0d59a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:31.785091 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd18c5-31c7-47ac-a176-db27bb930ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:31.785784 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd18c5-31c7-47ac-a176-db27bb930ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.786068 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd18c5-31c7-47ac-a176-db27bb930ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.786341 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd18c5-31c7-47ac-a176-db27bb930ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.787111 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd18c5-31c7-47ac-a176-db27bb930ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:31.787766 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 795/1589] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:10:31 2021] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:31.788548 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac707f8-dcb3-4af7-854a-ce5a85e0d59a admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.788858 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd18c5-31c7-47ac-a176-db27bb930ed9 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:31.798628 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac707f8-dcb3-4af7-854a-ce5a85e0d59a admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:31.802356 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 795/1590] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:31 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:31.802356 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0fff1-b350-4bc1-b580-1926100bb1b8 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.802356 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0fff1-b350-4bc1-b580-1926100bb1b8 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.802356 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0fff1-b350-4bc1-b580-1926100bb1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.806693 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c4a39-0f81-4eb2-aa9f-9bf68c2fd715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:31.807370 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c4a39-0f81-4eb2-aa9f-9bf68c2fd715 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.807675 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c4a39-0f81-4eb2-aa9f-9bf68c2fd715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.807945 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c4a39-0f81-4eb2-aa9f-9bf68c2fd715 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.808664 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c4a39-0f81-4eb2-aa9f-9bf68c2fd715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:31.810627 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c4a39-0f81-4eb2-aa9f-9bf68c2fd715 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:31.818235 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-22b0fff1-b350-4bc1-b580-1926100bb1b8 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:31.819443 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-22b0fff1-b350-4bc1-b580-1926100bb1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:31.828696 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 796/1591] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:31.829269 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0fff1-b350-4bc1-b580-1926100bb1b8 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.837118 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 796/1592] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:10:31 2021] POST /identity/v3/users => generated 291 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:31.837118 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c4a39-0f81-4eb2-aa9f-9bf68c2fd715 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.839031 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0fff1-b350-4bc1-b580-1926100bb1b8 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:31.844132 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d96460-0283-4dd9-9634-b3a457132767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:31.844797 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d96460-0283-4dd9-9634-b3a457132767 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.844905 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c4a39-0f81-4eb2-aa9f-9bf68c2fd715 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:31.845078 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d96460-0283-4dd9-9634-b3a457132767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.845351 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d96460-0283-4dd9-9634-b3a457132767 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.846089 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d96460-0283-4dd9-9634-b3a457132767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:31.848021 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d96460-0283-4dd9-9634-b3a457132767 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:31.849625 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4658cd-da11-472f-bfc9-e3342ba58ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:31.850210 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4658cd-da11-472f-bfc9-e3342ba58ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.850490 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4658cd-da11-472f-bfc9-e3342ba58ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.850757 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4658cd-da11-472f-bfc9-e3342ba58ac7 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.851439 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4658cd-da11-472f-bfc9-e3342ba58ac7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:31.854120 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4658cd-da11-472f-bfc9-e3342ba58ac7 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:31.871343 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 797/1593] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:10:31 2021] POST /identity/v3/users => generated 283 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:31.871343 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d96460-0283-4dd9-9634-b3a457132767 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.874461 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 797/1594] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:10:31 2021] POST /identity/v3/users => generated 288 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:31.877567 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4658cd-da11-472f-bfc9-e3342ba58ac7 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.878432 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d96460-0283-4dd9-9634-b3a457132767 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:31.882930 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ea629-dc99-4965-82c5-be6769232bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:31.883570 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ea629-dc99-4965-82c5-be6769232bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.883852 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ea629-dc99-4965-82c5-be6769232bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.884125 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ea629-dc99-4965-82c5-be6769232bb1 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.885026 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4658cd-da11-472f-bfc9-e3342ba58ac7 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:31.885345 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ea629-dc99-4965-82c5-be6769232bb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:31.887274 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ea629-dc99-4965-82c5-be6769232bb1 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:31.889571 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dba3f-4d08-4812-bc4f-a15a133b7e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:31.890410 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dba3f-4d08-4812-bc4f-a15a133b7e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.890690 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dba3f-4d08-4812-bc4f-a15a133b7e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.890961 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dba3f-4d08-4812-bc4f-a15a133b7e27 admin admin] PATH_INFO: `/v3/projects/3ef2200f28c8424790674e3a1436fd6d/users/aad9244529a241b7b4f89f7280cfb832/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.906166 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5dba3f-4d08-4812-bc4f-a15a133b7e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ef2200f28c8424790674e3a1436fd6d, user_id=aad9244529a241b7b4f89f7280cfb832, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:31.907162 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 798/1595] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:10:31 2021] POST /identity/v3/users => generated 295 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:31.908216 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ea629-dc99-4965-82c5-be6769232bb1 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.909092 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5dba3f-4d08-4812-bc4f-a15a133b7e27 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:31.918996 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ea629-dc99-4965-82c5-be6769232bb1 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:31.923045 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 798/1596] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:10:31 2021] PUT /identity/v3/projects/3ef2200f28c8424790674e3a1436fd6d/users/aad9244529a241b7b4f89f7280cfb832/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:31.923847 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dba3f-4d08-4812-bc4f-a15a133b7e27 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.974707 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2657109-530a-47aa-a952-10c5075637b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:31.975373 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2657109-530a-47aa-a952-10c5075637b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.975658 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2657109-530a-47aa-a952-10c5075637b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.975976 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2657109-530a-47aa-a952-10c5075637b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.976838 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2657109-530a-47aa-a952-10c5075637b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:31.978559 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2657109-530a-47aa-a952-10c5075637b8 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:31.986024 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dba3f-4d08-4812-bc4f-a15a133b7e27 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:31.988765 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 799/1597] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:31 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:31.989612 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2657109-530a-47aa-a952-10c5075637b8 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:31.993302 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e632a1f-8b76-4186-adbd-2b3ce039d819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:31.994042 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e632a1f-8b76-4186-adbd-2b3ce039d819 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:31.994318 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e632a1f-8b76-4186-adbd-2b3ce039d819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:31.994755 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e632a1f-8b76-4186-adbd-2b3ce039d819 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:31.995490 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e632a1f-8b76-4186-adbd-2b3ce039d819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:31.997092 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e632a1f-8b76-4186-adbd-2b3ce039d819 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:32.001210 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2657109-530a-47aa-a952-10c5075637b8 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:32.005924 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d1e53-fdec-4fac-8931-bfe3a7955fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:32.006600 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d1e53-fdec-4fac-8931-bfe3a7955fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:32.006886 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d1e53-fdec-4fac-8931-bfe3a7955fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:32.007161 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d1e53-fdec-4fac-8931-bfe3a7955fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:32.007390 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 799/1598] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:31 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:32.007901 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d1e53-fdec-4fac-8931-bfe3a7955fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:32.008193 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e632a1f-8b76-4186-adbd-2b3ce039d819 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:32.010463 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d1e53-fdec-4fac-8931-bfe3a7955fd2 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:32.021153 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 800/1599] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:31 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:32.022063 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d1e53-fdec-4fac-8931-bfe3a7955fd2 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:32.031989 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d1e53-fdec-4fac-8931-bfe3a7955fd2 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:32.036801 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4aba8-b89d-4cf9-8f07-a76484cb28cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:32.040347 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4aba8-b89d-4cf9-8f07-a76484cb28cc admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:32.040347 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4aba8-b89d-4cf9-8f07-a76484cb28cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:32.040347 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4aba8-b89d-4cf9-8f07-a76484cb28cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:32.040347 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4aba8-b89d-4cf9-8f07-a76484cb28cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:32.040347 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4aba8-b89d-4cf9-8f07-a76484cb28cc admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:32.050263 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 801/1600] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:32 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:32.054732 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4aba8-b89d-4cf9-8f07-a76484cb28cc admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:32.064539 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e632a1f-8b76-4186-adbd-2b3ce039d819 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:32.064720 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4aba8-b89d-4cf9-8f07-a76484cb28cc admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:32.068159 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bcf2a5-4d79-4154-b6bd-8426315bba47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:32.068800 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcf2a5-4d79-4154-b6bd-8426315bba47 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:32.069083 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcf2a5-4d79-4154-b6bd-8426315bba47 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:32.069187 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f29f2a-1696-44c7-b95e-ceea0d9d8239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:32.069358 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcf2a5-4d79-4154-b6bd-8426315bba47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:32.069815 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f29f2a-1696-44c7-b95e-ceea0d9d8239 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:32.070100 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f29f2a-1696-44c7-b95e-ceea0d9d8239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:32.070379 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f29f2a-1696-44c7-b95e-ceea0d9d8239 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:32.071115 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f29f2a-1696-44c7-b95e-ceea0d9d8239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:32.073221 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f29f2a-1696-44c7-b95e-ceea0d9d8239 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:32.079617 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bcf2a5-4d79-4154-b6bd-8426315bba47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:32.081046 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bcf2a5-4d79-4154-b6bd-8426315bba47 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:32.083064 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 802/1601] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:32 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:32.083763 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f29f2a-1696-44c7-b95e-ceea0d9d8239 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:32.091739 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 800/1602] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:32.092777 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bcf2a5-4d79-4154-b6bd-8426315bba47 service neutron] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:32.093487 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f29f2a-1696-44c7-b95e-ceea0d9d8239 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:32.098238 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7d7db-349d-4646-a32b-0775739ab146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:32.098885 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7d7db-349d-4646-a32b-0775739ab146 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:32.099174 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7d7db-349d-4646-a32b-0775739ab146 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:32.099450 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7d7db-349d-4646-a32b-0775739ab146 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:32.100238 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7d7db-349d-4646-a32b-0775739ab146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:32.101819 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7d7db-349d-4646-a32b-0775739ab146 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:32.102331 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bcf2a5-4d79-4154-b6bd-8426315bba47 service neutron] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:32.107262 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcc58f-6eb2-4f59-a6af-f4a65328cbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:32.107811 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcc58f-6eb2-4f59-a6af-f4a65328cbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:32.108094 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcc58f-6eb2-4f59-a6af-f4a65328cbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:32.108365 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcc58f-6eb2-4f59-a6af-f4a65328cbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:32.109102 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbcc58f-6eb2-4f59-a6af-f4a65328cbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:32.110710 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbcc58f-6eb2-4f59-a6af-f4a65328cbb7 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:32.112419 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 803/1603] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:32 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:32.114415 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7d7db-349d-4646-a32b-0775739ab146 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:32.125227 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 801/1604] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:32 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:32.125227 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcc58f-6eb2-4f59-a6af-f4a65328cbb7 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:32.126381 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7d7db-349d-4646-a32b-0775739ab146 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:32.132369 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad0ae6-e1c6-4ace-86d9-affb247be46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:32.132692 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcc58f-6eb2-4f59-a6af-f4a65328cbb7 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:32.133025 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad0ae6-e1c6-4ace-86d9-affb247be46a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:32.133303 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad0ae6-e1c6-4ace-86d9-affb247be46a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:32.133615 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad0ae6-e1c6-4ace-86d9-affb247be46a admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:32.134885 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad0ae6-e1c6-4ace-86d9-affb247be46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:32.136629 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad0ae6-e1c6-4ace-86d9-affb247be46a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:32.138094 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db25e7-5199-47a2-927a-f8ae2b0015e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:32.138977 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db25e7-5199-47a2-927a-f8ae2b0015e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:32.139305 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db25e7-5199-47a2-927a-f8ae2b0015e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:32.139581 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db25e7-5199-47a2-927a-f8ae2b0015e1 admin admin] PATH_INFO: `/v3/projects/a4a109f1f5954fd997092dcd73c6680f/users/0888ea1a0e6e47dab38c211d3540a464/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:32.147051 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 804/1605] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:32 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:32.151748 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad0ae6-e1c6-4ace-86d9-affb247be46a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:32.155621 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db25e7-5199-47a2-927a-f8ae2b0015e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4a109f1f5954fd997092dcd73c6680f, user_id=0888ea1a0e6e47dab38c211d3540a464, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:32.159063 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db25e7-5199-47a2-927a-f8ae2b0015e1 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:32.162120 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad0ae6-e1c6-4ace-86d9-affb247be46a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:32.167691 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be60fa-4f29-4a1d-a992-82e78cce8656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:32.168430 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be60fa-4f29-4a1d-a992-82e78cce8656 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:32.168675 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be60fa-4f29-4a1d-a992-82e78cce8656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:32.168973 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be60fa-4f29-4a1d-a992-82e78cce8656 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:32.169718 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be60fa-4f29-4a1d-a992-82e78cce8656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:32.171319 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be60fa-4f29-4a1d-a992-82e78cce8656 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:32.173287 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 802/1606] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:10:32 2021] PUT /identity/v3/projects/a4a109f1f5954fd997092dcd73c6680f/users/0888ea1a0e6e47dab38c211d3540a464/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:32.174134 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db25e7-5199-47a2-927a-f8ae2b0015e1 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:32.195017 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 805/1607] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:32 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:32.196318 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be60fa-4f29-4a1d-a992-82e78cce8656 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:32.207362 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be60fa-4f29-4a1d-a992-82e78cce8656 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:32.249036 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db25e7-5199-47a2-927a-f8ae2b0015e1 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:32.254870 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f72ae-f573-4668-bf89-de7da246fb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:32.255401 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f72ae-f573-4668-bf89-de7da246fb50 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:32.255684 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f72ae-f573-4668-bf89-de7da246fb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:32.255959 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f72ae-f573-4668-bf89-de7da246fb50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:32.256697 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f72ae-f573-4668-bf89-de7da246fb50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:32.258471 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f72ae-f573-4668-bf89-de7da246fb50 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:32.267282 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd714e7-d94c-461a-8ccc-e07e82f09d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:32.267954 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd714e7-d94c-461a-8ccc-e07e82f09d41 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:32.268241 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd714e7-d94c-461a-8ccc-e07e82f09d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:32.268498 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd714e7-d94c-461a-8ccc-e07e82f09d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:32.268986 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 803/1608] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:32 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:32.269972 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f72ae-f573-4668-bf89-de7da246fb50 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:32.272781 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd714e7-d94c-461a-8ccc-e07e82f09d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:32.276085 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd714e7-d94c-461a-8ccc-e07e82f09d41 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:32.284156 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f72ae-f573-4668-bf89-de7da246fb50 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:32.286227 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 806/1609] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:32 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:32.286996 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd714e7-d94c-461a-8ccc-e07e82f09d41 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:32.295908 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806ab5d-6e75-40a0-bee5-dbbfac3687a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:32.296467 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806ab5d-6e75-40a0-bee5-dbbfac3687a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:32.296741 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806ab5d-6e75-40a0-bee5-dbbfac3687a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:32.298557 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806ab5d-6e75-40a0-bee5-dbbfac3687a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:32.298557 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806ab5d-6e75-40a0-bee5-dbbfac3687a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:32.298778 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd714e7-d94c-461a-8ccc-e07e82f09d41 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:32.299405 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806ab5d-6e75-40a0-bee5-dbbfac3687a3 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:32.303774 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4ac67-23d6-4c87-9b47-90dadb1544f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:32.307240 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4ac67-23d6-4c87-9b47-90dadb1544f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:32.307240 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4ac67-23d6-4c87-9b47-90dadb1544f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:32.307240 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4ac67-23d6-4c87-9b47-90dadb1544f5 admin admin] PATH_INFO: `/v3/projects/3ef2200f28c8424790674e3a1436fd6d/users/aad9244529a241b7b4f89f7280cfb832/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:32.307560 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4ac67-23d6-4c87-9b47-90dadb1544f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ef2200f28c8424790674e3a1436fd6d, user_id=aad9244529a241b7b4f89f7280cfb832, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:32.310053 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4ac67-23d6-4c87-9b47-90dadb1544f5 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:32.312595 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 804/1610] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:32 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:32.313520 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806ab5d-6e75-40a0-bee5-dbbfac3687a3 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:32.325750 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 807/1611] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:10:32 2021] PUT /identity/v3/projects/3ef2200f28c8424790674e3a1436fd6d/users/aad9244529a241b7b4f89f7280cfb832/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:32.326022 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806ab5d-6e75-40a0-bee5-dbbfac3687a3 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:32.327292 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f2a16-6e0b-4ef1-ba28-34abdec4b9ad None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:32.327579 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f2a16-6e0b-4ef1-ba28-34abdec4b9ad None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:32.327858 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f2a16-6e0b-4ef1-ba28-34abdec4b9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:32.364658 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-eb0f2a16-6e0b-4ef1-ba28-34abdec4b9ad None None] MFA Rules not processed for user `0888ea1a0e6e47dab38c211d3540a464`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:32.366312 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-eb0f2a16-6e0b-4ef1-ba28-34abdec4b9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:32.392570 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cb8da-e4c9-4b94-a7d8-9cbba382a00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:32.393483 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cb8da-e4c9-4b94-a7d8-9cbba382a00b admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:32.393755 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cb8da-e4c9-4b94-a7d8-9cbba382a00b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:32.394035 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cb8da-e4c9-4b94-a7d8-9cbba382a00b admin admin] PATH_INFO: `/v3/projects/a4e05d818bd84699ab687f2b8bd98f74/users/157871d7f3574d73abe239ab6ce7137d/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:32.409165 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cb8da-e4c9-4b94-a7d8-9cbba382a00b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e05d818bd84699ab687f2b8bd98f74, user_id=157871d7f3574d73abe239ab6ce7137d, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:32.411846 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cb8da-e4c9-4b94-a7d8-9cbba382a00b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:32.426172 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 805/1612] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:10:32 2021] PUT /identity/v3/projects/a4e05d818bd84699ab687f2b8bd98f74/users/157871d7f3574d73abe239ab6ce7137d/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:32.426812 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cb8da-e4c9-4b94-a7d8-9cbba382a00b admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:32.440478 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 808/1613] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:32 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:32.441381 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f2a16-6e0b-4ef1-ba28-34abdec4b9ad None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:32.472914 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f2a16-6e0b-4ef1-ba28-34abdec4b9ad None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:32.521235 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cb8da-e4c9-4b94-a7d8-9cbba382a00b admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:32.528550 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368c5bf-21af-4df9-a57c-64529b4e7bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:32.529488 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368c5bf-21af-4df9-a57c-64529b4e7bda admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:32.529772 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368c5bf-21af-4df9-a57c-64529b4e7bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:32.530048 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368c5bf-21af-4df9-a57c-64529b4e7bda admin admin] PATH_INFO: `/v3/projects/59432b92e45948e5962f7a60e09135b3/users/df09b0b78f6646ed8c520c5c46b3eb58/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:32.540016 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af937f09-a527-4dc1-97d7-e6a9cfc47c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:32.540539 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af937f09-a527-4dc1-97d7-e6a9cfc47c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:32.541399 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af937f09-a527-4dc1-97d7-e6a9cfc47c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:32.541684 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af937f09-a527-4dc1-97d7-e6a9cfc47c9c admin admin] PATH_INFO: `/v3/projects/fe8423c4c8414c5287b43938d550e39b/users/51c0b02fca2244a69a719ca74b3c2f9a/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:32.546822 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368c5bf-21af-4df9-a57c-64529b4e7bda admin admin] RBAC: Authorizing `identity:create_grant(project_id=59432b92e45948e5962f7a60e09135b3, user_id=df09b0b78f6646ed8c520c5c46b3eb58, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:32.549867 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368c5bf-21af-4df9-a57c-64529b4e7bda admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:32.558735 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af937f09-a527-4dc1-97d7-e6a9cfc47c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe8423c4c8414c5287b43938d550e39b, user_id=51c0b02fca2244a69a719ca74b3c2f9a, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:32.561839 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af937f09-a527-4dc1-97d7-e6a9cfc47c9c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:32.566169 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 806/1614] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:10:32 2021] PUT /identity/v3/projects/59432b92e45948e5962f7a60e09135b3/users/df09b0b78f6646ed8c520c5c46b3eb58/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:32.566954 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368c5bf-21af-4df9-a57c-64529b4e7bda admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:32.581413 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 809/1615] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:10:32 2021] PUT /identity/v3/projects/fe8423c4c8414c5287b43938d550e39b/users/51c0b02fca2244a69a719ca74b3c2f9a/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:32.583278 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af937f09-a527-4dc1-97d7-e6a9cfc47c9c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:32.633961 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368c5bf-21af-4df9-a57c-64529b4e7bda admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:32.659803 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af937f09-a527-4dc1-97d7-e6a9cfc47c9c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:32.665297 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fae4bb-beb4-4e06-97bf-d2b0867538b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:32.667045 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fae4bb-beb4-4e06-97bf-d2b0867538b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:32.667369 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fae4bb-beb4-4e06-97bf-d2b0867538b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:32.667646 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fae4bb-beb4-4e06-97bf-d2b0867538b9 admin admin] PATH_INFO: `/v3/projects/4293903670af4a238fe13d805fcd9d59/users/2b01ba54246a4e8482417367b6329c1a/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:32.684954 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fae4bb-beb4-4e06-97bf-d2b0867538b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4293903670af4a238fe13d805fcd9d59, user_id=2b01ba54246a4e8482417367b6329c1a, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:32.687763 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fae4bb-beb4-4e06-97bf-d2b0867538b9 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:32.693059 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e6d30-7568-4634-b64d-788bdc14a678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:32.694316 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e6d30-7568-4634-b64d-788bdc14a678 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:32.694669 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e6d30-7568-4634-b64d-788bdc14a678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:32.695018 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e6d30-7568-4634-b64d-788bdc14a678 admin admin] PATH_INFO: `/v3/projects/d876e8f6e278448196f8e8989149241c/users/d1e314d7ae7a491ab057a93961c7c3b5/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:32.701868 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 810/1616] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:10:32 2021] PUT /identity/v3/projects/4293903670af4a238fe13d805fcd9d59/users/2b01ba54246a4e8482417367b6329c1a/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:32.703382 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed825f-a648-4dc4-8161-fd0f3a70a971 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:32.703675 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed825f-a648-4dc4-8161-fd0f3a70a971 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:32.703953 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed825f-a648-4dc4-8161-fd0f3a70a971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:32.713676 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e6d30-7568-4634-b64d-788bdc14a678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d876e8f6e278448196f8e8989149241c, user_id=d1e314d7ae7a491ab057a93961c7c3b5, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:32.716604 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e6d30-7568-4634-b64d-788bdc14a678 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:32.732802 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 807/1617] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:10:32 2021] PUT /identity/v3/projects/d876e8f6e278448196f8e8989149241c/users/d1e314d7ae7a491ab057a93961c7c3b5/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:32.733829 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-96ed825f-a648-4dc4-8161-fd0f3a70a971 None None] MFA Rules not processed for user `aad9244529a241b7b4f89f7280cfb832`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:32.735309 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-96ed825f-a648-4dc4-8161-fd0f3a70a971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:32.738095 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12317f-33ab-48fc-a2e6-0725fd59285f None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:32.738381 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12317f-33ab-48fc-a2e6-0725fd59285f None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:32.738680 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12317f-33ab-48fc-a2e6-0725fd59285f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:32.766681 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-6d12317f-33ab-48fc-a2e6-0725fd59285f None None] MFA Rules not processed for user `157871d7f3574d73abe239ab6ce7137d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:32.767910 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-6d12317f-33ab-48fc-a2e6-0725fd59285f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:32.820234 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 811/1618] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:32 2021] POST /identity/v3/auth/tokens => generated 3291 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:32.821241 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed825f-a648-4dc4-8161-fd0f3a70a971 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:32.849850 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 808/1619] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:32 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:32.851204 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb4521-6c23-4434-9464-3ac7d167c45c None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:32.851499 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb4521-6c23-4434-9464-3ac7d167c45c None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:32.851772 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb4521-6c23-4434-9464-3ac7d167c45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:32.871672 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-65fb4521-6c23-4434-9464-3ac7d167c45c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:32.872876 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-65fb4521-6c23-4434-9464-3ac7d167c45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:32.909252 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed825f-a648-4dc4-8161-fd0f3a70a971 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:32.921351 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d4440-af3c-41dd-8759-d38ddc76ca24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:32.922053 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d4440-af3c-41dd-8759-d38ddc76ca24 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:32.922334 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d4440-af3c-41dd-8759-d38ddc76ca24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:32.922799 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d4440-af3c-41dd-8759-d38ddc76ca24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:32.923313 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d4440-af3c-41dd-8759-d38ddc76ca24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:32.925224 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d4440-af3c-41dd-8759-d38ddc76ca24 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:32.945480 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 809/1620] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:32.947214 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cd274-e756-4245-a62f-796facc1f296 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:32.947574 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cd274-e756-4245-a62f-796facc1f296 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:32.948014 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cd274-e756-4245-a62f-796facc1f296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:32.965727 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 812/1621] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:10:32 2021] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:32.967462 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcb728-bc72-49b7-99d8-38c08bf23084 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:32.967962 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcb728-bc72-49b7-99d8-38c08bf23084 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:32.968439 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcb728-bc72-49b7-99d8-38c08bf23084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:32.983260 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-7e2cd274-e756-4245-a62f-796facc1f296 None None] MFA Rules not processed for user `51c0b02fca2244a69a719ca74b3c2f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:32.984640 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-7e2cd274-e756-4245-a62f-796facc1f296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:32.991548 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-26bcb728-bc72-49b7-99d8-38c08bf23084 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:32.994392 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-26bcb728-bc72-49b7-99d8-38c08bf23084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:33.067065 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 813/1622] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:33.068366 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6191349-64ab-4e5f-ab6e-a2fff1bc8f96 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:33.068655 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6191349-64ab-4e5f-ab6e-a2fff1bc8f96 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:33.068928 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6191349-64ab-4e5f-ab6e-a2fff1bc8f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:33.089254 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 810/1623] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:32 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:33.090248 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cd274-e756-4245-a62f-796facc1f296 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:33.097825 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-e6191349-64ab-4e5f-ab6e-a2fff1bc8f96 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:33.099811 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-e6191349-64ab-4e5f-ab6e-a2fff1bc8f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:33.111083 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 814/1624] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:33.112528 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef672e-e018-4d2e-bf11-d9556e1a7fb2 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:33.112922 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef672e-e018-4d2e-bf11-d9556e1a7fb2 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:33.113301 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef672e-e018-4d2e-bf11-d9556e1a7fb2 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:33.122610 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 815/1625] 10.222.0.36 () {54 vars in 961 bytes} [Wed Dec 15 16:10:33 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:10:33.123443 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef672e-e018-4d2e-bf11-d9556e1a7fb2 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:33.125357 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-43ef672e-e018-4d2e-bf11-d9556e1a7fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:33.151130 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cd274-e756-4245-a62f-796facc1f296 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:33.156450 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172872e-64b9-4573-99d9-0c33039c823a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:33.157312 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172872e-64b9-4573-99d9-0c33039c823a service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:33.157695 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172872e-64b9-4573-99d9-0c33039c823a service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:33.158234 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172872e-64b9-4573-99d9-0c33039c823a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:33.188638 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef672e-e018-4d2e-bf11-d9556e1a7fb2 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:33.192806 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8c009-247a-4860-b490-50f0041d4f8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:33.193488 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8c009-247a-4860-b490-50f0041d4f8e service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:33.193819 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8c009-247a-4860-b490-50f0041d4f8e service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:33.194098 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8c009-247a-4860-b490-50f0041d4f8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:33.203658 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8c009-247a-4860-b490-50f0041d4f8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:33.205095 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8c009-247a-4860-b490-50f0041d4f8e service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:33.216107 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 816/1626] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:33.217042 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8c009-247a-4860-b490-50f0041d4f8e service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:33.226767 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8c009-247a-4860-b490-50f0041d4f8e service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:33.228379 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3172872e-64b9-4573-99d9-0c33039c823a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:33.230178 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3172872e-64b9-4573-99d9-0c33039c823a service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:33.232541 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855055fc-1ea2-4a81-ba5d-e01b33c490bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:33.233917 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855055fc-1ea2-4a81-ba5d-e01b33c490bf admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:33.234353 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855055fc-1ea2-4a81-ba5d-e01b33c490bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:33.235233 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855055fc-1ea2-4a81-ba5d-e01b33c490bf admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:33.236249 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855055fc-1ea2-4a81-ba5d-e01b33c490bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:33.238366 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855055fc-1ea2-4a81-ba5d-e01b33c490bf admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:33.242716 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 811/1627] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:33 2021] GET /identity/v3/auth/tokens => generated 3291 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:33.244422 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172872e-64b9-4573-99d9-0c33039c823a service cinder] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:33.260128 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172872e-64b9-4573-99d9-0c33039c823a service cinder] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:33.264899 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ba75c-2d38-48cb-be63-ade4d43abf25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:33.265809 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ba75c-2d38-48cb-be63-ade4d43abf25 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:33.266762 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ba75c-2d38-48cb-be63-ade4d43abf25 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:33.266762 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ba75c-2d38-48cb-be63-ade4d43abf25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:33.279024 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ba75c-2d38-48cb-be63-ade4d43abf25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:33.281367 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ba75c-2d38-48cb-be63-ade4d43abf25 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:33.287994 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 817/1628] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:10:33 2021] POST /identity/v3/users => generated 293 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:33.289081 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855055fc-1ea2-4a81-ba5d-e01b33c490bf admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:33.299923 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855055fc-1ea2-4a81-ba5d-e01b33c490bf admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:33.300291 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 812/1629] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:33.301148 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ba75c-2d38-48cb-be63-ade4d43abf25 service neutron] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:33.305358 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9655a-033f-4ebe-a364-1d9ca5658d4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:33.307280 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9655a-033f-4ebe-a364-1d9ca5658d4b service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:33.307280 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9655a-033f-4ebe-a364-1d9ca5658d4b service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:33.307466 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9655a-033f-4ebe-a364-1d9ca5658d4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:33.310812 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ba75c-2d38-48cb-be63-ade4d43abf25 service neutron] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:33.315952 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f1be6-cec4-4273-8f11-c6adc01b2bd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:33.316717 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f1be6-cec4-4273-8f11-c6adc01b2bd8 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:33.317007 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f1be6-cec4-4273-8f11-c6adc01b2bd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:33.317287 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f1be6-cec4-4273-8f11-c6adc01b2bd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:33.317792 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9655a-033f-4ebe-a364-1d9ca5658d4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:33.320340 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9655a-033f-4ebe-a364-1d9ca5658d4b service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:33.330129 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f1be6-cec4-4273-8f11-c6adc01b2bd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:33.331744 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f1be6-cec4-4273-8f11-c6adc01b2bd8 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:33.344521 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 818/1630] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:33 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:33.346395 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 813/1631] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:33.346925 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef865a-ee50-4bad-a3fc-ccf7ef8fb525 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:33.347641 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef865a-ee50-4bad-a3fc-ccf7ef8fb525 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:33.348083 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f1be6-cec4-4273-8f11-c6adc01b2bd8 service neutron] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:33.349153 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef865a-ee50-4bad-a3fc-ccf7ef8fb525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:33.359411 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f1be6-cec4-4273-8f11-c6adc01b2bd8 service neutron] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:33.364807 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8557ddd-aa32-400d-bd4e-39e2ad611fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:33.365508 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8557ddd-aa32-400d-bd4e-39e2ad611fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:33.365798 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8557ddd-aa32-400d-bd4e-39e2ad611fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:33.366082 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8557ddd-aa32-400d-bd4e-39e2ad611fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:33.366880 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8557ddd-aa32-400d-bd4e-39e2ad611fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:33.368578 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8557ddd-aa32-400d-bd4e-39e2ad611fb5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:33.385144 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 814/1632] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:33 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:33.390626 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8557ddd-aa32-400d-bd4e-39e2ad611fb5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:33.393014 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-94ef865a-ee50-4bad-a3fc-ccf7ef8fb525 None None] MFA Rules not processed for user `bc13934328e742f9a1a85d1c84ab83dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:33.394895 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-94ef865a-ee50-4bad-a3fc-ccf7ef8fb525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:33.412637 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8557ddd-aa32-400d-bd4e-39e2ad611fb5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:33.421322 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d41982-a487-4f71-a16b-f84918feac62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:33.422387 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d41982-a487-4f71-a16b-f84918feac62 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:33.422894 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d41982-a487-4f71-a16b-f84918feac62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:33.423101 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d41982-a487-4f71-a16b-f84918feac62 admin admin] PATH_INFO: `/v3/projects/de7eaf7bf4c247d98d8e57590c97fcd3/users/ccf0da921dc44896bb42df6f2028ad02/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:33.440757 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d41982-a487-4f71-a16b-f84918feac62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de7eaf7bf4c247d98d8e57590c97fcd3, user_id=ccf0da921dc44896bb42df6f2028ad02, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:33.444592 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d41982-a487-4f71-a16b-f84918feac62 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:33.465372 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 815/1633] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:10:33 2021] PUT /identity/v3/projects/de7eaf7bf4c247d98d8e57590c97fcd3/users/ccf0da921dc44896bb42df6f2028ad02/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:33.466460 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d41982-a487-4f71-a16b-f84918feac62 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:33.550721 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 819/1634] 10.222.0.36 () {58 vars in 1058 bytes} [Wed Dec 15 16:10:33 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:33.552722 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef865a-ee50-4bad-a3fc-ccf7ef8fb525 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:33.570237 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef865a-ee50-4bad-a3fc-ccf7ef8fb525 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:33.573893 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d41982-a487-4f71-a16b-f84918feac62 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:33.582278 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd512d-cbb0-48cb-9a7a-0f7e07574bf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:33.584975 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd512d-cbb0-48cb-9a7a-0f7e07574bf9 service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:33.584975 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd512d-cbb0-48cb-9a7a-0f7e07574bf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:33.584975 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd512d-cbb0-48cb-9a7a-0f7e07574bf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:33.686097 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd512d-cbb0-48cb-9a7a-0f7e07574bf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:33.688104 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd512d-cbb0-48cb-9a7a-0f7e07574bf9 service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:33.697615 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f030f86-5840-4b67-8c52-30ae9bce714c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:33.698203 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f030f86-5840-4b67-8c52-30ae9bce714c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:33.698490 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f030f86-5840-4b67-8c52-30ae9bce714c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:33.698771 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f030f86-5840-4b67-8c52-30ae9bce714c admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:33.699537 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f030f86-5840-4b67-8c52-30ae9bce714c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:33.699916 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 816/1635] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:33 2021] GET /identity/v3/auth/tokens => generated 3222 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:33.700848 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd512d-cbb0-48cb-9a7a-0f7e07574bf9 service cinder] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:33.709576 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f030f86-5840-4b67-8c52-30ae9bce714c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:33.744930 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 820/1636] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:33 2021] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:33.746536 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f030f86-5840-4b67-8c52-30ae9bce714c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:33.766598 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f030f86-5840-4b67-8c52-30ae9bce714c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:33.779286 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a276c-8378-4c9f-83c9-c6ae936481a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:33.780211 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a276c-8378-4c9f-83c9-c6ae936481a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:33.780468 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a276c-8378-4c9f-83c9-c6ae936481a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:33.780751 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a276c-8378-4c9f-83c9-c6ae936481a6 admin admin] PATH_INFO: `/v3/projects/de7eaf7bf4c247d98d8e57590c97fcd3/users/ccf0da921dc44896bb42df6f2028ad02/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:33.794389 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a276c-8378-4c9f-83c9-c6ae936481a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de7eaf7bf4c247d98d8e57590c97fcd3, user_id=ccf0da921dc44896bb42df6f2028ad02, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:33.797089 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a276c-8378-4c9f-83c9-c6ae936481a6 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:33.823468 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 821/1637] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:10:33 2021] PUT /identity/v3/projects/de7eaf7bf4c247d98d8e57590c97fcd3/users/ccf0da921dc44896bb42df6f2028ad02/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:33.833432 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21305232-a829-4c4c-91ef-19221317beeb None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:33.833738 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21305232-a829-4c4c-91ef-19221317beeb None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:33.834021 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21305232-a829-4c4c-91ef-19221317beeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:33.835506 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd512d-cbb0-48cb-9a7a-0f7e07574bf9 service cinder] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:33.918534 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-21305232-a829-4c4c-91ef-19221317beeb None None] MFA Rules not processed for user `ccf0da921dc44896bb42df6f2028ad02`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:33.919811 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-21305232-a829-4c4c-91ef-19221317beeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:33.965274 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830a481-b524-43a7-af49-7b99c3e842ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:33.967050 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830a481-b524-43a7-af49-7b99c3e842ad service nova] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:33.967998 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830a481-b524-43a7-af49-7b99c3e842ad service nova] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:33.968890 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830a481-b524-43a7-af49-7b99c3e842ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:34.060847 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 822/1638] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:33 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:34.081812 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830a481-b524-43a7-af49-7b99c3e842ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:34.084031 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830a481-b524-43a7-af49-7b99c3e842ad service nova] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:34.096164 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 817/1639] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:33 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:34.114720 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21305232-a829-4c4c-91ef-19221317beeb None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:34.188229 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21305232-a829-4c4c-91ef-19221317beeb None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:34.194846 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6d636-dc9e-4263-b226-5ecceb3434d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:34.196258 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6d636-dc9e-4263-b226-5ecceb3434d0 service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:34.197315 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6d636-dc9e-4263-b226-5ecceb3434d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:34.198016 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6d636-dc9e-4263-b226-5ecceb3434d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:34.211390 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6d636-dc9e-4263-b226-5ecceb3434d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:34.215887 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6d636-dc9e-4263-b226-5ecceb3434d0 service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:34.227938 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 823/1640] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:34 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:34.569151 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f7231-8546-451f-9489-c5d8dbbc1b02 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:34.570558 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f7231-8546-451f-9489-c5d8dbbc1b02 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:34.570558 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f7231-8546-451f-9489-c5d8dbbc1b02 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:34.572214 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 818/1641] 10.222.0.36 () {54 vars in 912 bytes} [Wed Dec 15 16:10:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:10:34.590201 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef87dca-40b5-49bd-8c30-39830fda93a5 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:34.590484 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef87dca-40b5-49bd-8c30-39830fda93a5 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:34.590763 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef87dca-40b5-49bd-8c30-39830fda93a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:34.639759 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-aef87dca-40b5-49bd-8c30-39830fda93a5 None None] MFA Rules not processed for user `bc13934328e742f9a1a85d1c84ab83dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:34.641779 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-aef87dca-40b5-49bd-8c30-39830fda93a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:34.669167 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f7231-8546-451f-9489-c5d8dbbc1b02 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:34.678142 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 824/1642] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Dec 15 16:10:34 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:34.690807 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f7231-8546-451f-9489-c5d8dbbc1b02 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:34.694983 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0cda4-c416-4f1d-b556-df231fe653b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:34.695635 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0cda4-c416-4f1d-b556-df231fe653b5 service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:34.695921 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0cda4-c416-4f1d-b556-df231fe653b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:34.696198 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0cda4-c416-4f1d-b556-df231fe653b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:34.781455 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0cda4-c416-4f1d-b556-df231fe653b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:34.783763 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0cda4-c416-4f1d-b556-df231fe653b5 service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:34.793295 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 819/1643] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:34 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:34.971018 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef87dca-40b5-49bd-8c30-39830fda93a5 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:34.982589 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef87dca-40b5-49bd-8c30-39830fda93a5 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:34.986613 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20ef27-e865-4648-a809-77686f0568a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:34.987260 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20ef27-e865-4648-a809-77686f0568a8 service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:34.987541 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20ef27-e865-4648-a809-77686f0568a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:34.987970 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20ef27-e865-4648-a809-77686f0568a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:35.000206 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20ef27-e865-4648-a809-77686f0568a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:35.001938 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20ef27-e865-4648-a809-77686f0568a8 service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:35.029482 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 825/1644] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:34 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:35.123006 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf3f34-dab6-4921-b097-6093347728e6 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:35.123442 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf3f34-dab6-4921-b097-6093347728e6 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:35.123630 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf3f34-dab6-4921-b097-6093347728e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:35.211306 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-c0bf3f34-dab6-4921-b097-6093347728e6 None None] MFA Rules not processed for user `df09b0b78f6646ed8c520c5c46b3eb58`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:35.213071 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-c0bf3f34-dab6-4921-b097-6093347728e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:35.404465 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 820/1645] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:35 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:35.420638 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac537b9-af5e-4394-94a5-07be8b0923e1 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:35.421128 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac537b9-af5e-4394-94a5-07be8b0923e1 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:35.421217 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac537b9-af5e-4394-94a5-07be8b0923e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:35.445631 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-bac537b9-af5e-4394-94a5-07be8b0923e1 None None] MFA Rules not processed for user `df09b0b78f6646ed8c520c5c46b3eb58`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:35.447520 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-bac537b9-af5e-4394-94a5-07be8b0923e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:35.462196 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 826/1646] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:35 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:35.488654 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b326215-b5c7-459b-84eb-271314ad8d65 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:35.489023 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b326215-b5c7-459b-84eb-271314ad8d65 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:35.489373 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b326215-b5c7-459b-84eb-271314ad8d65 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:35.491397 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 821/1647] 10.222.0.36 () {54 vars in 961 bytes} [Wed Dec 15 16:10:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:10:35.509922 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7a736-b430-46e9-99db-0dd326170f58 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:35.511559 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a19c9-b397-4219-a4fe-5bfa6d78568b None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:35.511948 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a19c9-b397-4219-a4fe-5bfa6d78568b None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:35.512261 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a19c9-b397-4219-a4fe-5bfa6d78568b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:35.514527 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7a736-b430-46e9-99db-0dd326170f58 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:35.514527 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7a736-b430-46e9-99db-0dd326170f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:35.579600 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-f4b7a736-b430-46e9-99db-0dd326170f58 None None] MFA Rules not processed for user `bc13934328e742f9a1a85d1c84ab83dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:35.581103 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f4b7a736-b430-46e9-99db-0dd326170f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:35.597871 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-999a19c9-b397-4219-a4fe-5bfa6d78568b None None] MFA Rules not processed for user `d1e314d7ae7a491ab057a93961c7c3b5`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:35.602254 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-999a19c9-b397-4219-a4fe-5bfa6d78568b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:35.628653 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 827/1648] 10.222.0.36 () {58 vars in 1058 bytes} [Wed Dec 15 16:10:35 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:35.630319 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7a736-b430-46e9-99db-0dd326170f58 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:35.662737 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7a736-b430-46e9-99db-0dd326170f58 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:35.678935 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930ec20-025d-4f83-8af0-87b0d5f4fbe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:35.680838 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930ec20-025d-4f83-8af0-87b0d5f4fbe9 service nova] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:35.681297 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930ec20-025d-4f83-8af0-87b0d5f4fbe9 service nova] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:35.684531 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930ec20-025d-4f83-8af0-87b0d5f4fbe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:35.701688 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930ec20-025d-4f83-8af0-87b0d5f4fbe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:35.705015 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930ec20-025d-4f83-8af0-87b0d5f4fbe9 service nova] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:35.743575 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 828/1649] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:35 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:35.781933 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 822/1650] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:35 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:35.793595 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72dd842-a69b-4b8f-9973-a5b32347147b None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:35.794185 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72dd842-a69b-4b8f-9973-a5b32347147b None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:35.794692 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72dd842-a69b-4b8f-9973-a5b32347147b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:35.835805 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-b72dd842-a69b-4b8f-9973-a5b32347147b None None] MFA Rules not processed for user `d1e314d7ae7a491ab057a93961c7c3b5`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:35.850864 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-b72dd842-a69b-4b8f-9973-a5b32347147b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:35.886685 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 829/1651] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:35 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:36.167976 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a19c9-b397-4219-a4fe-5bfa6d78568b None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:36.193462 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a19c9-b397-4219-a4fe-5bfa6d78568b None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:36.220233 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded73f45-acc1-4cf1-a539-e39a59f8be21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:36.220907 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded73f45-acc1-4cf1-a539-e39a59f8be21 service nova] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:36.221190 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded73f45-acc1-4cf1-a539-e39a59f8be21 service nova] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:36.221495 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded73f45-acc1-4cf1-a539-e39a59f8be21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:36.245344 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded73f45-acc1-4cf1-a539-e39a59f8be21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:36.247013 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded73f45-acc1-4cf1-a539-e39a59f8be21 service nova] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:36.284768 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 823/1652] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:36 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:36.437935 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66fb43-0d88-4dc2-b1eb-aec17d78ad16 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:36.438654 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66fb43-0d88-4dc2-b1eb-aec17d78ad16 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:36.438788 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66fb43-0d88-4dc2-b1eb-aec17d78ad16 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:36.440863 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 830/1653] 10.222.0.36 () {54 vars in 912 bytes} [Wed Dec 15 16:10:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:10:36.449249 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39b530-f049-471f-8b49-cf0ed14b689e None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:36.450021 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39b530-f049-471f-8b49-cf0ed14b689e None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:36.450446 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39b530-f049-471f-8b49-cf0ed14b689e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:36.502722 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-8d39b530-f049-471f-8b49-cf0ed14b689e None None] MFA Rules not processed for user `bc13934328e742f9a1a85d1c84ab83dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:36.526357 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-8d39b530-f049-471f-8b49-cf0ed14b689e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:36.563752 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 824/1654] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Dec 15 16:10:36 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:36.582761 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66fb43-0d88-4dc2-b1eb-aec17d78ad16 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:36.585136 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-bc66fb43-0d88-4dc2-b1eb-aec17d78ad16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:36.696079 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66fb43-0d88-4dc2-b1eb-aec17d78ad16 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:36.703074 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb2ce4-d5ef-4075-8901-b076ed438a10 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9072bd35fdf046669c196133f485d334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:36.704312 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb2ce4-d5ef-4075-8901-b076ed438a10 service glance] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:36.704828 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb2ce4-d5ef-4075-8901-b076ed438a10 service glance] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:36.705339 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb2ce4-d5ef-4075-8901-b076ed438a10 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:36.721770 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb2ce4-d5ef-4075-8901-b076ed438a10 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:36.723574 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb2ce4-d5ef-4075-8901-b076ed438a10 service glance] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:36.738907 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 831/1655] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:36 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:37.013281 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e48e6-ce80-4456-bc53-721d08014afe None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:37.013872 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e48e6-ce80-4456-bc53-721d08014afe None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:37.014004 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e48e6-ce80-4456-bc53-721d08014afe None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:37.016996 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 825/1656] 10.222.0.36 () {54 vars in 912 bytes} [Wed Dec 15 16:10:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:10:37.023341 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f74c35-b4a9-44d3-b286-6f91a0000b76 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:37.023873 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f74c35-b4a9-44d3-b286-6f91a0000b76 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:37.024427 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f74c35-b4a9-44d3-b286-6f91a0000b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:37.111495 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-f8f74c35-b4a9-44d3-b286-6f91a0000b76 None None] MFA Rules not processed for user `f2f08f47d4e6442a92901fb7d8bed0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:37.114923 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f8f74c35-b4a9-44d3-b286-6f91a0000b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:37.158919 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30f3b7-b928-4142-b93d-1b48b623051c None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:37.159552 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30f3b7-b928-4142-b93d-1b48b623051c None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:37.159989 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30f3b7-b928-4142-b93d-1b48b623051c None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:37.162562 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 826/1657] 10.222.0.36 () {54 vars in 912 bytes} [Wed Dec 15 16:10:37 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:10:37.168738 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc6942-be35-4787-b83b-d8e2a23fc8d2 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:37.169104 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc6942-be35-4787-b83b-d8e2a23fc8d2 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:37.169925 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc6942-be35-4787-b83b-d8e2a23fc8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:37.213534 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 832/1658] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Dec 15 16:10:37 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:37.227402 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-fbbc6942-be35-4787-b83b-d8e2a23fc8d2 None None] MFA Rules not processed for user `f2f08f47d4e6442a92901fb7d8bed0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:37.229232 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-fbbc6942-be35-4787-b83b-d8e2a23fc8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:37.251429 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 827/1659] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Dec 15 16:10:37 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:10:37.267312 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f74c35-b4a9-44d3-b286-6f91a0000b76 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:37.284002 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f74c35-b4a9-44d3-b286-6f91a0000b76 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:37.288675 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e3db5-6ea1-43ed-ab26-078725147a68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:37.289324 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e3db5-6ea1-43ed-ab26-078725147a68 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:37.289649 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e3db5-6ea1-43ed-ab26-078725147a68 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:37.289909 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e3db5-6ea1-43ed-ab26-078725147a68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:37.298724 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc6942-be35-4787-b83b-d8e2a23fc8d2 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:37.300868 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e3db5-6ea1-43ed-ab26-078725147a68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:37.303248 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e3db5-6ea1-43ed-ab26-078725147a68 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:37.313214 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc6942-be35-4787-b83b-d8e2a23fc8d2 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:37.321480 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00cd64-bdfb-48fc-9414-9786a622620d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:37.323468 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00cd64-bdfb-48fc-9414-9786a622620d service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:37.324970 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00cd64-bdfb-48fc-9414-9786a622620d service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:37.325350 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00cd64-bdfb-48fc-9414-9786a622620d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:37.327771 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 833/1660] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:37 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:37.344469 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00cd64-bdfb-48fc-9414-9786a622620d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:37.347304 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00cd64-bdfb-48fc-9414-9786a622620d service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:37.370405 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 828/1661] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:37 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:10:38.657419 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e3db5-6ea1-43ed-ab26-078725147a68 service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:38.852847 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59d28a-5d94-4c1e-87b3-9bd81aefb64e None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:38.854033 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59d28a-5d94-4c1e-87b3-9bd81aefb64e None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:38.854608 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59d28a-5d94-4c1e-87b3-9bd81aefb64e None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:38.856586 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 829/1662] 10.222.0.36 () {54 vars in 960 bytes} [Wed Dec 15 16:10:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:10:38.881958 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855b8f2-2a5b-41a6-8259-ea9214f0b156 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:38.885437 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855b8f2-2a5b-41a6-8259-ea9214f0b156 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:38.885938 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855b8f2-2a5b-41a6-8259-ea9214f0b156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:38.947360 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-6855b8f2-2a5b-41a6-8259-ea9214f0b156 None None] MFA Rules not processed for user `e186d6728a2341399252238c559002f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:38.948595 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-6855b8f2-2a5b-41a6-8259-ea9214f0b156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:39.022439 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e3db5-6ea1-43ed-ab26-078725147a68 service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:39.066011 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e037f-2172-4fde-b8c1-5d58297ccc28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e186d6728a2341399252238c559002f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:39.067311 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e037f-2172-4fde-b8c1-5d58297ccc28 service placement] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:39.068002 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e037f-2172-4fde-b8c1-5d58297ccc28 service placement] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:39.068663 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e037f-2172-4fde-b8c1-5d58297ccc28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:39.079899 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-9d4e037f-2172-4fde-b8c1-5d58297ccc28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:39.116629 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e037f-2172-4fde-b8c1-5d58297ccc28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:39.118426 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e037f-2172-4fde-b8c1-5d58297ccc28 service placement] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:39.136943 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 834/1663] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:38 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:39.156649 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 830/1664] 10.222.0.36 () {58 vars in 1057 bytes} [Wed Dec 15 16:10:38 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:39.159139 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e037f-2172-4fde-b8c1-5d58297ccc28 service placement] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:39.184475 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e037f-2172-4fde-b8c1-5d58297ccc28 service placement] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:39.193748 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9bd99-f8d4-4c9a-bd9d-d3a4064f24a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e186d6728a2341399252238c559002f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:39.195142 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9bd99-f8d4-4c9a-bd9d-d3a4064f24a4 service placement] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:39.195907 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9bd99-f8d4-4c9a-bd9d-d3a4064f24a4 service placement] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:39.196363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9bd99-f8d4-4c9a-bd9d-d3a4064f24a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:39.239540 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9bd99-f8d4-4c9a-bd9d-d3a4064f24a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:39.251837 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9bd99-f8d4-4c9a-bd9d-d3a4064f24a4 service placement] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:39.294572 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 835/1665] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:39 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:40.073151 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f22272-26b7-4643-a081-203edcf54f70 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:40.073742 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f22272-26b7-4643-a081-203edcf54f70 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:40.073846 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f22272-26b7-4643-a081-203edcf54f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:40.152625 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-00f22272-26b7-4643-a081-203edcf54f70 None None] MFA Rules not processed for user `c7af97c50dab46dd85477944b2450a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:40.153965 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-00f22272-26b7-4643-a081-203edcf54f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:40.298960 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 831/1666] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:40 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:40.310858 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcfca8-3b7a-48f9-8d06-88bcfef9a4d1 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:40.313338 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcfca8-3b7a-48f9-8d06-88bcfef9a4d1 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:40.314490 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcfca8-3b7a-48f9-8d06-88bcfef9a4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:40.366942 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-60fcfca8-3b7a-48f9-8d06-88bcfef9a4d1 None None] MFA Rules not processed for user `c7af97c50dab46dd85477944b2450a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:40.372087 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-60fcfca8-3b7a-48f9-8d06-88bcfef9a4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:40.390890 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 836/1667] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:40 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:40.403216 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f22272-26b7-4643-a081-203edcf54f70 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:40.430101 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f22272-26b7-4643-a081-203edcf54f70 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:40.438152 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f6fa2-7847-4e92-874e-4b378d4bfc0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:40.439174 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f6fa2-7847-4e92-874e-4b378d4bfc0e service nova] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:40.439672 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f6fa2-7847-4e92-874e-4b378d4bfc0e service nova] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:40.440232 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f6fa2-7847-4e92-874e-4b378d4bfc0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:40.456164 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f6fa2-7847-4e92-874e-4b378d4bfc0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:40.462163 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f6fa2-7847-4e92-874e-4b378d4bfc0e service nova] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:40.491153 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 832/1668] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:40 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:41.795545 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507dfe6-3701-4bf2-9c77-38e25b653e9d None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:41.796131 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507dfe6-3701-4bf2-9c77-38e25b653e9d None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:41.796598 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507dfe6-3701-4bf2-9c77-38e25b653e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:41.847553 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-d507dfe6-3701-4bf2-9c77-38e25b653e9d None None] MFA Rules not processed for user `c7af97c50dab46dd85477944b2450a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:41.850780 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-d507dfe6-3701-4bf2-9c77-38e25b653e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:41.888591 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 837/1669] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:41 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:42.275298 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f6fa2-7847-4e92-874e-4b378d4bfc0e service nova] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:42.442083 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f6fa2-7847-4e92-874e-4b378d4bfc0e service nova] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:42.487872 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a46733-62ad-47ce-a030-deeaef0a6cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:42.494241 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a46733-62ad-47ce-a030-deeaef0a6cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:42.495025 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a46733-62ad-47ce-a030-deeaef0a6cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:42.495472 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a46733-62ad-47ce-a030-deeaef0a6cf3 admin admin] PATH_INFO: `/v3/users/157871d7f3574d73abe239ab6ce7137d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:42.498716 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a46733-62ad-47ce-a030-deeaef0a6cf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=157871d7f3574d73abe239ab6ce7137d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:42.506440 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a46733-62ad-47ce-a030-deeaef0a6cf3 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:42.652373 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-68a46733-62ad-47ce-a030-deeaef0a6cf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '157871d7f3574d73abe239ab6ce7137d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:42.655465 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-68a46733-62ad-47ce-a030-deeaef0a6cf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '157871d7f3574d73abe239ab6ce7137d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:42.670719 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-68a46733-62ad-47ce-a030-deeaef0a6cf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '157871d7f3574d73abe239ab6ce7137d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:42.671763 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-68a46733-62ad-47ce-a030-deeaef0a6cf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '157871d7f3574d73abe239ab6ce7137d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:42.711358 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-68a46733-62ad-47ce-a030-deeaef0a6cf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '157871d7f3574d73abe239ab6ce7137d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:42.736561 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 833/1670] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:10:42 2021] DELETE /identity/v3/users/157871d7f3574d73abe239ab6ce7137d => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:42.741249 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ded30-875d-4d00-9e17-546f913dac5d None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:42.741791 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ded30-875d-4d00-9e17-546f913dac5d None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:42.742274 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ded30-875d-4d00-9e17-546f913dac5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:42.771466 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-c25ded30-875d-4d00-9e17-546f913dac5d None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:42.773528 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c25ded30-875d-4d00-9e17-546f913dac5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:42.964319 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 838/1671] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:42.971674 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a46733-62ad-47ce-a030-deeaef0a6cf3 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:42.973204 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-68a46733-62ad-47ce-a030-deeaef0a6cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:43.098489 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a46733-62ad-47ce-a030-deeaef0a6cf3 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:43.106955 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200b576-fbcf-4d3d-9c28-155cd0329abf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:43.108236 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200b576-fbcf-4d3d-9c28-155cd0329abf service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:43.110030 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200b576-fbcf-4d3d-9c28-155cd0329abf service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:43.110486 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200b576-fbcf-4d3d-9c28-155cd0329abf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:43.145236 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200b576-fbcf-4d3d-9c28-155cd0329abf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:43.146934 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200b576-fbcf-4d3d-9c28-155cd0329abf service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:43.190828 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 834/1672] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:44.249112 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd7118-b875-4a15-8e3f-a6a6925bb4db None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:44.249681 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd7118-b875-4a15-8e3f-a6a6925bb4db None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:44.249681 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd7118-b875-4a15-8e3f-a6a6925bb4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:44.365860 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-2edd7118-b875-4a15-8e3f-a6a6925bb4db None None] MFA Rules not processed for user `2b01ba54246a4e8482417367b6329c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:44.365860 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-2edd7118-b875-4a15-8e3f-a6a6925bb4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:44.384718 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200b576-fbcf-4d3d-9c28-155cd0329abf service neutron] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:44.386888 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-5200b576-fbcf-4d3d-9c28-155cd0329abf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:44.411166 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200b576-fbcf-4d3d-9c28-155cd0329abf service neutron] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:44.424877 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe591fb4-3068-4a9f-833a-a0a24949c560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:44.425950 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe591fb4-3068-4a9f-833a-a0a24949c560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:44.426462 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe591fb4-3068-4a9f-833a-a0a24949c560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:44.427044 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe591fb4-3068-4a9f-833a-a0a24949c560 admin admin] PATH_INFO: `/v3/projects/a4e05d818bd84699ab687f2b8bd98f74` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:44.432692 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe591fb4-3068-4a9f-833a-a0a24949c560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4e05d818bd84699ab687f2b8bd98f74)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:44.470368 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: WARNING py.warnings [None req-fe591fb4-3068-4a9f-833a-a0a24949c560 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:10:44.470368 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: warnings.warn(msg) Dec 15 16:10:44.470368 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: Dec 15 16:10:44.474729 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe591fb4-3068-4a9f-833a-a0a24949c560 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:44.621013 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 839/1673] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:44 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:10:44.673996 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd7118-b875-4a15-8e3f-a6a6925bb4db None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:44.677411 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-2edd7118-b875-4a15-8e3f-a6a6925bb4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:44.727443 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-fe591fb4-3068-4a9f-833a-a0a24949c560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4e05d818bd84699ab687f2b8bd98f74', 'request_id': 'req-fe591fb4-3068-4a9f-833a-a0a24949c560'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:44.761346 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-fe591fb4-3068-4a9f-833a-a0a24949c560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4e05d818bd84699ab687f2b8bd98f74', 'request_id': 'req-fe591fb4-3068-4a9f-833a-a0a24949c560'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:44.785163 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-fe591fb4-3068-4a9f-833a-a0a24949c560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4e05d818bd84699ab687f2b8bd98f74', 'request_id': 'req-fe591fb4-3068-4a9f-833a-a0a24949c560'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:44.832526 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-fe591fb4-3068-4a9f-833a-a0a24949c560 admin admin] The token cache is being invalidate because project a4e05d818bd84699ab687f2b8bd98f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:10:44.835535 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-fe591fb4-3068-4a9f-833a-a0a24949c560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:44.836411 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-fe591fb4-3068-4a9f-833a-a0a24949c560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:44.841903 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 835/1674] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:10:44 2021] DELETE /identity/v3/projects/a4e05d818bd84699ab687f2b8bd98f74 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:10:44.843563 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963a8a4-539c-4d95-9cec-19a0774aaca6 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:44.845931 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963a8a4-539c-4d95-9cec-19a0774aaca6 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:44.846385 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963a8a4-539c-4d95-9cec-19a0774aaca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:44.876856 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd7118-b875-4a15-8e3f-a6a6925bb4db None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:44.902647 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-b963a8a4-539c-4d95-9cec-19a0774aaca6 None None] MFA Rules not processed for user `b2f47cbf62d44a6ba7e6a6f0f2305630`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:44.903897 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-b963a8a4-539c-4d95-9cec-19a0774aaca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:45.075269 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f8802-9a0f-4847-9a98-bafba55bb7aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:45.078225 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f8802-9a0f-4847-9a98-bafba55bb7aa service nova] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:45.081083 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f8802-9a0f-4847-9a98-bafba55bb7aa service nova] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:45.083027 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f8802-9a0f-4847-9a98-bafba55bb7aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:45.086407 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-355f8802-9a0f-4847-9a98-bafba55bb7aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:45.111522 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 836/1675] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Dec 15 16:10:44 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:45.120351 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684c758-c0f8-42b0-bb22-3ea729e040f6 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:45.122878 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684c758-c0f8-42b0-bb22-3ea729e040f6 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:45.122878 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684c758-c0f8-42b0-bb22-3ea729e040f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:45.242075 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-a684c758-c0f8-42b0-bb22-3ea729e040f6 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:45.252617 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-a684c758-c0f8-42b0-bb22-3ea729e040f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:45.377588 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f8802-9a0f-4847-9a98-bafba55bb7aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:45.381349 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f8802-9a0f-4847-9a98-bafba55bb7aa service nova] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:45.442270 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 840/1676] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:44 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 769 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:45.477158 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 837/1677] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:45.487620 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951dc2b-e021-4a7a-8f49-f92b4a860af4 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:45.489309 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951dc2b-e021-4a7a-8f49-f92b4a860af4 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:45.490106 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951dc2b-e021-4a7a-8f49-f92b4a860af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:45.534217 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684c758-c0f8-42b0-bb22-3ea729e040f6 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:45.535951 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-a684c758-c0f8-42b0-bb22-3ea729e040f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:45.558415 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-8951dc2b-e021-4a7a-8f49-f92b4a860af4 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:45.561949 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-8951dc2b-e021-4a7a-8f49-f92b4a860af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:45.604886 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 841/1678] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:45.606494 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951dc2b-e021-4a7a-8f49-f92b4a860af4 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:45.646824 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951dc2b-e021-4a7a-8f49-f92b4a860af4 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:45.673053 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684c758-c0f8-42b0-bb22-3ea729e040f6 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:45.673946 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b79ed7-0502-4b17-8237-57c50ad6fd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:45.676083 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b79ed7-0502-4b17-8237-57c50ad6fd06 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:45.676408 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b79ed7-0502-4b17-8237-57c50ad6fd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:45.677686 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b79ed7-0502-4b17-8237-57c50ad6fd06 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:45.679582 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b79ed7-0502-4b17-8237-57c50ad6fd06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:10:45.684308 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b79ed7-0502-4b17-8237-57c50ad6fd06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:45.688169 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d767b-f14c-4c30-a24e-311ffbb82024 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e3f652f76424e27a1d4329212d9b66d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:45.689442 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b79ed7-0502-4b17-8237-57c50ad6fd06 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:45.691233 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d767b-f14c-4c30-a24e-311ffbb82024 service swift] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:45.692218 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d767b-f14c-4c30-a24e-311ffbb82024 service swift] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:45.693568 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d767b-f14c-4c30-a24e-311ffbb82024 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:45.719152 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d767b-f14c-4c30-a24e-311ffbb82024 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:45.724154 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d767b-f14c-4c30-a24e-311ffbb82024 service swift] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:45.754887 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 842/1679] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:10:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:10:45.760062 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b79ed7-0502-4b17-8237-57c50ad6fd06 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:45.788105 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 838/1680] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Dec 15 16:10:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 16:10:45.798097 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b79ed7-0502-4b17-8237-57c50ad6fd06 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:45.829662 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79981f15-ee90-4d88-b91d-8917ab55451d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:45.830609 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79981f15-ee90-4d88-b91d-8917ab55451d admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:45.841556 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79981f15-ee90-4d88-b91d-8917ab55451d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:45.844927 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79981f15-ee90-4d88-b91d-8917ab55451d admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:45.846226 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79981f15-ee90-4d88-b91d-8917ab55451d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:45.865032 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79981f15-ee90-4d88-b91d-8917ab55451d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:45.997548 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 843/1681] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:10:45 2021] POST /identity/v3/projects => generated 405 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:45.999822 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d767b-f14c-4c30-a24e-311ffbb82024 service swift] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:46.032093 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d767b-f14c-4c30-a24e-311ffbb82024 service swift] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:46.330228 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408d843-f873-4453-9119-7c43f1b906be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:46.330943 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408d843-f873-4453-9119-7c43f1b906be admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:46.331207 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408d843-f873-4453-9119-7c43f1b906be admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:46.331481 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408d843-f873-4453-9119-7c43f1b906be admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:46.332195 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408d843-f873-4453-9119-7c43f1b906be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:46.356134 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408d843-f873-4453-9119-7c43f1b906be admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:46.476972 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79981f15-ee90-4d88-b91d-8917ab55451d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:46.499084 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 839/1682] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:10:45 2021] POST /identity/v3/users => generated 303 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:10:46.508830 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79981f15-ee90-4d88-b91d-8917ab55451d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:46.545230 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a0136-4e5c-4445-8ad0-94aeaa95f1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:46.556412 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a0136-4e5c-4445-8ad0-94aeaa95f1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:46.562859 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a0136-4e5c-4445-8ad0-94aeaa95f1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:46.563458 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a0136-4e5c-4445-8ad0-94aeaa95f1a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:46.566903 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a0136-4e5c-4445-8ad0-94aeaa95f1a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:46.573737 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a0136-4e5c-4445-8ad0-94aeaa95f1a7 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:46.618811 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408d843-f873-4453-9119-7c43f1b906be admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:46.632154 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 844/1683] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:46 2021] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:10:46.651531 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408d843-f873-4453-9119-7c43f1b906be admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:46.668497 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b4284-292c-49a1-b32b-63e566c5f098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:46.671618 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b4284-292c-49a1-b32b-63e566c5f098 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:46.672391 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b4284-292c-49a1-b32b-63e566c5f098 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:46.674955 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b4284-292c-49a1-b32b-63e566c5f098 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:46.676072 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b4284-292c-49a1-b32b-63e566c5f098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:46.681762 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b4284-292c-49a1-b32b-63e566c5f098 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:46.747999 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a0136-4e5c-4445-8ad0-94aeaa95f1a7 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:46.758778 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 840/1684] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:46 2021] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:10:46.768831 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a0136-4e5c-4445-8ad0-94aeaa95f1a7 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:46.791885 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e762d-a61f-4ef7-863d-b9322364344c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:46.795052 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e762d-a61f-4ef7-863d-b9322364344c admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:46.796877 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e762d-a61f-4ef7-863d-b9322364344c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:46.801262 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e762d-a61f-4ef7-863d-b9322364344c admin admin] PATH_INFO: `/v3/projects/46e321664d3f4a1486fcddef20aafeb4/users/a04d440e70604b279ea9841cb490236e/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:46.863498 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e762d-a61f-4ef7-863d-b9322364344c admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e321664d3f4a1486fcddef20aafeb4, user_id=a04d440e70604b279ea9841cb490236e, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:46.875552 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e762d-a61f-4ef7-863d-b9322364344c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:46.935844 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 845/1685] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:10:46 2021] PUT /identity/v3/projects/46e321664d3f4a1486fcddef20aafeb4/users/a04d440e70604b279ea9841cb490236e/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:46.941821 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c322884-fab7-4b31-a9d1-04defc5c3531 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:46.942358 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c322884-fab7-4b31-a9d1-04defc5c3531 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:46.942848 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c322884-fab7-4b31-a9d1-04defc5c3531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:47.047313 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-8c322884-fab7-4b31-a9d1-04defc5c3531 None None] MFA Rules not processed for user `a04d440e70604b279ea9841cb490236e`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:47.059729 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-8c322884-fab7-4b31-a9d1-04defc5c3531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:47.439753 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 841/1686] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:46 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 499 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:10:47.444167 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e762d-a61f-4ef7-863d-b9322364344c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:47.675053 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e762d-a61f-4ef7-863d-b9322364344c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:47.688154 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b013e70-47fb-48db-8493-4c2e190e10a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:47.689798 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b013e70-47fb-48db-8493-4c2e190e10a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:47.692543 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b013e70-47fb-48db-8493-4c2e190e10a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:47.693101 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b013e70-47fb-48db-8493-4c2e190e10a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:47.695279 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b013e70-47fb-48db-8493-4c2e190e10a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:47.703149 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b013e70-47fb-48db-8493-4c2e190e10a7 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:47.791609 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 846/1687] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:10:47 2021] POST /identity/v3/projects => generated 405 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:47.791788 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c322884-fab7-4b31-a9d1-04defc5c3531 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:47.819672 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c322884-fab7-4b31-a9d1-04defc5c3531 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:48.042443 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ffc87-fbbb-47d4-b498-6253110f5212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:48.046540 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ffc87-fbbb-47d4-b498-6253110f5212 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:48.046837 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ffc87-fbbb-47d4-b498-6253110f5212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:48.047120 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ffc87-fbbb-47d4-b498-6253110f5212 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:48.051979 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ffc87-fbbb-47d4-b498-6253110f5212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:48.058859 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ffc87-fbbb-47d4-b498-6253110f5212 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:48.098777 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 842/1688] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:10:47 2021] POST /identity/v3/users => generated 309 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:48.107135 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b013e70-47fb-48db-8493-4c2e190e10a7 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:48.173358 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b013e70-47fb-48db-8493-4c2e190e10a7 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:48.222276 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee61fa-64a4-48e9-92c6-e1426c40685a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:48.229102 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee61fa-64a4-48e9-92c6-e1426c40685a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:48.230388 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee61fa-64a4-48e9-92c6-e1426c40685a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:48.230738 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee61fa-64a4-48e9-92c6-e1426c40685a admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:48.251086 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee61fa-64a4-48e9-92c6-e1426c40685a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:48.282485 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee61fa-64a4-48e9-92c6-e1426c40685a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:48.375319 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 847/1689] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:48 2021] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:48.379888 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ffc87-fbbb-47d4-b498-6253110f5212 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:48.402692 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ffc87-fbbb-47d4-b498-6253110f5212 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:48.427583 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b266332-bb97-4bed-8d22-b74675b9473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:48.435036 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b266332-bb97-4bed-8d22-b74675b9473f admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:48.435315 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b266332-bb97-4bed-8d22-b74675b9473f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:48.435757 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b266332-bb97-4bed-8d22-b74675b9473f admin admin] PATH_INFO: `/v3/projects/ff4ea684b6b349778a73e3e2348e79b5/users/0854f6c20f0844d39e5b8dffa43b95a8/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:48.510550 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b266332-bb97-4bed-8d22-b74675b9473f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff4ea684b6b349778a73e3e2348e79b5, user_id=0854f6c20f0844d39e5b8dffa43b95a8, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:48.514237 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b266332-bb97-4bed-8d22-b74675b9473f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:48.558309 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 843/1690] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:10:48 2021] PUT /identity/v3/projects/ff4ea684b6b349778a73e3e2348e79b5/users/0854f6c20f0844d39e5b8dffa43b95a8/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:48.559819 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee61fa-64a4-48e9-92c6-e1426c40685a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:48.586285 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee61fa-64a4-48e9-92c6-e1426c40685a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:48.765663 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbea8b6-b87a-4cc1-beaf-eda2c663a009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:48.767777 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbea8b6-b87a-4cc1-beaf-eda2c663a009 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:48.768314 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbea8b6-b87a-4cc1-beaf-eda2c663a009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:48.768778 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbea8b6-b87a-4cc1-beaf-eda2c663a009 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:48.770148 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbea8b6-b87a-4cc1-beaf-eda2c663a009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:48.775974 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbea8b6-b87a-4cc1-beaf-eda2c663a009 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:48.815100 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 848/1691] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:48 2021] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:48.816413 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b266332-bb97-4bed-8d22-b74675b9473f admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:48.829570 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b266332-bb97-4bed-8d22-b74675b9473f admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:48.853449 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048097a8-80f5-496b-949b-8b66fd5affe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:48.856756 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048097a8-80f5-496b-949b-8b66fd5affe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:48.858860 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048097a8-80f5-496b-949b-8b66fd5affe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:48.859931 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048097a8-80f5-496b-949b-8b66fd5affe4 admin admin] PATH_INFO: `/v3/projects/ff4ea684b6b349778a73e3e2348e79b5/users/0854f6c20f0844d39e5b8dffa43b95a8/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:48.866512 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048097a8-80f5-496b-949b-8b66fd5affe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff4ea684b6b349778a73e3e2348e79b5, user_id=0854f6c20f0844d39e5b8dffa43b95a8, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:48.876990 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048097a8-80f5-496b-949b-8b66fd5affe4 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:48.910625 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 844/1692] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:10:48 2021] PUT /identity/v3/projects/ff4ea684b6b349778a73e3e2348e79b5/users/0854f6c20f0844d39e5b8dffa43b95a8/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:10:48.981671 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b1ed1-c54e-406f-babe-4e5137b3f6f1 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:48.982009 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b1ed1-c54e-406f-babe-4e5137b3f6f1 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:48.983267 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b1ed1-c54e-406f-babe-4e5137b3f6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:49.063597 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-5f2b1ed1-c54e-406f-babe-4e5137b3f6f1 None None] MFA Rules not processed for user `0854f6c20f0844d39e5b8dffa43b95a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:49.066833 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-5f2b1ed1-c54e-406f-babe-4e5137b3f6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:49.309484 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 849/1693] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:48 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:49.317501 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048097a8-80f5-496b-949b-8b66fd5affe4 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:49.319907 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-048097a8-80f5-496b-949b-8b66fd5affe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:49.533776 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048097a8-80f5-496b-949b-8b66fd5affe4 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:49.544516 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a5084-db95-4bec-8f6c-2c265bccbbde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:49.553816 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a5084-db95-4bec-8f6c-2c265bccbbde service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:49.554018 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a5084-db95-4bec-8f6c-2c265bccbbde service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:49.554743 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a5084-db95-4bec-8f6c-2c265bccbbde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:49.590821 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a5084-db95-4bec-8f6c-2c265bccbbde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:49.599074 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a5084-db95-4bec-8f6c-2c265bccbbde service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:49.658276 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 845/1694] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:49 2021] GET /identity/v3/auth/tokens => generated 3339 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:50.527916 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35874894-9d48-42ab-b3ac-5f1290fb1368 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:50.528505 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35874894-9d48-42ab-b3ac-5f1290fb1368 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:50.529125 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35874894-9d48-42ab-b3ac-5f1290fb1368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:50.598336 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a5084-db95-4bec-8f6c-2c265bccbbde service cinder] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:50.606486 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-35874894-9d48-42ab-b3ac-5f1290fb1368 None None] MFA Rules not processed for user `f2f08f47d4e6442a92901fb7d8bed0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:50.609829 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-35874894-9d48-42ab-b3ac-5f1290fb1368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:50.778328 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 850/1695] 10.222.0.46 () {58 vars in 1015 bytes} [Wed Dec 15 16:10:50 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:50.780814 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a5084-db95-4bec-8f6c-2c265bccbbde service cinder] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:50.788945 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21642b3-72e1-4820-9b59-e0f293a8c60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:50.791659 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21642b3-72e1-4820-9b59-e0f293a8c60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:50.792869 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21642b3-72e1-4820-9b59-e0f293a8c60e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:50.793641 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21642b3-72e1-4820-9b59-e0f293a8c60e admin admin] PATH_INFO: `/v3/users/a04d440e70604b279ea9841cb490236e` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:50.798696 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21642b3-72e1-4820-9b59-e0f293a8c60e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a04d440e70604b279ea9841cb490236e)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:50.803138 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21642b3-72e1-4820-9b59-e0f293a8c60e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:50.925376 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-e21642b3-72e1-4820-9b59-e0f293a8c60e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a04d440e70604b279ea9841cb490236e'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:50.928170 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-e21642b3-72e1-4820-9b59-e0f293a8c60e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a04d440e70604b279ea9841cb490236e'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:50.943431 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-e21642b3-72e1-4820-9b59-e0f293a8c60e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a04d440e70604b279ea9841cb490236e'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:50.944893 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-e21642b3-72e1-4820-9b59-e0f293a8c60e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a04d440e70604b279ea9841cb490236e'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:50.974403 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-e21642b3-72e1-4820-9b59-e0f293a8c60e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a04d440e70604b279ea9841cb490236e'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:51.005579 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d03923-4acb-41a4-b984-206ff9d9252c None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:51.005928 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d03923-4acb-41a4-b984-206ff9d9252c None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:51.006258 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d03923-4acb-41a4-b984-206ff9d9252c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:51.008768 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 846/1696] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:10:50 2021] DELETE /identity/v3/users/a04d440e70604b279ea9841cb490236e => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:51.046181 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-20d03923-4acb-41a4-b984-206ff9d9252c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:51.051718 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-20d03923-4acb-41a4-b984-206ff9d9252c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:51.130289 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21642b3-72e1-4820-9b59-e0f293a8c60e admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:51.132345 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-e21642b3-72e1-4820-9b59-e0f293a8c60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:51.251672 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 851/1697] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:10:51.256374 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d03923-4acb-41a4-b984-206ff9d9252c None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:51.258286 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-20d03923-4acb-41a4-b984-206ff9d9252c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:51.276384 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d03923-4acb-41a4-b984-206ff9d9252c None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:51.282304 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1548a4-0ed7-4315-97c5-6f7ffd41eb78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:51.283567 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1548a4-0ed7-4315-97c5-6f7ffd41eb78 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:51.284599 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1548a4-0ed7-4315-97c5-6f7ffd41eb78 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:51.285053 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1548a4-0ed7-4315-97c5-6f7ffd41eb78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:51.287086 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-ec1548a4-0ed7-4315-97c5-6f7ffd41eb78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:51.290139 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21642b3-72e1-4820-9b59-e0f293a8c60e admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:51.294849 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc067933-5e82-4547-9688-cb85c5d2ee84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:51.295729 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc067933-5e82-4547-9688-cb85c5d2ee84 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:51.296164 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc067933-5e82-4547-9688-cb85c5d2ee84 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:51.297206 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc067933-5e82-4547-9688-cb85c5d2ee84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:51.302312 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1548a4-0ed7-4315-97c5-6f7ffd41eb78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:51.308252 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1548a4-0ed7-4315-97c5-6f7ffd41eb78 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:51.310301 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc067933-5e82-4547-9688-cb85c5d2ee84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:51.312621 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc067933-5e82-4547-9688-cb85c5d2ee84 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:51.323908 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 852/1698] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:51 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:51.324915 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1548a4-0ed7-4315-97c5-6f7ffd41eb78 service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:51.326466 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-ec1548a4-0ed7-4315-97c5-6f7ffd41eb78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:51.336124 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 847/1699] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:51 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:51.344431 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc067933-5e82-4547-9688-cb85c5d2ee84 service neutron] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:51.354256 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1548a4-0ed7-4315-97c5-6f7ffd41eb78 service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:51.375437 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc067933-5e82-4547-9688-cb85c5d2ee84 service neutron] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:51.376974 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abe158-04ab-4053-9804-cbe65808e9b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:51.377913 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abe158-04ab-4053-9804-cbe65808e9b5 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:51.378271 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abe158-04ab-4053-9804-cbe65808e9b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:51.378951 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abe158-04ab-4053-9804-cbe65808e9b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:51.388241 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344cc54-79c4-4638-b709-550bc1f5cf3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:51.389099 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344cc54-79c4-4638-b709-550bc1f5cf3c service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:51.389568 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344cc54-79c4-4638-b709-550bc1f5cf3c service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:51.390017 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344cc54-79c4-4638-b709-550bc1f5cf3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:51.417769 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abe158-04ab-4053-9804-cbe65808e9b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:51.420547 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abe158-04ab-4053-9804-cbe65808e9b5 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:51.429475 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344cc54-79c4-4638-b709-550bc1f5cf3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:51.432622 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 853/1700] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:51 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:51.433762 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344cc54-79c4-4638-b709-550bc1f5cf3c service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:51.466362 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 848/1701] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:53.454980 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abe158-04ab-4053-9804-cbe65808e9b5 service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:53.457137 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f8abe158-04ab-4053-9804-cbe65808e9b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:53.494224 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abe158-04ab-4053-9804-cbe65808e9b5 service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:53.509030 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401dfcc4-53c6-487b-b442-7d1c6c7e5831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:53.510314 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dfcc4-53c6-487b-b442-7d1c6c7e5831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:53.510876 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dfcc4-53c6-487b-b442-7d1c6c7e5831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:53.511410 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dfcc4-53c6-487b-b442-7d1c6c7e5831 admin admin] PATH_INFO: `/v3/users/51c0b02fca2244a69a719ca74b3c2f9a` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:53.513374 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401dfcc4-53c6-487b-b442-7d1c6c7e5831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51c0b02fca2244a69a719ca74b3c2f9a)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:53.518333 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: WARNING py.warnings [None req-401dfcc4-53c6-487b-b442-7d1c6c7e5831 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:10:53.518333 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: warnings.warn(msg) Dec 15 16:10:53.518333 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: Dec 15 16:10:53.522384 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401dfcc4-53c6-487b-b442-7d1c6c7e5831 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:53.716504 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-401dfcc4-53c6-487b-b442-7d1c6c7e5831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51c0b02fca2244a69a719ca74b3c2f9a'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:53.718878 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-401dfcc4-53c6-487b-b442-7d1c6c7e5831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51c0b02fca2244a69a719ca74b3c2f9a'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:53.721608 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-401dfcc4-53c6-487b-b442-7d1c6c7e5831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51c0b02fca2244a69a719ca74b3c2f9a'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:53.772888 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-401dfcc4-53c6-487b-b442-7d1c6c7e5831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51c0b02fca2244a69a719ca74b3c2f9a'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:53.787661 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-401dfcc4-53c6-487b-b442-7d1c6c7e5831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51c0b02fca2244a69a719ca74b3c2f9a'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:53.814711 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 854/1702] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:10:53 2021] DELETE /identity/v3/users/51c0b02fca2244a69a719ca74b3c2f9a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:53.818865 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b15991-c791-47fa-bf63-2ec66f209538 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:53.819543 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b15991-c791-47fa-bf63-2ec66f209538 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:53.819543 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b15991-c791-47fa-bf63-2ec66f209538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:53.866301 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-12b15991-c791-47fa-bf63-2ec66f209538 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:53.867528 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-12b15991-c791-47fa-bf63-2ec66f209538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:54.112586 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 849/1703] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:54.161215 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401dfcc4-53c6-487b-b442-7d1c6c7e5831 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:54.165649 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-401dfcc4-53c6-487b-b442-7d1c6c7e5831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:54.250835 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b15991-c791-47fa-bf63-2ec66f209538 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:54.252805 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-12b15991-c791-47fa-bf63-2ec66f209538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:54.273184 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b15991-c791-47fa-bf63-2ec66f209538 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:54.290218 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51626d0b-60bd-4d28-a8ad-60be97dae82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:54.291101 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51626d0b-60bd-4d28-a8ad-60be97dae82a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:54.291386 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51626d0b-60bd-4d28-a8ad-60be97dae82a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:54.291665 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51626d0b-60bd-4d28-a8ad-60be97dae82a admin admin] PATH_INFO: `/v3/projects/46e321664d3f4a1486fcddef20aafeb4` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:54.294529 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51626d0b-60bd-4d28-a8ad-60be97dae82a admin admin] RBAC: Authorizing `identity:delete_project(project_id=46e321664d3f4a1486fcddef20aafeb4)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:54.296470 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51626d0b-60bd-4d28-a8ad-60be97dae82a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:54.390342 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401dfcc4-53c6-487b-b442-7d1c6c7e5831 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:54.405879 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b33b33-3c9a-4bb6-b458-bc36082f64b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:54.406556 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b33b33-3c9a-4bb6-b458-bc36082f64b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:54.406838 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b33b33-3c9a-4bb6-b458-bc36082f64b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:54.407114 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b33b33-3c9a-4bb6-b458-bc36082f64b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:54.461235 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b33b33-3c9a-4bb6-b458-bc36082f64b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:54.462752 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b33b33-3c9a-4bb6-b458-bc36082f64b9 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:54.523962 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 855/1704] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:54.527164 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-51626d0b-60bd-4d28-a8ad-60be97dae82a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46e321664d3f4a1486fcddef20aafeb4', 'request_id': 'req-51626d0b-60bd-4d28-a8ad-60be97dae82a'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:54.545570 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-51626d0b-60bd-4d28-a8ad-60be97dae82a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46e321664d3f4a1486fcddef20aafeb4', 'request_id': 'req-51626d0b-60bd-4d28-a8ad-60be97dae82a'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:54.555161 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-51626d0b-60bd-4d28-a8ad-60be97dae82a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46e321664d3f4a1486fcddef20aafeb4', 'request_id': 'req-51626d0b-60bd-4d28-a8ad-60be97dae82a'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:54.590940 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-51626d0b-60bd-4d28-a8ad-60be97dae82a admin admin] The token cache is being invalidate because project 46e321664d3f4a1486fcddef20aafeb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:10:54.594978 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-51626d0b-60bd-4d28-a8ad-60be97dae82a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:54.594978 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-51626d0b-60bd-4d28-a8ad-60be97dae82a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:54.594978 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 850/1705] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:10:54 2021] DELETE /identity/v3/projects/46e321664d3f4a1486fcddef20aafeb4 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:54.602025 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b33b33-3c9a-4bb6-b458-bc36082f64b9 service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:54.627140 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b33b33-3c9a-4bb6-b458-bc36082f64b9 service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:54.853253 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12522531-d132-48f5-a983-e27196ce5d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:54.854360 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12522531-d132-48f5-a983-e27196ce5d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:54.854651 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12522531-d132-48f5-a983-e27196ce5d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:54.854933 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12522531-d132-48f5-a983-e27196ce5d81 admin admin] PATH_INFO: `/v3/users/0854f6c20f0844d39e5b8dffa43b95a8` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:54.856295 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12522531-d132-48f5-a983-e27196ce5d81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0854f6c20f0844d39e5b8dffa43b95a8)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:54.858551 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12522531-d132-48f5-a983-e27196ce5d81 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:54.884785 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265d18e-b340-40ee-a9da-63350bae22c8 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:54.885356 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265d18e-b340-40ee-a9da-63350bae22c8 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:54.885356 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265d18e-b340-40ee-a9da-63350bae22c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:54.974585 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-a265d18e-b340-40ee-a9da-63350bae22c8 None None] MFA Rules not processed for user `2b01ba54246a4e8482417367b6329c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:54.981932 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-a265d18e-b340-40ee-a9da-63350bae22c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:54.996455 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-12522531-d132-48f5-a983-e27196ce5d81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0854f6c20f0844d39e5b8dffa43b95a8'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:54.997730 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-12522531-d132-48f5-a983-e27196ce5d81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0854f6c20f0844d39e5b8dffa43b95a8'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:55.001988 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-12522531-d132-48f5-a983-e27196ce5d81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0854f6c20f0844d39e5b8dffa43b95a8'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:55.025788 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-12522531-d132-48f5-a983-e27196ce5d81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0854f6c20f0844d39e5b8dffa43b95a8'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:55.049328 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-12522531-d132-48f5-a983-e27196ce5d81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0854f6c20f0844d39e5b8dffa43b95a8'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:55.108614 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 856/1706] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:10:54 2021] DELETE /identity/v3/users/0854f6c20f0844d39e5b8dffa43b95a8 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:55.113581 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c2ead-8396-464e-befa-ed091857b353 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:55.113881 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c2ead-8396-464e-befa-ed091857b353 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:55.114164 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c2ead-8396-464e-befa-ed091857b353 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:55.116329 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 857/1707] 10.222.0.36 () {54 vars in 921 bytes} [Wed Dec 15 16:10:55 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:10:55.208939 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 851/1708] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:54 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:55.284024 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfa370-0480-4327-abd4-3f737c5f5446 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:55.284302 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfa370-0480-4327-abd4-3f737c5f5446 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:55.284585 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfa370-0480-4327-abd4-3f737c5f5446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:55.323280 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-b9dfa370-0480-4327-abd4-3f737c5f5446 None None] MFA Rules not processed for user `bc13934328e742f9a1a85d1c84ab83dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:55.324552 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-b9dfa370-0480-4327-abd4-3f737c5f5446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:55.566162 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 858/1709] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Dec 15 16:10:55 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:56.004486 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69c1e6-6baf-4810-a1fb-cd29b149223c None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:56.005041 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69c1e6-6baf-4810-a1fb-cd29b149223c None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:56.005041 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69c1e6-6baf-4810-a1fb-cd29b149223c None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:56.008159 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 852/1710] 10.222.0.36 () {54 vars in 921 bytes} [Wed Dec 15 16:10:56 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:10:56.046265 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b717969-daef-4e25-8fb6-b084ecd74a9b None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:56.047846 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b717969-daef-4e25-8fb6-b084ecd74a9b None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:56.048006 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b717969-daef-4e25-8fb6-b084ecd74a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:56.097636 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-2b717969-daef-4e25-8fb6-b084ecd74a9b None None] MFA Rules not processed for user `bc13934328e742f9a1a85d1c84ab83dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:56.100768 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-2b717969-daef-4e25-8fb6-b084ecd74a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:56.154007 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 859/1711] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Dec 15 16:10:56 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:56.201731 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69c1e6-6baf-4810-a1fb-cd29b149223c None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:56.204237 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-cd69c1e6-6baf-4810-a1fb-cd29b149223c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:56.281477 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69c1e6-6baf-4810-a1fb-cd29b149223c None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:56.308877 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98538530-32f9-4d4f-a3c7-271bcb8564dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:56.312429 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98538530-32f9-4d4f-a3c7-271bcb8564dc service nova] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:56.314386 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98538530-32f9-4d4f-a3c7-271bcb8564dc service nova] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:56.315812 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98538530-32f9-4d4f-a3c7-271bcb8564dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:56.354800 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98538530-32f9-4d4f-a3c7-271bcb8564dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:56.360018 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98538530-32f9-4d4f-a3c7-271bcb8564dc service nova] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:56.393171 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 853/1712] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:56 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:10:56.639777 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b717969-daef-4e25-8fb6-b084ecd74a9b None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:56.641609 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-2b717969-daef-4e25-8fb6-b084ecd74a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:56.721895 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98538530-32f9-4d4f-a3c7-271bcb8564dc service nova] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:56.723492 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-98538530-32f9-4d4f-a3c7-271bcb8564dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:56.801487 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b717969-daef-4e25-8fb6-b084ecd74a9b None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:56.812008 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac185fc-a276-45a9-902e-774e269f9682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:56.813155 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac185fc-a276-45a9-902e-774e269f9682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:56.813624 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac185fc-a276-45a9-902e-774e269f9682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:56.814056 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac185fc-a276-45a9-902e-774e269f9682 admin admin] PATH_INFO: `/v3/projects/fe8423c4c8414c5287b43938d550e39b` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:56.817645 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac185fc-a276-45a9-902e-774e269f9682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe8423c4c8414c5287b43938d550e39b)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:56.819821 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac185fc-a276-45a9-902e-774e269f9682 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:56.903608 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98538530-32f9-4d4f-a3c7-271bcb8564dc service nova] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:56.911729 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-5ac185fc-a276-45a9-902e-774e269f9682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe8423c4c8414c5287b43938d550e39b', 'request_id': 'req-5ac185fc-a276-45a9-902e-774e269f9682'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:56.927591 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-5ac185fc-a276-45a9-902e-774e269f9682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe8423c4c8414c5287b43938d550e39b', 'request_id': 'req-5ac185fc-a276-45a9-902e-774e269f9682'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:56.940541 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-5ac185fc-a276-45a9-902e-774e269f9682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe8423c4c8414c5287b43938d550e39b', 'request_id': 'req-5ac185fc-a276-45a9-902e-774e269f9682'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:56.955400 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-5ac185fc-a276-45a9-902e-774e269f9682 admin admin] The token cache is being invalidate because project fe8423c4c8414c5287b43938d550e39b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:10:56.956200 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-5ac185fc-a276-45a9-902e-774e269f9682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:56.961311 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-5ac185fc-a276-45a9-902e-774e269f9682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:56.964461 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 860/1713] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:10:56 2021] DELETE /identity/v3/projects/fe8423c4c8414c5287b43938d550e39b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:56.966478 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac185fc-a276-45a9-902e-774e269f9682 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:56.968924 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-5ac185fc-a276-45a9-902e-774e269f9682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:57.071329 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac185fc-a276-45a9-902e-774e269f9682 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:57.083666 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4831b13-6fb9-4bbc-a307-4939188e54b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:57.084655 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4831b13-6fb9-4bbc-a307-4939188e54b4 service nova] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:57.085063 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4831b13-6fb9-4bbc-a307-4939188e54b4 service nova] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:57.085487 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4831b13-6fb9-4bbc-a307-4939188e54b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:57.088840 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c4831b13-6fb9-4bbc-a307-4939188e54b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:57.103451 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4831b13-6fb9-4bbc-a307-4939188e54b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:57.103714 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15619d2b-50aa-4190-bbc2-4206ac02eef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:57.106503 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15619d2b-50aa-4190-bbc2-4206ac02eef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:57.107731 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15619d2b-50aa-4190-bbc2-4206ac02eef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:57.107951 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15619d2b-50aa-4190-bbc2-4206ac02eef5 admin admin] PATH_INFO: `/v3/projects/ff4ea684b6b349778a73e3e2348e79b5` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:57.110881 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15619d2b-50aa-4190-bbc2-4206ac02eef5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff4ea684b6b349778a73e3e2348e79b5)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:57.117782 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15619d2b-50aa-4190-bbc2-4206ac02eef5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:57.129029 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4831b13-6fb9-4bbc-a307-4939188e54b4 service nova] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:57.142468 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 861/1714] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:56 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:57.160207 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281796f4-32da-40fe-b8ec-d86f678d4f67 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:57.160510 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281796f4-32da-40fe-b8ec-d86f678d4f67 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:57.160798 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281796f4-32da-40fe-b8ec-d86f678d4f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:57.211016 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-281796f4-32da-40fe-b8ec-d86f678d4f67 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:57.216913 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-281796f4-32da-40fe-b8ec-d86f678d4f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:57.228777 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-15619d2b-50aa-4190-bbc2-4206ac02eef5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff4ea684b6b349778a73e3e2348e79b5', 'request_id': 'req-15619d2b-50aa-4190-bbc2-4206ac02eef5'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:57.241647 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-15619d2b-50aa-4190-bbc2-4206ac02eef5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff4ea684b6b349778a73e3e2348e79b5', 'request_id': 'req-15619d2b-50aa-4190-bbc2-4206ac02eef5'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:57.281125 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-15619d2b-50aa-4190-bbc2-4206ac02eef5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff4ea684b6b349778a73e3e2348e79b5', 'request_id': 'req-15619d2b-50aa-4190-bbc2-4206ac02eef5'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:57.306533 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-15619d2b-50aa-4190-bbc2-4206ac02eef5 admin admin] The token cache is being invalidate because project ff4ea684b6b349778a73e3e2348e79b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:10:57.307132 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-15619d2b-50aa-4190-bbc2-4206ac02eef5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:57.308227 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-15619d2b-50aa-4190-bbc2-4206ac02eef5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:57.313976 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 854/1715] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:10:56 2021] DELETE /identity/v3/projects/ff4ea684b6b349778a73e3e2348e79b5 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:57.319814 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd03f80-d231-4549-ae4b-596ce0da3d9c None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:57.320290 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd03f80-d231-4549-ae4b-596ce0da3d9c None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:57.320743 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd03f80-d231-4549-ae4b-596ce0da3d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:57.373322 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-9bd03f80-d231-4549-ae4b-596ce0da3d9c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:57.377940 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-9bd03f80-d231-4549-ae4b-596ce0da3d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:57.393261 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 862/1716] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:57.394934 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad85c61-55d6-4846-b503-71104a8740ff None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:57.395232 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad85c61-55d6-4846-b503-71104a8740ff None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:57.395515 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad85c61-55d6-4846-b503-71104a8740ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:57.407373 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 855/1717] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:10:57.422501 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c6ca5-d626-4b21-b53f-80794a542ec3 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:57.422782 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c6ca5-d626-4b21-b53f-80794a542ec3 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:57.423067 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c6ca5-d626-4b21-b53f-80794a542ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:57.461014 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-1ad85c61-55d6-4846-b503-71104a8740ff None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:57.462582 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-1ad85c61-55d6-4846-b503-71104a8740ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:57.484342 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-832c6ca5-d626-4b21-b53f-80794a542ec3 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:57.485614 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-832c6ca5-d626-4b21-b53f-80794a542ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:57.515048 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 863/1718] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:57.515048 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad85c61-55d6-4846-b503-71104a8740ff None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:57.521439 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-1ad85c61-55d6-4846-b503-71104a8740ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:57.536693 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 856/1719] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:57.537580 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c6ca5-d626-4b21-b53f-80794a542ec3 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:57.560289 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c6ca5-d626-4b21-b53f-80794a542ec3 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:57.563778 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad85c61-55d6-4846-b503-71104a8740ff None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:57.568466 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af899eb9-e486-4820-853d-b577fa84b918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:57.570106 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af899eb9-e486-4820-853d-b577fa84b918 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:57.571858 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af899eb9-e486-4820-853d-b577fa84b918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:57.575306 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af899eb9-e486-4820-853d-b577fa84b918 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:57.575825 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d3795-2819-4774-af9c-c56843118cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:57.576839 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af899eb9-e486-4820-853d-b577fa84b918 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:10:57.577173 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af899eb9-e486-4820-853d-b577fa84b918 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:57.578234 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d3795-2819-4774-af9c-c56843118cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:57.578528 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d3795-2819-4774-af9c-c56843118cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:57.578815 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af899eb9-e486-4820-853d-b577fa84b918 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:57.578920 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d3795-2819-4774-af9c-c56843118cb0 admin admin] PATH_INFO: `/v3/users/82c3c2afa8d84f0dbb1b0d423b97e256` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:57.580979 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d3795-2819-4774-af9c-c56843118cb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82c3c2afa8d84f0dbb1b0d423b97e256)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:57.583115 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d3795-2819-4774-af9c-c56843118cb0 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:57.607061 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 857/1720] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:10:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:10:57.614110 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af899eb9-e486-4820-853d-b577fa84b918 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:57.652985 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af899eb9-e486-4820-853d-b577fa84b918 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:57.666748 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf9484-75fd-48ad-9fca-b7ba0cfa302e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:57.667357 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf9484-75fd-48ad-9fca-b7ba0cfa302e admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:57.667640 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf9484-75fd-48ad-9fca-b7ba0cfa302e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:57.667912 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf9484-75fd-48ad-9fca-b7ba0cfa302e admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:57.668653 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf9484-75fd-48ad-9fca-b7ba0cfa302e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:10:57.669049 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf9484-75fd-48ad-9fca-b7ba0cfa302e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:57.685712 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf9484-75fd-48ad-9fca-b7ba0cfa302e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:57.686769 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-258d3795-2819-4774-af9c-c56843118cb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82c3c2afa8d84f0dbb1b0d423b97e256'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:57.687665 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-258d3795-2819-4774-af9c-c56843118cb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82c3c2afa8d84f0dbb1b0d423b97e256'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:57.688461 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-258d3795-2819-4774-af9c-c56843118cb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82c3c2afa8d84f0dbb1b0d423b97e256'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:57.708410 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-258d3795-2819-4774-af9c-c56843118cb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82c3c2afa8d84f0dbb1b0d423b97e256'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:57.710350 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 858/1721] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:10:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:10:57.711259 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf9484-75fd-48ad-9fca-b7ba0cfa302e admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:57.726214 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-afaf9484-75fd-48ad-9fca-b7ba0cfa302e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:57.727110 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-258d3795-2819-4774-af9c-c56843118cb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82c3c2afa8d84f0dbb1b0d423b97e256'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:57.742352 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf9484-75fd-48ad-9fca-b7ba0cfa302e admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:57.748805 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365eaae2-b39a-469d-bffc-d710c9517cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:57.749600 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eaae2-b39a-469d-bffc-d710c9517cea admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:57.749958 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eaae2-b39a-469d-bffc-d710c9517cea admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:57.750332 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eaae2-b39a-469d-bffc-d710c9517cea admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:57.750944 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 864/1722] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:10:57 2021] DELETE /identity/v3/users/82c3c2afa8d84f0dbb1b0d423b97e256 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:57.751898 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d3795-2819-4774-af9c-c56843118cb0 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:57.753411 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-258d3795-2819-4774-af9c-c56843118cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:57.754079 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365eaae2-b39a-469d-bffc-d710c9517cea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:57.756154 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365eaae2-b39a-469d-bffc-d710c9517cea admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:57.835354 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 859/1723] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:10:57 2021] POST /identity/v3/projects => generated 369 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:57.843775 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe3a7e-0fba-497d-806d-867158a8c501 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:57.844189 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe3a7e-0fba-497d-806d-867158a8c501 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:57.845975 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe3a7e-0fba-497d-806d-867158a8c501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:57.877268 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d3795-2819-4774-af9c-c56843118cb0 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:57.894152 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-b1fe3a7e-0fba-497d-806d-867158a8c501 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:57.900510 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-b1fe3a7e-0fba-497d-806d-867158a8c501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:58.039739 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 860/1724] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:58.042082 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe3a7e-0fba-497d-806d-867158a8c501 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:58.047117 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd152d-95e6-4958-b9eb-493dd5fb8214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:58.047813 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd152d-95e6-4958-b9eb-493dd5fb8214 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:58.048094 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd152d-95e6-4958-b9eb-493dd5fb8214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:58.048363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd152d-95e6-4958-b9eb-493dd5fb8214 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:58.049163 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd152d-95e6-4958-b9eb-493dd5fb8214 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:58.051097 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd152d-95e6-4958-b9eb-493dd5fb8214 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:58.068150 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe3a7e-0fba-497d-806d-867158a8c501 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:58.083186 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac74a6-6235-45de-b591-52b9c72fb5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:58.084116 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac74a6-6235-45de-b591-52b9c72fb5e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:58.084481 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac74a6-6235-45de-b591-52b9c72fb5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:58.084829 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac74a6-6235-45de-b591-52b9c72fb5e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:58.085722 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac74a6-6235-45de-b591-52b9c72fb5e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:58.087768 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac74a6-6235-45de-b591-52b9c72fb5e9 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:58.097860 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 865/1725] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:10:57 2021] POST /identity/v3/projects => generated 405 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:58.097860 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd152d-95e6-4958-b9eb-493dd5fb8214 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:58.104301 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-97dd152d-95e6-4958-b9eb-493dd5fb8214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:58.112905 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 861/1726] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:10:58 2021] POST /identity/v3/users => generated 285 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:58.114555 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac74a6-6235-45de-b591-52b9c72fb5e9 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:58.125257 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac74a6-6235-45de-b591-52b9c72fb5e9 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:58.195776 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd152d-95e6-4958-b9eb-493dd5fb8214 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:58.200387 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb83c01-b7e6-4f05-b69f-557417c5f126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:58.201295 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb83c01-b7e6-4f05-b69f-557417c5f126 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:58.201653 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb83c01-b7e6-4f05-b69f-557417c5f126 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:58.202007 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb83c01-b7e6-4f05-b69f-557417c5f126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:58.253303 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546d52b-3b3c-4356-8af5-49f20e330410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:58.254098 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546d52b-3b3c-4356-8af5-49f20e330410 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:58.254417 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546d52b-3b3c-4356-8af5-49f20e330410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:58.254740 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546d52b-3b3c-4356-8af5-49f20e330410 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:58.255561 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546d52b-3b3c-4356-8af5-49f20e330410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:58.257675 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546d52b-3b3c-4356-8af5-49f20e330410 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:58.271954 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb83c01-b7e6-4f05-b69f-557417c5f126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:58.273573 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb83c01-b7e6-4f05-b69f-557417c5f126 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:58.283490 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 862/1727] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:10:58 2021] POST /identity/v3/users => generated 303 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:58.285107 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 866/1728] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:58.286663 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546d52b-3b3c-4356-8af5-49f20e330410 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:58.295309 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb83c01-b7e6-4f05-b69f-557417c5f126 service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:58.298256 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546d52b-3b3c-4356-8af5-49f20e330410 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:58.303400 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602c136-0341-4afe-81ba-62debeca03b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:58.304310 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602c136-0341-4afe-81ba-62debeca03b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:58.304664 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602c136-0341-4afe-81ba-62debeca03b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:58.305150 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602c136-0341-4afe-81ba-62debeca03b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:58.306714 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602c136-0341-4afe-81ba-62debeca03b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:58.308711 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602c136-0341-4afe-81ba-62debeca03b1 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:58.311698 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb83c01-b7e6-4f05-b69f-557417c5f126 service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:58.319224 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9476e2-2430-48d9-800d-c3e902348b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:58.320137 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9476e2-2430-48d9-800d-c3e902348b5d admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:58.320423 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9476e2-2430-48d9-800d-c3e902348b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:58.320702 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9476e2-2430-48d9-800d-c3e902348b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:58.321708 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 863/1729] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:58 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:58.322767 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9476e2-2430-48d9-800d-c3e902348b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:58.324507 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9476e2-2430-48d9-800d-c3e902348b5d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:58.325772 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602c136-0341-4afe-81ba-62debeca03b1 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:58.338707 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602c136-0341-4afe-81ba-62debeca03b1 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:58.341583 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 867/1730] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:58 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:58.343398 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9476e2-2430-48d9-800d-c3e902348b5d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:58.350873 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fa606-d607-4154-8764-590a1c60ab96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:58.351562 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fa606-d607-4154-8764-590a1c60ab96 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:58.351853 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fa606-d607-4154-8764-590a1c60ab96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:58.352141 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fa606-d607-4154-8764-590a1c60ab96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:58.355659 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fa606-d607-4154-8764-590a1c60ab96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:58.357067 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9476e2-2430-48d9-800d-c3e902348b5d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:58.359912 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fa606-d607-4154-8764-590a1c60ab96 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:58.363091 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595b238-209b-4f53-a01d-dc79232ce499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:58.363846 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595b238-209b-4f53-a01d-dc79232ce499 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:58.364117 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595b238-209b-4f53-a01d-dc79232ce499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:58.364420 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595b238-209b-4f53-a01d-dc79232ce499 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:58.365344 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595b238-209b-4f53-a01d-dc79232ce499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:58.367998 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595b238-209b-4f53-a01d-dc79232ce499 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:58.377355 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 864/1731] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:58 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:10:58.382014 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fa606-d607-4154-8764-590a1c60ab96 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:58.385294 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 868/1732] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:58 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:58.389131 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595b238-209b-4f53-a01d-dc79232ce499 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:58.400061 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fa606-d607-4154-8764-590a1c60ab96 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:58.400235 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595b238-209b-4f53-a01d-dc79232ce499 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:58.405620 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b3fa9-661c-43f0-b13b-91f8e9619bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:58.406019 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e77fc-5884-4100-a165-b9a010f1c212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:58.406521 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b3fa9-661c-43f0-b13b-91f8e9619bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:58.406802 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b3fa9-661c-43f0-b13b-91f8e9619bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:58.407072 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b3fa9-661c-43f0-b13b-91f8e9619bb2 admin admin] PATH_INFO: `/v3/projects/0048dccd65bd42778cee278e83420df2/users/ab7a999fc00643aca44c739b15fe2f93/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:58.407895 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e77fc-5884-4100-a165-b9a010f1c212 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:58.408313 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e77fc-5884-4100-a165-b9a010f1c212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:58.408739 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e77fc-5884-4100-a165-b9a010f1c212 admin admin] PATH_INFO: `/v3/projects/4ec3331c301a4be39f55b8f4fac47de5/users/2f0bdd9f0f9c424a8f7b8db85c914495/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:58.423409 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b3fa9-661c-43f0-b13b-91f8e9619bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0048dccd65bd42778cee278e83420df2, user_id=ab7a999fc00643aca44c739b15fe2f93, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:58.426583 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e77fc-5884-4100-a165-b9a010f1c212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec3331c301a4be39f55b8f4fac47de5, user_id=2f0bdd9f0f9c424a8f7b8db85c914495, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:58.427126 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b3fa9-661c-43f0-b13b-91f8e9619bb2 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:58.429474 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e77fc-5884-4100-a165-b9a010f1c212 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:58.444199 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 865/1733] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:10:58 2021] PUT /identity/v3/projects/0048dccd65bd42778cee278e83420df2/users/ab7a999fc00643aca44c739b15fe2f93/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:10:58.445840 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 869/1734] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:10:58 2021] PUT /identity/v3/projects/4ec3331c301a4be39f55b8f4fac47de5/users/2f0bdd9f0f9c424a8f7b8db85c914495/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:10:58.451194 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd59fb-7b43-46fb-8323-ed9378d678d6 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:58.451503 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd59fb-7b43-46fb-8323-ed9378d678d6 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:58.451830 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd59fb-7b43-46fb-8323-ed9378d678d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:58.476936 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-61fd59fb-7b43-46fb-8323-ed9378d678d6 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:58.478922 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-61fd59fb-7b43-46fb-8323-ed9378d678d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:58.497938 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708c609-e86a-48ef-8c75-6dbed61f164c None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:58.498335 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708c609-e86a-48ef-8c75-6dbed61f164c None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:58.499005 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708c609-e86a-48ef-8c75-6dbed61f164c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:58.527214 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-c708c609-e86a-48ef-8c75-6dbed61f164c None None] MFA Rules not processed for user `ab7a999fc00643aca44c739b15fe2f93`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:58.528506 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c708c609-e86a-48ef-8c75-6dbed61f164c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:58.546206 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 866/1735] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:10:58.557253 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd59fb-7b43-46fb-8323-ed9378d678d6 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:58.601183 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 870/1736] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:58 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:58.606272 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708c609-e86a-48ef-8c75-6dbed61f164c None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:58.627077 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708c609-e86a-48ef-8c75-6dbed61f164c None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:58.631831 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b0a92-f6e4-48d5-bc8a-06e89f6238c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:58.632488 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b0a92-f6e4-48d5-bc8a-06e89f6238c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:58.632774 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b0a92-f6e4-48d5-bc8a-06e89f6238c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:58.633046 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b0a92-f6e4-48d5-bc8a-06e89f6238c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:58.634402 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b0a92-f6e4-48d5-bc8a-06e89f6238c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:58.636497 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b0a92-f6e4-48d5-bc8a-06e89f6238c5 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:58.654069 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd59fb-7b43-46fb-8323-ed9378d678d6 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:58.658720 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16dd3de-11ff-4b89-ba53-57e7082a5d0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:58.659667 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16dd3de-11ff-4b89-ba53-57e7082a5d0e service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:58.660149 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16dd3de-11ff-4b89-ba53-57e7082a5d0e service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:58.660700 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16dd3de-11ff-4b89-ba53-57e7082a5d0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:58.666194 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 871/1737] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:10:58 2021] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:10:58.667028 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b0a92-f6e4-48d5-bc8a-06e89f6238c5 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:58.668654 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-329b0a92-f6e4-48d5-bc8a-06e89f6238c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:58.677248 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16dd3de-11ff-4b89-ba53-57e7082a5d0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:58.678931 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16dd3de-11ff-4b89-ba53-57e7082a5d0e service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:58.690333 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 867/1738] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:10:58.691348 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16dd3de-11ff-4b89-ba53-57e7082a5d0e service neutron] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:58.704299 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16dd3de-11ff-4b89-ba53-57e7082a5d0e service neutron] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:58.769628 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b0a92-f6e4-48d5-bc8a-06e89f6238c5 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:58.777299 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c8d90-a52d-49c2-81b8-d2ca3760ccf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:58.778870 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c8d90-a52d-49c2-81b8-d2ca3760ccf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:58.779281 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c8d90-a52d-49c2-81b8-d2ca3760ccf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:58.779634 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c8d90-a52d-49c2-81b8-d2ca3760ccf2 admin admin] PATH_INFO: `/v3/projects/634e831b75b845dcb9ff741abc8aa949` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:58.782757 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c8d90-a52d-49c2-81b8-d2ca3760ccf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=634e831b75b845dcb9ff741abc8aa949)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:58.785486 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c8d90-a52d-49c2-81b8-d2ca3760ccf2 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:58.830282 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dbd6d-e411-4ad8-a864-52485404148a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:58.831047 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dbd6d-e411-4ad8-a864-52485404148a admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:58.831332 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dbd6d-e411-4ad8-a864-52485404148a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:58.831940 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dbd6d-e411-4ad8-a864-52485404148a admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:58.832377 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865dbd6d-e411-4ad8-a864-52485404148a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:58.834606 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865dbd6d-e411-4ad8-a864-52485404148a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:58.840385 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b35c8d90-a52d-49c2-81b8-d2ca3760ccf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '634e831b75b845dcb9ff741abc8aa949', 'request_id': 'req-b35c8d90-a52d-49c2-81b8-d2ca3760ccf2'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:58.852387 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b35c8d90-a52d-49c2-81b8-d2ca3760ccf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '634e831b75b845dcb9ff741abc8aa949', 'request_id': 'req-b35c8d90-a52d-49c2-81b8-d2ca3760ccf2'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:58.861124 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b35c8d90-a52d-49c2-81b8-d2ca3760ccf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '634e831b75b845dcb9ff741abc8aa949', 'request_id': 'req-b35c8d90-a52d-49c2-81b8-d2ca3760ccf2'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:58.869855 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 868/1739] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:10:58 2021] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:10:58.873927 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dbd6d-e411-4ad8-a864-52485404148a admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:58.874554 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b35c8d90-a52d-49c2-81b8-d2ca3760ccf2 admin admin] The token cache is being invalidate because project 634e831b75b845dcb9ff741abc8aa949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:10:58.874755 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b35c8d90-a52d-49c2-81b8-d2ca3760ccf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:58.875433 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b35c8d90-a52d-49c2-81b8-d2ca3760ccf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:58.877066 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 872/1740] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:10:58 2021] DELETE /identity/v3/projects/634e831b75b845dcb9ff741abc8aa949 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:58.882608 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c8d90-a52d-49c2-81b8-d2ca3760ccf2 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:58.886406 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-b35c8d90-a52d-49c2-81b8-d2ca3760ccf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:58.889088 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dbd6d-e411-4ad8-a864-52485404148a admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:59.027218 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6f9f3-6772-4e32-86f2-7a3438c03b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:59.027917 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6f9f3-6772-4e32-86f2-7a3438c03b2b admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:59.028259 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6f9f3-6772-4e32-86f2-7a3438c03b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:59.028540 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6f9f3-6772-4e32-86f2-7a3438c03b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:59.029298 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6f9f3-6772-4e32-86f2-7a3438c03b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:59.032379 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6f9f3-6772-4e32-86f2-7a3438c03b2b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:59.054593 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 869/1741] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:58 2021] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:59.059243 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6f9f3-6772-4e32-86f2-7a3438c03b2b admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:59.073574 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-21b6f9f3-6772-4e32-86f2-7a3438c03b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:59.076005 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c8d90-a52d-49c2-81b8-d2ca3760ccf2 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:59.092950 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2718a6-b3aa-4aa8-9093-0214ffcd3410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:59.093904 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2718a6-b3aa-4aa8-9093-0214ffcd3410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:59.094195 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2718a6-b3aa-4aa8-9093-0214ffcd3410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:59.094477 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2718a6-b3aa-4aa8-9093-0214ffcd3410 admin admin] PATH_INFO: `/v3/users/aad9244529a241b7b4f89f7280cfb832` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:59.096035 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2718a6-b3aa-4aa8-9093-0214ffcd3410 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad9244529a241b7b4f89f7280cfb832)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:59.097573 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6f9f3-6772-4e32-86f2-7a3438c03b2b admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:59.098396 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2718a6-b3aa-4aa8-9093-0214ffcd3410 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:59.106772 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb8a23-5877-4d3a-b12e-a3bbb3ad2d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:59.107855 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb8a23-5877-4d3a-b12e-a3bbb3ad2d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:59.108214 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb8a23-5877-4d3a-b12e-a3bbb3ad2d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:59.108559 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb8a23-5877-4d3a-b12e-a3bbb3ad2d60 admin admin] PATH_INFO: `/v3/projects/50a8267d9f3745188e78889eb5853436/users/f6ef1587ff854bb1bb4feac3ff65494d/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:59.132180 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb8a23-5877-4d3a-b12e-a3bbb3ad2d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a8267d9f3745188e78889eb5853436, user_id=f6ef1587ff854bb1bb4feac3ff65494d, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:59.138051 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb8a23-5877-4d3a-b12e-a3bbb3ad2d60 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:59.166543 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 870/1742] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:10:59 2021] PUT /identity/v3/projects/50a8267d9f3745188e78889eb5853436/users/f6ef1587ff854bb1bb4feac3ff65494d/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:59.168474 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb8a23-5877-4d3a-b12e-a3bbb3ad2d60 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:59.168989 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2d2718a6-b3aa-4aa8-9093-0214ffcd3410 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad9244529a241b7b4f89f7280cfb832'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:59.169886 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2d2718a6-b3aa-4aa8-9093-0214ffcd3410 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad9244529a241b7b4f89f7280cfb832'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:59.170848 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2d2718a6-b3aa-4aa8-9093-0214ffcd3410 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad9244529a241b7b4f89f7280cfb832'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:59.184506 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2d2718a6-b3aa-4aa8-9093-0214ffcd3410 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad9244529a241b7b4f89f7280cfb832'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:59.210698 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2d2718a6-b3aa-4aa8-9093-0214ffcd3410 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad9244529a241b7b4f89f7280cfb832'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:10:59.230052 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 873/1743] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:10:58 2021] DELETE /identity/v3/users/aad9244529a241b7b4f89f7280cfb832 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:59.266643 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb8a23-5877-4d3a-b12e-a3bbb3ad2d60 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:59.343096 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc09f1-b242-43f0-a2f3-066e4c42a07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:59.343854 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc09f1-b242-43f0-a2f3-066e4c42a07e admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:59.344285 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc09f1-b242-43f0-a2f3-066e4c42a07e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:59.344569 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc09f1-b242-43f0-a2f3-066e4c42a07e admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:59.345616 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc09f1-b242-43f0-a2f3-066e4c42a07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:59.349098 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc09f1-b242-43f0-a2f3-066e4c42a07e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:59.366038 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 871/1744] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:10:59 2021] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:10:59.374024 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2718a6-b3aa-4aa8-9093-0214ffcd3410 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:59.375310 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-2d2718a6-b3aa-4aa8-9093-0214ffcd3410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:59.397587 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2718a6-b3aa-4aa8-9093-0214ffcd3410 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:59.406769 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b10c2-0da3-475a-a021-fdfdce22d3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:59.410216 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b10c2-0da3-475a-a021-fdfdce22d3bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:59.411585 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b10c2-0da3-475a-a021-fdfdce22d3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:59.412526 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b10c2-0da3-475a-a021-fdfdce22d3bf admin admin] PATH_INFO: `/v3/projects/50a8267d9f3745188e78889eb5853436/users/f6ef1587ff854bb1bb4feac3ff65494d/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:59.419037 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b10c2-0da3-475a-a021-fdfdce22d3bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a8267d9f3745188e78889eb5853436, user_id=f6ef1587ff854bb1bb4feac3ff65494d, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:59.424777 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b10c2-0da3-475a-a021-fdfdce22d3bf admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:59.440969 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 874/1745] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:10:59 2021] PUT /identity/v3/projects/50a8267d9f3745188e78889eb5853436/users/f6ef1587ff854bb1bb4feac3ff65494d/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:10:59.451421 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c549a-02f8-49c5-b7c8-e0614e7f7830 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:59.451421 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c549a-02f8-49c5-b7c8-e0614e7f7830 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:59.451631 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c549a-02f8-49c5-b7c8-e0614e7f7830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:59.481754 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-103c549a-02f8-49c5-b7c8-e0614e7f7830 None None] MFA Rules not processed for user `f6ef1587ff854bb1bb4feac3ff65494d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:10:59.483164 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-103c549a-02f8-49c5-b7c8-e0614e7f7830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:59.569487 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 872/1746] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:10:59 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:10:59.574254 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b10c2-0da3-475a-a021-fdfdce22d3bf admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:10:59.577024 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-469b10c2-0da3-475a-a021-fdfdce22d3bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:10:59.640846 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b10c2-0da3-475a-a021-fdfdce22d3bf admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:10:59.644576 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8b17e-b003-4ebf-8270-a79c9d0c31fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:10:59.645682 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8b17e-b003-4ebf-8270-a79c9d0c31fe service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:10:59.645682 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8b17e-b003-4ebf-8270-a79c9d0c31fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:10:59.645682 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8b17e-b003-4ebf-8270-a79c9d0c31fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:10:59.674883 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8b17e-b003-4ebf-8270-a79c9d0c31fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:10:59.676480 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8b17e-b003-4ebf-8270-a79c9d0c31fe service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:10:59.703576 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 875/1747] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:10:59 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:01.135685 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c549a-02f8-49c5-b7c8-e0614e7f7830 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:01.137250 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-103c549a-02f8-49c5-b7c8-e0614e7f7830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:01.275219 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c549a-02f8-49c5-b7c8-e0614e7f7830 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:01.283775 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1633e-ec0a-439e-9cb0-435a5a4e8581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:01.285677 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1633e-ec0a-439e-9cb0-435a5a4e8581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:01.288158 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1633e-ec0a-439e-9cb0-435a5a4e8581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:01.288637 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1633e-ec0a-439e-9cb0-435a5a4e8581 admin admin] PATH_INFO: `/v3/projects/3ef2200f28c8424790674e3a1436fd6d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:01.291953 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1633e-ec0a-439e-9cb0-435a5a4e8581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ef2200f28c8424790674e3a1436fd6d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:01.309525 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1633e-ec0a-439e-9cb0-435a5a4e8581 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:01.492538 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-bad1633e-ec0a-439e-9cb0-435a5a4e8581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ef2200f28c8424790674e3a1436fd6d', 'request_id': 'req-bad1633e-ec0a-439e-9cb0-435a5a4e8581'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:01.518048 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-bad1633e-ec0a-439e-9cb0-435a5a4e8581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ef2200f28c8424790674e3a1436fd6d', 'request_id': 'req-bad1633e-ec0a-439e-9cb0-435a5a4e8581'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:01.528213 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-bad1633e-ec0a-439e-9cb0-435a5a4e8581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ef2200f28c8424790674e3a1436fd6d', 'request_id': 'req-bad1633e-ec0a-439e-9cb0-435a5a4e8581'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:01.534716 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883fb77-d7ac-4b25-9328-e9a8cfa01afd None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:01.535302 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883fb77-d7ac-4b25-9328-e9a8cfa01afd None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:01.535411 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883fb77-d7ac-4b25-9328-e9a8cfa01afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:01.552299 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-bad1633e-ec0a-439e-9cb0-435a5a4e8581 admin admin] The token cache is being invalidate because project 3ef2200f28c8424790674e3a1436fd6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:01.552685 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-bad1633e-ec0a-439e-9cb0-435a5a4e8581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:01.553746 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-bad1633e-ec0a-439e-9cb0-435a5a4e8581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:01.557098 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 873/1748] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:01 2021] DELETE /identity/v3/projects/3ef2200f28c8424790674e3a1436fd6d => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:01.564846 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2d05a-dbcc-43cd-a463-e6f285e7b558 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:01.565233 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2d05a-dbcc-43cd-a463-e6f285e7b558 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:01.565776 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2d05a-dbcc-43cd-a463-e6f285e7b558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:01.602283 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-55b2d05a-dbcc-43cd-a463-e6f285e7b558 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:01.603966 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-55b2d05a-dbcc-43cd-a463-e6f285e7b558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:01.612650 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-0883fb77-d7ac-4b25-9328-e9a8cfa01afd None None] MFA Rules not processed for user `2f0bdd9f0f9c424a8f7b8db85c914495`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:01.616277 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-0883fb77-d7ac-4b25-9328-e9a8cfa01afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:01.755699 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 874/1749] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:11:01.779390 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2d05a-dbcc-43cd-a463-e6f285e7b558 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:01.780877 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-55b2d05a-dbcc-43cd-a463-e6f285e7b558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:01.799373 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 876/1750] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:01 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:01.807873 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883fb77-d7ac-4b25-9328-e9a8cfa01afd None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:01.808218 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2d05a-dbcc-43cd-a463-e6f285e7b558 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:01.810062 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-0883fb77-d7ac-4b25-9328-e9a8cfa01afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:01.823786 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f8b91-b684-4bda-8efd-eb8dffa6d41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:01.824690 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f8b91-b684-4bda-8efd-eb8dffa6d41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:01.824977 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f8b91-b684-4bda-8efd-eb8dffa6d41e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:01.825257 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f8b91-b684-4bda-8efd-eb8dffa6d41e admin admin] PATH_INFO: `/v3/users/ab7a999fc00643aca44c739b15fe2f93` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:01.826752 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f8b91-b684-4bda-8efd-eb8dffa6d41e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab7a999fc00643aca44c739b15fe2f93)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:01.828736 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f8b91-b684-4bda-8efd-eb8dffa6d41e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:01.839811 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883fb77-d7ac-4b25-9328-e9a8cfa01afd None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:01.853243 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19246a-3596-40d4-9dbb-0958fab29227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:01.854137 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19246a-3596-40d4-9dbb-0958fab29227 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:01.854421 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19246a-3596-40d4-9dbb-0958fab29227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:01.854700 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19246a-3596-40d4-9dbb-0958fab29227 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:01.861890 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19246a-3596-40d4-9dbb-0958fab29227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:01.871625 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19246a-3596-40d4-9dbb-0958fab29227 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:01.912852 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-927f8b91-b684-4bda-8efd-eb8dffa6d41e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab7a999fc00643aca44c739b15fe2f93'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:01.913707 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-927f8b91-b684-4bda-8efd-eb8dffa6d41e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab7a999fc00643aca44c739b15fe2f93'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:01.924022 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-927f8b91-b684-4bda-8efd-eb8dffa6d41e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab7a999fc00643aca44c739b15fe2f93'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:01.924811 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-927f8b91-b684-4bda-8efd-eb8dffa6d41e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab7a999fc00643aca44c739b15fe2f93'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:01.942144 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 877/1751] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:01 2021] POST /identity/v3/projects => generated 405 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:01.944699 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-927f8b91-b684-4bda-8efd-eb8dffa6d41e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab7a999fc00643aca44c739b15fe2f93'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:01.945479 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab9a66-42ae-4ce9-a7e5-2c2398a77abd None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:01.947135 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab9a66-42ae-4ce9-a7e5-2c2398a77abd None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:01.947525 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab9a66-42ae-4ce9-a7e5-2c2398a77abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:01.961482 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 875/1752] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:01 2021] DELETE /identity/v3/users/ab7a999fc00643aca44c739b15fe2f93 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:11:01.962844 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f8b91-b684-4bda-8efd-eb8dffa6d41e admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:01.964609 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-927f8b91-b684-4bda-8efd-eb8dffa6d41e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:02.003087 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-ddab9a66-42ae-4ce9-a7e5-2c2398a77abd None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:02.004338 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-ddab9a66-42ae-4ce9-a7e5-2c2398a77abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:02.047469 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f8b91-b684-4bda-8efd-eb8dffa6d41e admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:02.062274 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481d955-e6d6-4956-b801-5469ab988d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:02.062974 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481d955-e6d6-4956-b801-5469ab988d17 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:02.065434 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481d955-e6d6-4956-b801-5469ab988d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:02.065730 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481d955-e6d6-4956-b801-5469ab988d17 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:02.066462 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481d955-e6d6-4956-b801-5469ab988d17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:02.070084 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481d955-e6d6-4956-b801-5469ab988d17 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:02.092517 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 878/1753] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:02.095572 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac0947-644e-41c6-91cc-9205abab86ad None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:02.095572 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac0947-644e-41c6-91cc-9205abab86ad None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:02.097808 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac0947-644e-41c6-91cc-9205abab86ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:02.105256 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 876/1754] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:01 2021] POST /identity/v3/users => generated 309 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:02.106009 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481d955-e6d6-4956-b801-5469ab988d17 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:02.115965 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481d955-e6d6-4956-b801-5469ab988d17 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:02.123920 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-2dac0947-644e-41c6-91cc-9205abab86ad None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:02.125324 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-2dac0947-644e-41c6-91cc-9205abab86ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:02.126085 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da580904-e7aa-4cda-aac1-90d242cd5f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:02.126778 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da580904-e7aa-4cda-aac1-90d242cd5f7d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:02.127233 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da580904-e7aa-4cda-aac1-90d242cd5f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:02.127519 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da580904-e7aa-4cda-aac1-90d242cd5f7d admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:02.128322 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da580904-e7aa-4cda-aac1-90d242cd5f7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:02.129741 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da580904-e7aa-4cda-aac1-90d242cd5f7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:02.131666 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da580904-e7aa-4cda-aac1-90d242cd5f7d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:02.134440 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 879/1755] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:02.135264 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac0947-644e-41c6-91cc-9205abab86ad None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:02.146289 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac0947-644e-41c6-91cc-9205abab86ad None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:02.146575 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 877/1756] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:11:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:02.152042 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da580904-e7aa-4cda-aac1-90d242cd5f7d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:02.157277 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b95fa5-8f90-40d0-9c2e-58fa7a7016c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:02.158524 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b95fa5-8f90-40d0-9c2e-58fa7a7016c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:02.159051 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b95fa5-8f90-40d0-9c2e-58fa7a7016c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:02.159547 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b95fa5-8f90-40d0-9c2e-58fa7a7016c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:02.161030 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b95fa5-8f90-40d0-9c2e-58fa7a7016c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:02.162334 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da580904-e7aa-4cda-aac1-90d242cd5f7d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:02.163303 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b95fa5-8f90-40d0-9c2e-58fa7a7016c3 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:02.168787 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117299e2-6b76-473e-b65f-22dade0e89cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:02.169681 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117299e2-6b76-473e-b65f-22dade0e89cb admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:02.170091 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117299e2-6b76-473e-b65f-22dade0e89cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:02.170921 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117299e2-6b76-473e-b65f-22dade0e89cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:02.171842 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117299e2-6b76-473e-b65f-22dade0e89cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:02.174205 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117299e2-6b76-473e-b65f-22dade0e89cb admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:02.177559 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 880/1757] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:02 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:02.179968 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b95fa5-8f90-40d0-9c2e-58fa7a7016c3 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:02.183840 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-12b95fa5-8f90-40d0-9c2e-58fa7a7016c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:02.212471 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 878/1758] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:02 2021] POST /identity/v3/projects => generated 363 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:02.212471 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117299e2-6b76-473e-b65f-22dade0e89cb admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:02.267322 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b95fa5-8f90-40d0-9c2e-58fa7a7016c3 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:02.284289 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117299e2-6b76-473e-b65f-22dade0e89cb admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:02.289937 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d92794-565d-4067-aa27-30a58bbcb2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:02.291120 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d92794-565d-4067-aa27-30a58bbcb2a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:02.291406 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d92794-565d-4067-aa27-30a58bbcb2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:02.291684 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d92794-565d-4067-aa27-30a58bbcb2a6 admin admin] PATH_INFO: `/v3/projects/a8d9ee65493044e5909f43d55fd76847/users/907d4a1ee9c1453483a4dbe33a36ba27/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:02.307735 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d92794-565d-4067-aa27-30a58bbcb2a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8d9ee65493044e5909f43d55fd76847, user_id=907d4a1ee9c1453483a4dbe33a36ba27, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:02.310693 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d92794-565d-4067-aa27-30a58bbcb2a6 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:02.322611 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc48837-8866-4691-8676-65b3cdf3a59c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:02.323598 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc48837-8866-4691-8676-65b3cdf3a59c service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:02.323873 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc48837-8866-4691-8676-65b3cdf3a59c service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:02.324153 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc48837-8866-4691-8676-65b3cdf3a59c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:02.328795 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 879/1759] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:02 2021] PUT /identity/v3/projects/a8d9ee65493044e5909f43d55fd76847/users/907d4a1ee9c1453483a4dbe33a36ba27/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:02.329763 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d92794-565d-4067-aa27-30a58bbcb2a6 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:02.336224 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc48837-8866-4691-8676-65b3cdf3a59c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:02.338317 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc48837-8866-4691-8676-65b3cdf3a59c service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:02.348111 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 881/1760] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:11:02.348778 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc48837-8866-4691-8676-65b3cdf3a59c service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:02.360682 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc48837-8866-4691-8676-65b3cdf3a59c service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:02.406274 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d92794-565d-4067-aa27-30a58bbcb2a6 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:02.412692 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64665e28-24f4-4574-9efb-26358f8472b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:02.413419 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64665e28-24f4-4574-9efb-26358f8472b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:02.413913 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64665e28-24f4-4574-9efb-26358f8472b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:02.414322 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64665e28-24f4-4574-9efb-26358f8472b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:02.415591 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64665e28-24f4-4574-9efb-26358f8472b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:02.417972 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64665e28-24f4-4574-9efb-26358f8472b2 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:02.444166 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 880/1761] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:02 2021] POST /identity/v3/users => generated 282 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:02.445357 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64665e28-24f4-4574-9efb-26358f8472b2 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:02.455714 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41120745-fbcb-438f-8f8e-af903b3324f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:02.456497 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41120745-fbcb-438f-8f8e-af903b3324f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:02.456787 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41120745-fbcb-438f-8f8e-af903b3324f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:02.457185 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41120745-fbcb-438f-8f8e-af903b3324f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:02.458043 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41120745-fbcb-438f-8f8e-af903b3324f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:02.459506 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64665e28-24f4-4574-9efb-26358f8472b2 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:02.460122 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41120745-fbcb-438f-8f8e-af903b3324f2 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:02.466335 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d31309-9cf6-4a24-a09c-8d651d69d876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:02.467423 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d31309-9cf6-4a24-a09c-8d651d69d876 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:02.467756 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d31309-9cf6-4a24-a09c-8d651d69d876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:02.468032 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d31309-9cf6-4a24-a09c-8d651d69d876 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:02.468828 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d31309-9cf6-4a24-a09c-8d651d69d876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:02.470559 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d31309-9cf6-4a24-a09c-8d651d69d876 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:02.480679 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 882/1762] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:02 2021] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:02.482363 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 881/1763] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:02 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:02.485112 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41120745-fbcb-438f-8f8e-af903b3324f2 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:02.486690 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d31309-9cf6-4a24-a09c-8d651d69d876 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:02.498915 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41120745-fbcb-438f-8f8e-af903b3324f2 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:02.500433 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d31309-9cf6-4a24-a09c-8d651d69d876 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:02.504669 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a93e76-d9d2-4979-94f7-64d6bd090f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:02.505688 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a93e76-d9d2-4979-94f7-64d6bd090f35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:02.506109 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a93e76-d9d2-4979-94f7-64d6bd090f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:02.506280 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c4c9d-3bfd-4cec-893b-692f4c2ad692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:02.506449 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a93e76-d9d2-4979-94f7-64d6bd090f35 admin admin] PATH_INFO: `/v3/projects/a8d9ee65493044e5909f43d55fd76847/users/907d4a1ee9c1453483a4dbe33a36ba27/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:02.507032 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c4c9d-3bfd-4cec-893b-692f4c2ad692 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:02.507322 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c4c9d-3bfd-4cec-893b-692f4c2ad692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:02.507646 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c4c9d-3bfd-4cec-893b-692f4c2ad692 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:02.509399 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c4c9d-3bfd-4cec-893b-692f4c2ad692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:02.509690 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a93e76-d9d2-4979-94f7-64d6bd090f35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8d9ee65493044e5909f43d55fd76847, user_id=907d4a1ee9c1453483a4dbe33a36ba27, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:02.512122 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c4c9d-3bfd-4cec-893b-692f4c2ad692 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:02.512531 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a93e76-d9d2-4979-94f7-64d6bd090f35 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:02.524196 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 882/1764] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:02 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:02.525355 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 883/1765] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:02 2021] PUT /identity/v3/projects/a8d9ee65493044e5909f43d55fd76847/users/907d4a1ee9c1453483a4dbe33a36ba27/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:11:02.528499 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c4c9d-3bfd-4cec-893b-692f4c2ad692 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:02.541065 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c4c9d-3bfd-4cec-893b-692f4c2ad692 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:02.609475 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98610c72-82e1-4b13-b94c-40fadf2442a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:02.610383 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98610c72-82e1-4b13-b94c-40fadf2442a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:02.610665 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98610c72-82e1-4b13-b94c-40fadf2442a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:02.610972 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98610c72-82e1-4b13-b94c-40fadf2442a4 admin admin] PATH_INFO: `/v3/projects/ecc53043b8e8417db1627282285f5bdb/users/aa366dae28a54b85bf97b81338a83d37/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:02.628020 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98610c72-82e1-4b13-b94c-40fadf2442a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc53043b8e8417db1627282285f5bdb, user_id=aa366dae28a54b85bf97b81338a83d37, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:02.630797 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98610c72-82e1-4b13-b94c-40fadf2442a4 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:02.644245 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 883/1766] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:02 2021] PUT /identity/v3/projects/ecc53043b8e8417db1627282285f5bdb/users/aa366dae28a54b85bf97b81338a83d37/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:11:02.654835 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f4cd3-0d8f-486e-9a98-0935eb0a8a3a None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:02.655330 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f4cd3-0d8f-486e-9a98-0935eb0a8a3a None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:02.655574 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f4cd3-0d8f-486e-9a98-0935eb0a8a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:02.684583 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-d15f4cd3-0d8f-486e-9a98-0935eb0a8a3a None None] MFA Rules not processed for user `aa366dae28a54b85bf97b81338a83d37`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:02.686115 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-d15f4cd3-0d8f-486e-9a98-0935eb0a8a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:02.780915 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 884/1767] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:02 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:02.786631 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98610c72-82e1-4b13-b94c-40fadf2442a4 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:02.788258 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f4cd3-0d8f-486e-9a98-0935eb0a8a3a None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:02.791508 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-d15f4cd3-0d8f-486e-9a98-0935eb0a8a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:02.878845 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f4cd3-0d8f-486e-9a98-0935eb0a8a3a None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:02.884962 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfaec5c-cc99-4e2d-8aa0-b6489a5ae99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:02.885947 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfaec5c-cc99-4e2d-8aa0-b6489a5ae99c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:02.886241 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfaec5c-cc99-4e2d-8aa0-b6489a5ae99c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:02.886524 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfaec5c-cc99-4e2d-8aa0-b6489a5ae99c admin admin] PATH_INFO: `/v3/projects/0048dccd65bd42778cee278e83420df2` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:02.887758 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfaec5c-cc99-4e2d-8aa0-b6489a5ae99c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0048dccd65bd42778cee278e83420df2)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:02.888026 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98610c72-82e1-4b13-b94c-40fadf2442a4 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:02.889712 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfaec5c-cc99-4e2d-8aa0-b6489a5ae99c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:02.894573 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b798b-b16c-4568-94f1-6647b011480a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:02.895209 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b798b-b16c-4568-94f1-6647b011480a admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:02.896177 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b798b-b16c-4568-94f1-6647b011480a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:02.896360 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b798b-b16c-4568-94f1-6647b011480a admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:02.897043 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b798b-b16c-4568-94f1-6647b011480a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:02.899194 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b798b-b16c-4568-94f1-6647b011480a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:02.934104 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 884/1768] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:02 2021] POST /identity/v3/projects => generated 363 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:11:02.938531 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b798b-b16c-4568-94f1-6647b011480a admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:02.962490 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-dcfaec5c-cc99-4e2d-8aa0-b6489a5ae99c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0048dccd65bd42778cee278e83420df2', 'request_id': 'req-dcfaec5c-cc99-4e2d-8aa0-b6489a5ae99c'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:02.971884 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-dcfaec5c-cc99-4e2d-8aa0-b6489a5ae99c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0048dccd65bd42778cee278e83420df2', 'request_id': 'req-dcfaec5c-cc99-4e2d-8aa0-b6489a5ae99c'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:02.979656 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-dcfaec5c-cc99-4e2d-8aa0-b6489a5ae99c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0048dccd65bd42778cee278e83420df2', 'request_id': 'req-dcfaec5c-cc99-4e2d-8aa0-b6489a5ae99c'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:02.995662 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-dcfaec5c-cc99-4e2d-8aa0-b6489a5ae99c admin admin] The token cache is being invalidate because project 0048dccd65bd42778cee278e83420df2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:02.995985 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-dcfaec5c-cc99-4e2d-8aa0-b6489a5ae99c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:02.996663 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-dcfaec5c-cc99-4e2d-8aa0-b6489a5ae99c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:03.000199 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 885/1769] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:02 2021] DELETE /identity/v3/projects/0048dccd65bd42778cee278e83420df2 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:03.004907 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfaec5c-cc99-4e2d-8aa0-b6489a5ae99c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:03.007602 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-dcfaec5c-cc99-4e2d-8aa0-b6489a5ae99c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:03.024537 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b798b-b16c-4568-94f1-6647b011480a admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:03.112707 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfaec5c-cc99-4e2d-8aa0-b6489a5ae99c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:03.117689 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ff507-cbdc-41c5-9a3c-723eb8806801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:03.119456 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ff507-cbdc-41c5-9a3c-723eb8806801 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:03.119642 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac2144-8315-45ec-991d-275f03c4536a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:03.119873 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ff507-cbdc-41c5-9a3c-723eb8806801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:03.120221 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ff507-cbdc-41c5-9a3c-723eb8806801 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:03.120718 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac2144-8315-45ec-991d-275f03c4536a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:03.121079 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac2144-8315-45ec-991d-275f03c4536a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:03.121172 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ff507-cbdc-41c5-9a3c-723eb8806801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:03.121541 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac2144-8315-45ec-991d-275f03c4536a admin admin] PATH_INFO: `/v3/users/f6ef1587ff854bb1bb4feac3ff65494d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:03.122741 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac2144-8315-45ec-991d-275f03c4536a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ef1587ff854bb1bb4feac3ff65494d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:03.124735 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac2144-8315-45ec-991d-275f03c4536a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:03.129843 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ff507-cbdc-41c5-9a3c-723eb8806801 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:03.170874 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 885/1770] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:02 2021] POST /identity/v3/users => generated 288 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:11:03.172093 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ff507-cbdc-41c5-9a3c-723eb8806801 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:03.174307 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-1a2ff507-cbdc-41c5-9a3c-723eb8806801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:03.192331 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ff507-cbdc-41c5-9a3c-723eb8806801 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:03.207512 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0583bc-431d-4c9c-bc16-9c01b898852b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:03.208324 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0583bc-431d-4c9c-bc16-9c01b898852b admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:03.208825 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0583bc-431d-4c9c-bc16-9c01b898852b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:03.209184 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0583bc-431d-4c9c-bc16-9c01b898852b admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:03.210127 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0583bc-431d-4c9c-bc16-9c01b898852b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:03.212809 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0583bc-431d-4c9c-bc16-9c01b898852b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:03.226172 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-87ac2144-8315-45ec-991d-275f03c4536a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ef1587ff854bb1bb4feac3ff65494d'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:03.234042 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-87ac2144-8315-45ec-991d-275f03c4536a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ef1587ff854bb1bb4feac3ff65494d'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:03.238251 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-87ac2144-8315-45ec-991d-275f03c4536a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ef1587ff854bb1bb4feac3ff65494d'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:03.261527 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 886/1771] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:03 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:11:03.263246 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0583bc-431d-4c9c-bc16-9c01b898852b admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:03.267409 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-ad0583bc-431d-4c9c-bc16-9c01b898852b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:03.273771 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-87ac2144-8315-45ec-991d-275f03c4536a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ef1587ff854bb1bb4feac3ff65494d'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:03.290629 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0583bc-431d-4c9c-bc16-9c01b898852b admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:03.292739 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-87ac2144-8315-45ec-991d-275f03c4536a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ef1587ff854bb1bb4feac3ff65494d'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:03.298490 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046e3dd-daef-4b7e-ba85-8c00db942118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:03.299711 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046e3dd-daef-4b7e-ba85-8c00db942118 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:03.300052 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046e3dd-daef-4b7e-ba85-8c00db942118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:03.300419 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046e3dd-daef-4b7e-ba85-8c00db942118 admin admin] PATH_INFO: `/v3/projects/64a0ea03d21246e6b38026c23a2bf342/users/0111ac49a7364f93836b19d51cc7dc71/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:03.311450 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 886/1772] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:03 2021] DELETE /identity/v3/users/f6ef1587ff854bb1bb4feac3ff65494d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:03.323369 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046e3dd-daef-4b7e-ba85-8c00db942118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a0ea03d21246e6b38026c23a2bf342, user_id=0111ac49a7364f93836b19d51cc7dc71, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:03.326237 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046e3dd-daef-4b7e-ba85-8c00db942118 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:03.347525 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 887/1773] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:03 2021] PUT /identity/v3/projects/64a0ea03d21246e6b38026c23a2bf342/users/0111ac49a7364f93836b19d51cc7dc71/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:03.351227 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac2144-8315-45ec-991d-275f03c4536a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:03.439241 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac2144-8315-45ec-991d-275f03c4536a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:03.531029 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebeb265-aac8-470b-b6c6-88bfd703e180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:03.532002 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebeb265-aac8-470b-b6c6-88bfd703e180 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:03.532289 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebeb265-aac8-470b-b6c6-88bfd703e180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:03.532827 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebeb265-aac8-470b-b6c6-88bfd703e180 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:03.533664 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebeb265-aac8-470b-b6c6-88bfd703e180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:03.535292 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebeb265-aac8-470b-b6c6-88bfd703e180 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:03.562425 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 887/1774] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:03 2021] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:03.572201 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046e3dd-daef-4b7e-ba85-8c00db942118 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:03.582537 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046e3dd-daef-4b7e-ba85-8c00db942118 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:03.588130 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66939b9b-973b-43c9-b376-c5aa2a1fde8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:03.589145 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66939b9b-973b-43c9-b376-c5aa2a1fde8d admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:03.589489 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66939b9b-973b-43c9-b376-c5aa2a1fde8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:03.589818 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66939b9b-973b-43c9-b376-c5aa2a1fde8d admin admin] PATH_INFO: `/v3/projects/64a0ea03d21246e6b38026c23a2bf342/users/0111ac49a7364f93836b19d51cc7dc71/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:03.592151 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66939b9b-973b-43c9-b376-c5aa2a1fde8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a0ea03d21246e6b38026c23a2bf342, user_id=0111ac49a7364f93836b19d51cc7dc71, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:03.595095 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66939b9b-973b-43c9-b376-c5aa2a1fde8d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:03.607042 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 888/1775] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:03 2021] PUT /identity/v3/projects/64a0ea03d21246e6b38026c23a2bf342/users/0111ac49a7364f93836b19d51cc7dc71/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:11:03.618575 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13cb0e-98f6-4d9a-8aca-4512969325c3 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:03.619363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13cb0e-98f6-4d9a-8aca-4512969325c3 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:03.619363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13cb0e-98f6-4d9a-8aca-4512969325c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:03.654173 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-7b13cb0e-98f6-4d9a-8aca-4512969325c3 None None] MFA Rules not processed for user `0111ac49a7364f93836b19d51cc7dc71`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:03.654173 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-7b13cb0e-98f6-4d9a-8aca-4512969325c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:03.660931 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f6239-844e-4d8a-9f6c-103ffac110d5 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:03.661220 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f6239-844e-4d8a-9f6c-103ffac110d5 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:03.661522 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f6239-844e-4d8a-9f6c-103ffac110d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:03.707612 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-5c9f6239-844e-4d8a-9f6c-103ffac110d5 None None] MFA Rules not processed for user `907d4a1ee9c1453483a4dbe33a36ba27`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:03.708851 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-5c9f6239-844e-4d8a-9f6c-103ffac110d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:03.745538 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 888/1776] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:03 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:03.746464 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13cb0e-98f6-4d9a-8aca-4512969325c3 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:03.747945 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-7b13cb0e-98f6-4d9a-8aca-4512969325c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:03.814405 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 889/1777] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:03 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:03.815434 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f6239-844e-4d8a-9f6c-103ffac110d5 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:03.816710 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-5c9f6239-844e-4d8a-9f6c-103ffac110d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:03.845953 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13cb0e-98f6-4d9a-8aca-4512969325c3 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:03.851311 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54d256-d8f7-47de-bcef-06cfb1ffc9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:03.852201 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54d256-d8f7-47de-bcef-06cfb1ffc9dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:03.853103 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54d256-d8f7-47de-bcef-06cfb1ffc9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:03.853627 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54d256-d8f7-47de-bcef-06cfb1ffc9dc admin admin] PATH_INFO: `/v3/projects/50a8267d9f3745188e78889eb5853436` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:03.854979 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54d256-d8f7-47de-bcef-06cfb1ffc9dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=50a8267d9f3745188e78889eb5853436)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:03.856994 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54d256-d8f7-47de-bcef-06cfb1ffc9dc admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:03.883769 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f6239-844e-4d8a-9f6c-103ffac110d5 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:03.888029 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e1a24-36b9-4972-9cf0-df0019472a55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:03.888735 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e1a24-36b9-4972-9cf0-df0019472a55 service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:03.889015 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e1a24-36b9-4972-9cf0-df0019472a55 service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:03.889283 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e1a24-36b9-4972-9cf0-df0019472a55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:03.898976 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e1a24-36b9-4972-9cf0-df0019472a55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:03.901402 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e1a24-36b9-4972-9cf0-df0019472a55 service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:03.917223 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 890/1778] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:03 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:03.924387 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4e54d256-d8f7-47de-bcef-06cfb1ffc9dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50a8267d9f3745188e78889eb5853436', 'request_id': 'req-4e54d256-d8f7-47de-bcef-06cfb1ffc9dc'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:03.933473 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4e54d256-d8f7-47de-bcef-06cfb1ffc9dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50a8267d9f3745188e78889eb5853436', 'request_id': 'req-4e54d256-d8f7-47de-bcef-06cfb1ffc9dc'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:03.939714 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4e54d256-d8f7-47de-bcef-06cfb1ffc9dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50a8267d9f3745188e78889eb5853436', 'request_id': 'req-4e54d256-d8f7-47de-bcef-06cfb1ffc9dc'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:03.955135 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4e54d256-d8f7-47de-bcef-06cfb1ffc9dc admin admin] The token cache is being invalidate because project 50a8267d9f3745188e78889eb5853436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:03.955677 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4e54d256-d8f7-47de-bcef-06cfb1ffc9dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:03.956367 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4e54d256-d8f7-47de-bcef-06cfb1ffc9dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:03.958358 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 889/1779] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:03 2021] DELETE /identity/v3/projects/50a8267d9f3745188e78889eb5853436 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:03.964349 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cec3b-f6de-4bbf-ac18-1ccd6d38f12f None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:03.964653 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cec3b-f6de-4bbf-ac18-1ccd6d38f12f None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:03.964929 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cec3b-f6de-4bbf-ac18-1ccd6d38f12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:03.984336 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-d38cec3b-f6de-4bbf-ac18-1ccd6d38f12f None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:03.985608 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-d38cec3b-f6de-4bbf-ac18-1ccd6d38f12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:03.992283 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54d256-d8f7-47de-bcef-06cfb1ffc9dc admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:03.994475 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-4e54d256-d8f7-47de-bcef-06cfb1ffc9dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:04.061266 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 891/1780] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:04.064699 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54d256-d8f7-47de-bcef-06cfb1ffc9dc admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:04.069096 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b09f61-7673-440f-b738-d284e4e7ea7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:04.069929 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b09f61-7673-440f-b738-d284e4e7ea7c service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:04.070222 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b09f61-7673-440f-b738-d284e4e7ea7c service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:04.070344 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aa5c5-6cbc-4dd7-a271-b2e299983a26 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:04.070580 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aa5c5-6cbc-4dd7-a271-b2e299983a26 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:04.070676 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b09f61-7673-440f-b738-d284e4e7ea7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:04.071554 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aa5c5-6cbc-4dd7-a271-b2e299983a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:04.073228 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-56b09f61-7673-440f-b738-d284e4e7ea7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:04.094396 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-957aa5c5-6cbc-4dd7-a271-b2e299983a26 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:04.096265 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-957aa5c5-6cbc-4dd7-a271-b2e299983a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:04.106639 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 892/1781] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:11:04.110930 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957aa5c5-6cbc-4dd7-a271-b2e299983a26 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:04.122195 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957aa5c5-6cbc-4dd7-a271-b2e299983a26 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:04.127950 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07e609-dca3-4c06-90cf-90d1d8827527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:04.128970 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07e609-dca3-4c06-90cf-90d1d8827527 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:04.129344 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07e609-dca3-4c06-90cf-90d1d8827527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:04.129865 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07e609-dca3-4c06-90cf-90d1d8827527 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:04.130708 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07e609-dca3-4c06-90cf-90d1d8827527 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:04.131083 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07e609-dca3-4c06-90cf-90d1d8827527 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:04.132823 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07e609-dca3-4c06-90cf-90d1d8827527 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:04.135986 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b09f61-7673-440f-b738-d284e4e7ea7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:04.137460 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b09f61-7673-440f-b738-d284e4e7ea7c service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:04.146826 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 890/1782] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:03 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:04.149289 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 893/1783] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:11:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:04.153578 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b09f61-7673-440f-b738-d284e4e7ea7c service cinder] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:04.166550 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b09f61-7673-440f-b738-d284e4e7ea7c service cinder] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:04.172150 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebc445-53c7-4d19-ae51-c0e8d8a8d411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:04.172833 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebc445-53c7-4d19-ae51-c0e8d8a8d411 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:04.173100 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebc445-53c7-4d19-ae51-c0e8d8a8d411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:04.173379 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebc445-53c7-4d19-ae51-c0e8d8a8d411 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:04.174223 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbebc445-53c7-4d19-ae51-c0e8d8a8d411 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:04.176042 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbebc445-53c7-4d19-ae51-c0e8d8a8d411 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:04.203762 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 891/1784] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:04 2021] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:11:04.208166 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07e609-dca3-4c06-90cf-90d1d8827527 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:04.220792 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07e609-dca3-4c06-90cf-90d1d8827527 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:04.302095 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc876680-7b26-4114-b738-6a608f5f9d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:04.302885 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc876680-7b26-4114-b738-6a608f5f9d47 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:04.303229 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc876680-7b26-4114-b738-6a608f5f9d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:04.303477 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc876680-7b26-4114-b738-6a608f5f9d47 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:04.304301 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc876680-7b26-4114-b738-6a608f5f9d47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:04.306695 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc876680-7b26-4114-b738-6a608f5f9d47 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:04.329646 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 894/1785] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:04 2021] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:04.333781 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebc445-53c7-4d19-ae51-c0e8d8a8d411 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:04.345292 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebc445-53c7-4d19-ae51-c0e8d8a8d411 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:04.350032 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5544f-3639-4647-98b9-4e9f6d97089d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:04.350682 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5544f-3639-4647-98b9-4e9f6d97089d admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:04.350962 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5544f-3639-4647-98b9-4e9f6d97089d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:04.351234 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5544f-3639-4647-98b9-4e9f6d97089d admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:04.352021 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5544f-3639-4647-98b9-4e9f6d97089d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:04.354480 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5544f-3639-4647-98b9-4e9f6d97089d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:04.365028 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 892/1786] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:04 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:04.369841 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc876680-7b26-4114-b738-6a608f5f9d47 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:04.379687 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc876680-7b26-4114-b738-6a608f5f9d47 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:04.384746 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005414d1-0c0d-48d1-af57-bd3152c8edd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:04.385453 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005414d1-0c0d-48d1-af57-bd3152c8edd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:04.385742 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005414d1-0c0d-48d1-af57-bd3152c8edd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:04.386041 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005414d1-0c0d-48d1-af57-bd3152c8edd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:04.386781 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005414d1-0c0d-48d1-af57-bd3152c8edd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:04.388523 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005414d1-0c0d-48d1-af57-bd3152c8edd7 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:04.398617 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 895/1787] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:04 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:04.402916 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5544f-3639-4647-98b9-4e9f6d97089d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:04.413415 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5544f-3639-4647-98b9-4e9f6d97089d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:04.419105 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1820b-4831-4d30-becb-c83e52683a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:04.420170 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1820b-4831-4d30-becb-c83e52683a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:04.420457 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1820b-4831-4d30-becb-c83e52683a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:04.420735 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1820b-4831-4d30-becb-c83e52683a1f admin admin] PATH_INFO: `/v3/projects/b1791c1c3a224d9ca7bdc9d5941b2d84/users/5f2c14e3b42240d7ad1403b4b54107a9/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:04.445785 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1820b-4831-4d30-becb-c83e52683a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1791c1c3a224d9ca7bdc9d5941b2d84, user_id=5f2c14e3b42240d7ad1403b4b54107a9, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:04.451179 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1820b-4831-4d30-becb-c83e52683a1f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:04.467767 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 893/1788] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:04 2021] PUT /identity/v3/projects/b1791c1c3a224d9ca7bdc9d5941b2d84/users/5f2c14e3b42240d7ad1403b4b54107a9/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:04.477882 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb8c6b-1e8a-4401-9b8b-d077147e3b5a None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:04.478234 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb8c6b-1e8a-4401-9b8b-d077147e3b5a None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:04.478440 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb8c6b-1e8a-4401-9b8b-d077147e3b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:04.506079 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-dfbb8c6b-1e8a-4401-9b8b-d077147e3b5a None None] MFA Rules not processed for user `5f2c14e3b42240d7ad1403b4b54107a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:04.507296 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-dfbb8c6b-1e8a-4401-9b8b-d077147e3b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:04.584017 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 896/1789] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:04 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:04.589060 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1820b-4831-4d30-becb-c83e52683a1f admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:04.672060 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1820b-4831-4d30-becb-c83e52683a1f admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:04.687718 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeae95f-3240-4f92-aadb-54cc2097c7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:04.688955 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeae95f-3240-4f92-aadb-54cc2097c7a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:04.689342 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeae95f-3240-4f92-aadb-54cc2097c7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:04.689898 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeae95f-3240-4f92-aadb-54cc2097c7a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:04.691062 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeae95f-3240-4f92-aadb-54cc2097c7a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:04.693279 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeae95f-3240-4f92-aadb-54cc2097c7a0 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:04.731193 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 894/1790] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:04 2021] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:11:04.732436 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb8c6b-1e8a-4401-9b8b-d077147e3b5a None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:04.745803 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb8c6b-1e8a-4401-9b8b-d077147e3b5a None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:04.854932 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119e9ba-388a-4ce2-abfa-e4bebdd21489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:04.855633 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119e9ba-388a-4ce2-abfa-e4bebdd21489 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:04.856190 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119e9ba-388a-4ce2-abfa-e4bebdd21489 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:04.856476 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119e9ba-388a-4ce2-abfa-e4bebdd21489 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:04.857196 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119e9ba-388a-4ce2-abfa-e4bebdd21489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:04.859372 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119e9ba-388a-4ce2-abfa-e4bebdd21489 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:04.880768 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 897/1791] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:04 2021] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:11:04.885623 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeae95f-3240-4f92-aadb-54cc2097c7a0 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:04.903456 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeae95f-3240-4f92-aadb-54cc2097c7a0 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:04.909541 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d8988-7580-45ac-94c5-7936725651bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:04.911610 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d8988-7580-45ac-94c5-7936725651bf admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:04.912075 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d8988-7580-45ac-94c5-7936725651bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:04.912518 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d8988-7580-45ac-94c5-7936725651bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:04.913633 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d8988-7580-45ac-94c5-7936725651bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:04.916917 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d8988-7580-45ac-94c5-7936725651bf admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:04.941690 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 895/1792] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:04 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:04.947566 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119e9ba-388a-4ce2-abfa-e4bebdd21489 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:04.958797 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119e9ba-388a-4ce2-abfa-e4bebdd21489 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:04.964834 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffec79-aeaf-462c-8ad2-85f88f35c84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:04.965963 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffec79-aeaf-462c-8ad2-85f88f35c84a admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:04.966504 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffec79-aeaf-462c-8ad2-85f88f35c84a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:04.966727 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffec79-aeaf-462c-8ad2-85f88f35c84a admin admin] PATH_INFO: `/v3/projects/1eaff1221426439b8bc0dd0109fb44f9/users/77d3313a81ac4f1fab9974ed925d8260/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:04.986752 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffec79-aeaf-462c-8ad2-85f88f35c84a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eaff1221426439b8bc0dd0109fb44f9, user_id=77d3313a81ac4f1fab9974ed925d8260, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:04.989950 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffec79-aeaf-462c-8ad2-85f88f35c84a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:05.007164 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 898/1793] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:04 2021] PUT /identity/v3/projects/1eaff1221426439b8bc0dd0109fb44f9/users/77d3313a81ac4f1fab9974ed925d8260/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:05.012026 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d8988-7580-45ac-94c5-7936725651bf admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:05.021938 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d8988-7580-45ac-94c5-7936725651bf admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:05.084523 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e79722-82ec-4017-b7f8-dd187047e171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:05.085354 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e79722-82ec-4017-b7f8-dd187047e171 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:05.085533 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e79722-82ec-4017-b7f8-dd187047e171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:05.085813 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e79722-82ec-4017-b7f8-dd187047e171 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:05.086649 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e79722-82ec-4017-b7f8-dd187047e171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:05.088493 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e79722-82ec-4017-b7f8-dd187047e171 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:05.099355 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 896/1794] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:05 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:05.104403 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffec79-aeaf-462c-8ad2-85f88f35c84a admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:05.115798 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffec79-aeaf-462c-8ad2-85f88f35c84a admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:05.121549 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c70dd-d785-4701-9154-ab4d4591dd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:05.122443 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c70dd-d785-4701-9154-ab4d4591dd46 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:05.122724 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c70dd-d785-4701-9154-ab4d4591dd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:05.122996 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c70dd-d785-4701-9154-ab4d4591dd46 admin admin] PATH_INFO: `/v3/projects/1eaff1221426439b8bc0dd0109fb44f9/users/77d3313a81ac4f1fab9974ed925d8260/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:05.125191 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c70dd-d785-4701-9154-ab4d4591dd46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eaff1221426439b8bc0dd0109fb44f9, user_id=77d3313a81ac4f1fab9974ed925d8260, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:05.128091 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c70dd-d785-4701-9154-ab4d4591dd46 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:05.139133 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 899/1795] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:05 2021] PUT /identity/v3/projects/1eaff1221426439b8bc0dd0109fb44f9/users/77d3313a81ac4f1fab9974ed925d8260/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:05.149790 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baa120-e783-421e-bb51-992bae90100d None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:05.150173 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baa120-e783-421e-bb51-992bae90100d None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:05.150417 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baa120-e783-421e-bb51-992bae90100d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:05.177843 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-f3baa120-e783-421e-bb51-992bae90100d None None] MFA Rules not processed for user `77d3313a81ac4f1fab9974ed925d8260`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:05.179067 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f3baa120-e783-421e-bb51-992bae90100d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:05.246795 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 897/1796] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:05 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:05.256802 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c70dd-d785-4701-9154-ab4d4591dd46 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:05.258704 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-153c70dd-d785-4701-9154-ab4d4591dd46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:05.316227 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c70dd-d785-4701-9154-ab4d4591dd46 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:05.320205 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9c476-6df9-40d0-91b3-74e09d8b8deb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:05.320878 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9c476-6df9-40d0-91b3-74e09d8b8deb service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:05.321266 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9c476-6df9-40d0-91b3-74e09d8b8deb service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:05.321567 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9c476-6df9-40d0-91b3-74e09d8b8deb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:05.381947 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9c476-6df9-40d0-91b3-74e09d8b8deb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:05.383624 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9c476-6df9-40d0-91b3-74e09d8b8deb service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:05.393836 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 900/1797] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:05 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:05.629408 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baa120-e783-421e-bb51-992bae90100d None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:05.632406 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f3baa120-e783-421e-bb51-992bae90100d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:05.765644 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baa120-e783-421e-bb51-992bae90100d None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:05.776983 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ac4b8-007f-4233-a75d-62bf32e46634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:05.778178 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ac4b8-007f-4233-a75d-62bf32e46634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:05.780271 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ac4b8-007f-4233-a75d-62bf32e46634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:05.780711 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ac4b8-007f-4233-a75d-62bf32e46634 admin admin] PATH_INFO: `/v3/users/2f0bdd9f0f9c424a8f7b8db85c914495` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:05.783972 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ac4b8-007f-4233-a75d-62bf32e46634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f0bdd9f0f9c424a8f7b8db85c914495)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:05.790319 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ac4b8-007f-4233-a75d-62bf32e46634 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:05.877542 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-f80ac4b8-007f-4233-a75d-62bf32e46634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f0bdd9f0f9c424a8f7b8db85c914495'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:05.878315 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-f80ac4b8-007f-4233-a75d-62bf32e46634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f0bdd9f0f9c424a8f7b8db85c914495'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:05.879900 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-f80ac4b8-007f-4233-a75d-62bf32e46634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f0bdd9f0f9c424a8f7b8db85c914495'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:05.904507 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-f80ac4b8-007f-4233-a75d-62bf32e46634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f0bdd9f0f9c424a8f7b8db85c914495'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:05.916724 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-f80ac4b8-007f-4233-a75d-62bf32e46634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f0bdd9f0f9c424a8f7b8db85c914495'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:05.932036 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 898/1798] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:05 2021] DELETE /identity/v3/users/2f0bdd9f0f9c424a8f7b8db85c914495 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:06.254406 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9c476-6df9-40d0-91b3-74e09d8b8deb service cinder] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:06.267037 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9c476-6df9-40d0-91b3-74e09d8b8deb service cinder] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:06.338888 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe71e2-7eb3-49e5-a631-78af4f7a6579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:06.339900 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe71e2-7eb3-49e5-a631-78af4f7a6579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:06.340189 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe71e2-7eb3-49e5-a631-78af4f7a6579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:06.340489 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe71e2-7eb3-49e5-a631-78af4f7a6579 admin admin] PATH_INFO: `/v3/projects/4ec3331c301a4be39f55b8f4fac47de5` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:06.341714 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe71e2-7eb3-49e5-a631-78af4f7a6579 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ec3331c301a4be39f55b8f4fac47de5)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:06.343691 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe71e2-7eb3-49e5-a631-78af4f7a6579 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:06.392961 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5bbe71e2-7eb3-49e5-a631-78af4f7a6579 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ec3331c301a4be39f55b8f4fac47de5', 'request_id': 'req-5bbe71e2-7eb3-49e5-a631-78af4f7a6579'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:06.402945 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5bbe71e2-7eb3-49e5-a631-78af4f7a6579 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ec3331c301a4be39f55b8f4fac47de5', 'request_id': 'req-5bbe71e2-7eb3-49e5-a631-78af4f7a6579'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:06.410472 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5bbe71e2-7eb3-49e5-a631-78af4f7a6579 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ec3331c301a4be39f55b8f4fac47de5', 'request_id': 'req-5bbe71e2-7eb3-49e5-a631-78af4f7a6579'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:06.424517 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5bbe71e2-7eb3-49e5-a631-78af4f7a6579 admin admin] The token cache is being invalidate because project 4ec3331c301a4be39f55b8f4fac47de5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:06.424851 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5bbe71e2-7eb3-49e5-a631-78af4f7a6579 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:06.425589 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5bbe71e2-7eb3-49e5-a631-78af4f7a6579 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:06.427189 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 901/1799] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:06 2021] DELETE /identity/v3/projects/4ec3331c301a4be39f55b8f4fac47de5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:06.432174 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ac4b8-007f-4233-a75d-62bf32e46634 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:06.435899 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f80ac4b8-007f-4233-a75d-62bf32e46634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:06.450307 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ac4b8-007f-4233-a75d-62bf32e46634 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:06.513251 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4a2dc-4e23-4a60-8422-e4b7532772e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:06.514187 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4a2dc-4e23-4a60-8422-e4b7532772e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:06.514463 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4a2dc-4e23-4a60-8422-e4b7532772e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:06.514731 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4a2dc-4e23-4a60-8422-e4b7532772e4 admin admin] PATH_INFO: `/v3/users/907d4a1ee9c1453483a4dbe33a36ba27` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:06.515945 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4a2dc-4e23-4a60-8422-e4b7532772e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=907d4a1ee9c1453483a4dbe33a36ba27)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:06.517916 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4a2dc-4e23-4a60-8422-e4b7532772e4 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:06.567724 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-dda4a2dc-4e23-4a60-8422-e4b7532772e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '907d4a1ee9c1453483a4dbe33a36ba27'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:06.568378 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-dda4a2dc-4e23-4a60-8422-e4b7532772e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '907d4a1ee9c1453483a4dbe33a36ba27'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:06.568977 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-dda4a2dc-4e23-4a60-8422-e4b7532772e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '907d4a1ee9c1453483a4dbe33a36ba27'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:06.580923 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-dda4a2dc-4e23-4a60-8422-e4b7532772e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '907d4a1ee9c1453483a4dbe33a36ba27'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:06.588770 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-dda4a2dc-4e23-4a60-8422-e4b7532772e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '907d4a1ee9c1453483a4dbe33a36ba27'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:06.600683 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 899/1800] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:06 2021] DELETE /identity/v3/users/907d4a1ee9c1453483a4dbe33a36ba27 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:06.766343 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe71e2-7eb3-49e5-a631-78af4f7a6579 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:06.767809 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-5bbe71e2-7eb3-49e5-a631-78af4f7a6579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:06.784863 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe71e2-7eb3-49e5-a631-78af4f7a6579 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:06.844125 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64f707-f750-496a-bb7e-e6993193aa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:06.845553 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64f707-f750-496a-bb7e-e6993193aa02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:06.846020 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64f707-f750-496a-bb7e-e6993193aa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:06.846306 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64f707-f750-496a-bb7e-e6993193aa02 admin admin] PATH_INFO: `/v3/projects/a8d9ee65493044e5909f43d55fd76847` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:06.847792 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64f707-f750-496a-bb7e-e6993193aa02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8d9ee65493044e5909f43d55fd76847)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:06.849796 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64f707-f750-496a-bb7e-e6993193aa02 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:06.901033 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-7f64f707-f750-496a-bb7e-e6993193aa02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8d9ee65493044e5909f43d55fd76847', 'request_id': 'req-7f64f707-f750-496a-bb7e-e6993193aa02'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:06.910460 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-7f64f707-f750-496a-bb7e-e6993193aa02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8d9ee65493044e5909f43d55fd76847', 'request_id': 'req-7f64f707-f750-496a-bb7e-e6993193aa02'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:06.916229 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-7f64f707-f750-496a-bb7e-e6993193aa02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8d9ee65493044e5909f43d55fd76847', 'request_id': 'req-7f64f707-f750-496a-bb7e-e6993193aa02'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:06.927032 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-7f64f707-f750-496a-bb7e-e6993193aa02 admin admin] The token cache is being invalidate because project a8d9ee65493044e5909f43d55fd76847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:06.927316 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-7f64f707-f750-496a-bb7e-e6993193aa02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:06.927956 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-7f64f707-f750-496a-bb7e-e6993193aa02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:06.929487 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 902/1801] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:06 2021] DELETE /identity/v3/projects/a8d9ee65493044e5909f43d55fd76847 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:06.937341 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb5c0d-c392-407d-86b9-31f1912251aa None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:06.937831 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb5c0d-c392-407d-86b9-31f1912251aa None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:06.937937 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb5c0d-c392-407d-86b9-31f1912251aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:06.956306 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-83bb5c0d-c392-407d-86b9-31f1912251aa None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:06.957567 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-83bb5c0d-c392-407d-86b9-31f1912251aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:07.017850 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 900/1802] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:07.026246 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448be72c-ddd5-445f-8a59-444775474e25 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:07.026546 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448be72c-ddd5-445f-8a59-444775474e25 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:07.026824 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448be72c-ddd5-445f-8a59-444775474e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:07.046095 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-448be72c-ddd5-445f-8a59-444775474e25 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:07.047302 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-448be72c-ddd5-445f-8a59-444775474e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:07.056676 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 903/1803] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:07.060729 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb5c0d-c392-407d-86b9-31f1912251aa None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:07.070670 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb5c0d-c392-407d-86b9-31f1912251aa None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:07.076341 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8072401-e9e9-471f-9ddc-656d258ebdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:07.076990 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8072401-e9e9-471f-9ddc-656d258ebdf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:07.077275 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8072401-e9e9-471f-9ddc-656d258ebdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:07.077618 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8072401-e9e9-471f-9ddc-656d258ebdf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:07.078392 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8072401-e9e9-471f-9ddc-656d258ebdf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:07.078702 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8072401-e9e9-471f-9ddc-656d258ebdf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:07.080303 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8072401-e9e9-471f-9ddc-656d258ebdf8 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:07.091782 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 901/1804] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:11:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:07.096168 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448be72c-ddd5-445f-8a59-444775474e25 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:07.106167 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448be72c-ddd5-445f-8a59-444775474e25 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:07.110793 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e5705-2927-4722-b78c-caf207dfb34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:07.111436 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e5705-2927-4722-b78c-caf207dfb34c admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:07.111729 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e5705-2927-4722-b78c-caf207dfb34c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:07.112034 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e5705-2927-4722-b78c-caf207dfb34c admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:07.112735 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e5705-2927-4722-b78c-caf207dfb34c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:07.114684 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e5705-2927-4722-b78c-caf207dfb34c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:07.140184 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 904/1805] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:07 2021] POST /identity/v3/projects => generated 361 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:07.144221 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8072401-e9e9-471f-9ddc-656d258ebdf8 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:07.154241 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8072401-e9e9-471f-9ddc-656d258ebdf8 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:07.208177 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93163076-eaaf-4acc-88b9-16733e20a08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:07.208858 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93163076-eaaf-4acc-88b9-16733e20a08c admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:07.209121 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93163076-eaaf-4acc-88b9-16733e20a08c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:07.209414 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93163076-eaaf-4acc-88b9-16733e20a08c admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:07.210129 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93163076-eaaf-4acc-88b9-16733e20a08c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:07.212094 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93163076-eaaf-4acc-88b9-16733e20a08c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:07.232092 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 902/1806] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:07 2021] POST /identity/v3/users => generated 281 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:11:07.236221 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e5705-2927-4722-b78c-caf207dfb34c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:07.247491 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e5705-2927-4722-b78c-caf207dfb34c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:07.252829 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3796013-65f7-4897-9dd6-5d2cb75ab699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:07.253625 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3796013-65f7-4897-9dd6-5d2cb75ab699 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:07.253980 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3796013-65f7-4897-9dd6-5d2cb75ab699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:07.254339 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3796013-65f7-4897-9dd6-5d2cb75ab699 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:07.255178 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3796013-65f7-4897-9dd6-5d2cb75ab699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:07.257068 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3796013-65f7-4897-9dd6-5d2cb75ab699 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:07.267797 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 905/1807] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:07 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:11:07.271805 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93163076-eaaf-4acc-88b9-16733e20a08c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:07.282915 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93163076-eaaf-4acc-88b9-16733e20a08c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:07.288219 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dcf96c-f094-46df-a161-46fafefda5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:07.288889 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcf96c-f094-46df-a161-46fafefda5dc admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:07.289177 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcf96c-f094-46df-a161-46fafefda5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:07.289471 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcf96c-f094-46df-a161-46fafefda5dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:07.290812 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dcf96c-f094-46df-a161-46fafefda5dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:07.292399 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dcf96c-f094-46df-a161-46fafefda5dc admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:07.310279 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 903/1808] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:07 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:11:07.311211 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3796013-65f7-4897-9dd6-5d2cb75ab699 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:07.321950 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3796013-65f7-4897-9dd6-5d2cb75ab699 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:07.327015 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b9555-9354-4ecf-81d6-788fc99533f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:07.327952 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b9555-9354-4ecf-81d6-788fc99533f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:07.328233 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b9555-9354-4ecf-81d6-788fc99533f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:07.328510 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b9555-9354-4ecf-81d6-788fc99533f3 admin admin] PATH_INFO: `/v3/projects/fcb2841ed71a43068b50cdf978d8ee41/users/d0a19b21073c42bda13a68e8e03e4fba/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:07.348401 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b9555-9354-4ecf-81d6-788fc99533f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb2841ed71a43068b50cdf978d8ee41, user_id=d0a19b21073c42bda13a68e8e03e4fba, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:07.351101 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b9555-9354-4ecf-81d6-788fc99533f3 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:07.369466 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 906/1809] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:07 2021] PUT /identity/v3/projects/fcb2841ed71a43068b50cdf978d8ee41/users/d0a19b21073c42bda13a68e8e03e4fba/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:07.378201 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cc762-f8fa-4c1f-9cdf-d7759b268d62 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:07.378516 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cc762-f8fa-4c1f-9cdf-d7759b268d62 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:07.379027 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cc762-f8fa-4c1f-9cdf-d7759b268d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:07.407002 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-f76cc762-f8fa-4c1f-9cdf-d7759b268d62 None None] MFA Rules not processed for user `d0a19b21073c42bda13a68e8e03e4fba`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:07.408438 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f76cc762-f8fa-4c1f-9cdf-d7759b268d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:07.471326 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 904/1810] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:07 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:07.502393 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b9555-9354-4ecf-81d6-788fc99533f3 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:07.504080 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-aa5b9555-9354-4ecf-81d6-788fc99533f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:07.559712 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b9555-9354-4ecf-81d6-788fc99533f3 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:07.563258 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5479ff-145a-4850-87a1-ea4385cc811a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:07.563895 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5479ff-145a-4850-87a1-ea4385cc811a service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:07.564194 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5479ff-145a-4850-87a1-ea4385cc811a service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:07.564472 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5479ff-145a-4850-87a1-ea4385cc811a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:07.573254 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5479ff-145a-4850-87a1-ea4385cc811a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:07.574713 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5479ff-145a-4850-87a1-ea4385cc811a service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:07.583177 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 907/1811] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:07 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:07.597319 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cc762-f8fa-4c1f-9cdf-d7759b268d62 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:07.656704 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cc762-f8fa-4c1f-9cdf-d7759b268d62 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:07.661583 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713ae28-30c5-400f-8ac3-56346ca510c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:07.662414 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713ae28-30c5-400f-8ac3-56346ca510c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:07.662696 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713ae28-30c5-400f-8ac3-56346ca510c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:07.662990 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713ae28-30c5-400f-8ac3-56346ca510c9 admin admin] PATH_INFO: `/v3/users/d0a19b21073c42bda13a68e8e03e4fba` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:07.664178 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713ae28-30c5-400f-8ac3-56346ca510c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0a19b21073c42bda13a68e8e03e4fba)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:07.666337 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713ae28-30c5-400f-8ac3-56346ca510c9 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:07.709965 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2713ae28-30c5-400f-8ac3-56346ca510c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0a19b21073c42bda13a68e8e03e4fba'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:07.710632 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2713ae28-30c5-400f-8ac3-56346ca510c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0a19b21073c42bda13a68e8e03e4fba'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:07.711248 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2713ae28-30c5-400f-8ac3-56346ca510c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0a19b21073c42bda13a68e8e03e4fba'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:07.722469 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2713ae28-30c5-400f-8ac3-56346ca510c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0a19b21073c42bda13a68e8e03e4fba'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:07.729185 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2713ae28-30c5-400f-8ac3-56346ca510c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0a19b21073c42bda13a68e8e03e4fba'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:07.742332 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 905/1812] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:07 2021] DELETE /identity/v3/users/d0a19b21073c42bda13a68e8e03e4fba => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:07.747910 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259334a-c0a9-424a-92f7-e98c6926e0c8 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:07.748200 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259334a-c0a9-424a-92f7-e98c6926e0c8 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:07.748498 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259334a-c0a9-424a-92f7-e98c6926e0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:07.765571 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-f259334a-c0a9-424a-92f7-e98c6926e0c8 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:07.766762 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-f259334a-c0a9-424a-92f7-e98c6926e0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:07.823788 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 908/1813] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:07.833570 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713ae28-30c5-400f-8ac3-56346ca510c9 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:07.834974 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-2713ae28-30c5-400f-8ac3-56346ca510c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:07.895047 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713ae28-30c5-400f-8ac3-56346ca510c9 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:07.900764 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc810e3-1a75-47f7-973b-8fe9a38268e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:07.901136 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc810e3-1a75-47f7-973b-8fe9a38268e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:07.901526 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc810e3-1a75-47f7-973b-8fe9a38268e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:07.901966 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc810e3-1a75-47f7-973b-8fe9a38268e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:07.913774 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc810e3-1a75-47f7-973b-8fe9a38268e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:07.914376 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc810e3-1a75-47f7-973b-8fe9a38268e8 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:07.929350 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 906/1814] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:08.273770 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259334a-c0a9-424a-92f7-e98c6926e0c8 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:08.275714 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-f259334a-c0a9-424a-92f7-e98c6926e0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:08.291710 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259334a-c0a9-424a-92f7-e98c6926e0c8 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:08.297233 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fe994-e938-4a10-b607-6118191dc609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:08.298572 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fe994-e938-4a10-b607-6118191dc609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:08.299741 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fe994-e938-4a10-b607-6118191dc609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:08.300362 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fe994-e938-4a10-b607-6118191dc609 admin admin] PATH_INFO: `/v3/projects/fcb2841ed71a43068b50cdf978d8ee41` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:08.302330 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fe994-e938-4a10-b607-6118191dc609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcb2841ed71a43068b50cdf978d8ee41)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:08.304408 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fe994-e938-4a10-b607-6118191dc609 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:08.366654 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-040fe994-e938-4a10-b607-6118191dc609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcb2841ed71a43068b50cdf978d8ee41', 'request_id': 'req-040fe994-e938-4a10-b607-6118191dc609'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:08.379452 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-040fe994-e938-4a10-b607-6118191dc609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcb2841ed71a43068b50cdf978d8ee41', 'request_id': 'req-040fe994-e938-4a10-b607-6118191dc609'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:08.395317 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-040fe994-e938-4a10-b607-6118191dc609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcb2841ed71a43068b50cdf978d8ee41', 'request_id': 'req-040fe994-e938-4a10-b607-6118191dc609'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:08.418777 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-040fe994-e938-4a10-b607-6118191dc609 admin admin] The token cache is being invalidate because project fcb2841ed71a43068b50cdf978d8ee41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:08.419137 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-040fe994-e938-4a10-b607-6118191dc609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:08.420122 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-040fe994-e938-4a10-b607-6118191dc609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:08.422585 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 909/1815] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:08 2021] DELETE /identity/v3/projects/fcb2841ed71a43068b50cdf978d8ee41 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:08.432027 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cc1e3-7103-4e3e-b951-6554ba3bb8ba None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:08.432483 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cc1e3-7103-4e3e-b951-6554ba3bb8ba None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:08.432669 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cc1e3-7103-4e3e-b951-6554ba3bb8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:08.455222 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-460cc1e3-7103-4e3e-b951-6554ba3bb8ba None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:08.456653 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-460cc1e3-7103-4e3e-b951-6554ba3bb8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:08.546618 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 907/1816] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:08.547815 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8301ea-f26a-4d7b-b702-c0bf15e61c49 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:08.548186 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8301ea-f26a-4d7b-b702-c0bf15e61c49 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:08.548542 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8301ea-f26a-4d7b-b702-c0bf15e61c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:08.584176 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-1d8301ea-f26a-4d7b-b702-c0bf15e61c49 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:08.586131 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-1d8301ea-f26a-4d7b-b702-c0bf15e61c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:08.601397 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cc1e3-7103-4e3e-b951-6554ba3bb8ba None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:08.608610 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 910/1817] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:08.613225 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cc1e3-7103-4e3e-b951-6554ba3bb8ba None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:08.623214 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c80f1-53ae-47b9-b5ae-539946f988dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:08.627650 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c80f1-53ae-47b9-b5ae-539946f988dc admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:08.627938 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c80f1-53ae-47b9-b5ae-539946f988dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:08.628214 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c80f1-53ae-47b9-b5ae-539946f988dc admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:08.628973 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c80f1-53ae-47b9-b5ae-539946f988dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:08.629283 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c80f1-53ae-47b9-b5ae-539946f988dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:08.630929 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c80f1-53ae-47b9-b5ae-539946f988dc admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:08.660410 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 908/1818] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:11:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:08.666333 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8301ea-f26a-4d7b-b702-c0bf15e61c49 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:08.676385 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8301ea-f26a-4d7b-b702-c0bf15e61c49 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:08.681579 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8916b7a-75bc-49b2-a0e6-0d3a6bf9fdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:08.682363 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8916b7a-75bc-49b2-a0e6-0d3a6bf9fdd6 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:08.682765 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8916b7a-75bc-49b2-a0e6-0d3a6bf9fdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:08.683148 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8916b7a-75bc-49b2-a0e6-0d3a6bf9fdd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:08.683959 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8916b7a-75bc-49b2-a0e6-0d3a6bf9fdd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:08.686072 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8916b7a-75bc-49b2-a0e6-0d3a6bf9fdd6 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:08.729587 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 911/1819] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:08 2021] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:08.734116 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c80f1-53ae-47b9-b5ae-539946f988dc admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:08.746308 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c80f1-53ae-47b9-b5ae-539946f988dc admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:08.807949 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3fada-6789-4e92-bb37-767e9d338327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:08.808634 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3fada-6789-4e92-bb37-767e9d338327 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:08.808898 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3fada-6789-4e92-bb37-767e9d338327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:08.809281 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3fada-6789-4e92-bb37-767e9d338327 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:08.809961 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3fada-6789-4e92-bb37-767e9d338327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:08.811866 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3fada-6789-4e92-bb37-767e9d338327 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:08.833057 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 909/1820] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:08 2021] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:08.837423 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8916b7a-75bc-49b2-a0e6-0d3a6bf9fdd6 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:08.848298 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8916b7a-75bc-49b2-a0e6-0d3a6bf9fdd6 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:08.853692 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fee498-b6e5-413d-8486-0683fe63b5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:08.854466 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fee498-b6e5-413d-8486-0683fe63b5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:08.854751 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fee498-b6e5-413d-8486-0683fe63b5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:08.855025 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fee498-b6e5-413d-8486-0683fe63b5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:08.855795 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fee498-b6e5-413d-8486-0683fe63b5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:08.857646 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fee498-b6e5-413d-8486-0683fe63b5e1 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:08.869427 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 912/1821] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:08 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:08.873341 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3fada-6789-4e92-bb37-767e9d338327 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:08.883321 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3fada-6789-4e92-bb37-767e9d338327 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:08.888437 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82364691-1423-42fe-b6c0-65f5fbbed36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:08.889210 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82364691-1423-42fe-b6c0-65f5fbbed36e admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:08.889594 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82364691-1423-42fe-b6c0-65f5fbbed36e admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:08.889949 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82364691-1423-42fe-b6c0-65f5fbbed36e admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:08.890761 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82364691-1423-42fe-b6c0-65f5fbbed36e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:08.892568 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82364691-1423-42fe-b6c0-65f5fbbed36e admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:08.904117 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 910/1822] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:08 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:11:08.908048 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fee498-b6e5-413d-8486-0683fe63b5e1 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:08.918830 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fee498-b6e5-413d-8486-0683fe63b5e1 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:08.924698 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f1c38-9323-44b4-8a30-556e5b44a7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:08.926681 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f1c38-9323-44b4-8a30-556e5b44a7bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:08.927235 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f1c38-9323-44b4-8a30-556e5b44a7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:08.927573 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f1c38-9323-44b4-8a30-556e5b44a7bc admin admin] PATH_INFO: `/v3/projects/b82d06d1c4f84b8baa79ed95d3d0283b/users/8bf6e9d8757d4794b0e3df1ed362043c/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:08.951458 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f1c38-9323-44b4-8a30-556e5b44a7bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b82d06d1c4f84b8baa79ed95d3d0283b, user_id=8bf6e9d8757d4794b0e3df1ed362043c, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:08.956728 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f1c38-9323-44b4-8a30-556e5b44a7bc admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:08.980077 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 913/1823] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:08 2021] PUT /identity/v3/projects/b82d06d1c4f84b8baa79ed95d3d0283b/users/8bf6e9d8757d4794b0e3df1ed362043c/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:09.000887 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56806e6-a023-4fbd-8d3b-7dec24870eeb None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:09.001565 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56806e6-a023-4fbd-8d3b-7dec24870eeb None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:09.002241 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56806e6-a023-4fbd-8d3b-7dec24870eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:09.231724 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f1c38-9323-44b4-8a30-556e5b44a7bc admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:09.234215 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-c08f1c38-9323-44b4-8a30-556e5b44a7bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:09.252647 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-e56806e6-a023-4fbd-8d3b-7dec24870eeb None None] MFA Rules not processed for user `8bf6e9d8757d4794b0e3df1ed362043c`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:09.253899 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-e56806e6-a023-4fbd-8d3b-7dec24870eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:09.346550 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f1c38-9323-44b4-8a30-556e5b44a7bc admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:09.351496 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d35b2-0f73-40ec-bfa4-8a7090983e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:09.353304 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d35b2-0f73-40ec-bfa4-8a7090983e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:09.354162 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d35b2-0f73-40ec-bfa4-8a7090983e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:09.354647 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d35b2-0f73-40ec-bfa4-8a7090983e58 admin admin] PATH_INFO: `/v3/users/aa366dae28a54b85bf97b81338a83d37` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:09.355395 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 911/1824] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:08 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:09.356362 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d35b2-0f73-40ec-bfa4-8a7090983e58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa366dae28a54b85bf97b81338a83d37)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:09.358499 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d35b2-0f73-40ec-bfa4-8a7090983e58 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:09.360160 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56806e6-a023-4fbd-8d3b-7dec24870eeb None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:09.371896 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56806e6-a023-4fbd-8d3b-7dec24870eeb None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:09.376856 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171efb6-e64c-4a6b-96e0-102b20f4ab91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:09.378201 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171efb6-e64c-4a6b-96e0-102b20f4ab91 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:09.378201 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171efb6-e64c-4a6b-96e0-102b20f4ab91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:09.379347 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171efb6-e64c-4a6b-96e0-102b20f4ab91 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:09.380438 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171efb6-e64c-4a6b-96e0-102b20f4ab91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:09.382692 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171efb6-e64c-4a6b-96e0-102b20f4ab91 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:09.442897 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-923d35b2-0f73-40ec-bfa4-8a7090983e58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa366dae28a54b85bf97b81338a83d37'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:09.447318 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-923d35b2-0f73-40ec-bfa4-8a7090983e58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa366dae28a54b85bf97b81338a83d37'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:09.452873 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 912/1825] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:09 2021] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:09.456322 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171efb6-e64c-4a6b-96e0-102b20f4ab91 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:09.460287 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-1171efb6-e64c-4a6b-96e0-102b20f4ab91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:09.470871 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-923d35b2-0f73-40ec-bfa4-8a7090983e58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa366dae28a54b85bf97b81338a83d37'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:09.473350 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-923d35b2-0f73-40ec-bfa4-8a7090983e58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa366dae28a54b85bf97b81338a83d37'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:09.499375 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-923d35b2-0f73-40ec-bfa4-8a7090983e58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa366dae28a54b85bf97b81338a83d37'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:09.527423 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 914/1826] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:09 2021] DELETE /identity/v3/users/aa366dae28a54b85bf97b81338a83d37 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:11:09.531921 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f656d7-78af-447f-a1e8-cc92783bfc6a None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:09.532799 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f656d7-78af-447f-a1e8-cc92783bfc6a None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:09.533444 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f656d7-78af-447f-a1e8-cc92783bfc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:09.553061 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-f3f656d7-78af-447f-a1e8-cc92783bfc6a None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:09.554598 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-f3f656d7-78af-447f-a1e8-cc92783bfc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:09.579001 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171efb6-e64c-4a6b-96e0-102b20f4ab91 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:09.642868 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 915/1827] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:09.646026 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dd11c-275c-4a48-aa2e-44984548b7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:09.646758 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dd11c-275c-4a48-aa2e-44984548b7f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:09.647043 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dd11c-275c-4a48-aa2e-44984548b7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:09.647320 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dd11c-275c-4a48-aa2e-44984548b7f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:09.648240 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dd11c-275c-4a48-aa2e-44984548b7f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:09.651057 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dd11c-275c-4a48-aa2e-44984548b7f3 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:09.655801 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f656d7-78af-447f-a1e8-cc92783bfc6a None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:09.658596 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-f3f656d7-78af-447f-a1e8-cc92783bfc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:09.679644 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 913/1828] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:09 2021] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:09.684305 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dd11c-275c-4a48-aa2e-44984548b7f3 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:09.698229 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dd11c-275c-4a48-aa2e-44984548b7f3 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:09.704915 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1831ae-4f74-401e-afe5-3f99b1c12105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:09.705703 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1831ae-4f74-401e-afe5-3f99b1c12105 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:09.705924 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1831ae-4f74-401e-afe5-3f99b1c12105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:09.706200 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1831ae-4f74-401e-afe5-3f99b1c12105 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:09.706948 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1831ae-4f74-401e-afe5-3f99b1c12105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:09.708545 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1831ae-4f74-401e-afe5-3f99b1c12105 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:09.727525 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 914/1829] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:09 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:11:09.729363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1831ae-4f74-401e-afe5-3f99b1c12105 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:09.745300 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1831ae-4f74-401e-afe5-3f99b1c12105 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:09.753078 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68238e-ce31-4bcc-b21a-0349fd1d354f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:09.754257 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68238e-ce31-4bcc-b21a-0349fd1d354f admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:09.754630 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68238e-ce31-4bcc-b21a-0349fd1d354f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:09.754998 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68238e-ce31-4bcc-b21a-0349fd1d354f admin admin] PATH_INFO: `/v3/projects/4496529ed1544b56b9b64f951b308869/users/497ade3d350c4f719b816567974857d1/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:09.761136 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f656d7-78af-447f-a1e8-cc92783bfc6a None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:09.765807 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddcd47-412f-4d23-8c3a-5d4efb8f6bdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:09.766827 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddcd47-412f-4d23-8c3a-5d4efb8f6bdd service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:09.767310 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddcd47-412f-4d23-8c3a-5d4efb8f6bdd service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:09.767777 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddcd47-412f-4d23-8c3a-5d4efb8f6bdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:09.775835 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68238e-ce31-4bcc-b21a-0349fd1d354f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4496529ed1544b56b9b64f951b308869, user_id=497ade3d350c4f719b816567974857d1, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:09.779282 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68238e-ce31-4bcc-b21a-0349fd1d354f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:09.782110 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddcd47-412f-4d23-8c3a-5d4efb8f6bdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:09.783878 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddcd47-412f-4d23-8c3a-5d4efb8f6bdd service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:09.794890 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 916/1830] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:11:09.803665 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 915/1831] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:09 2021] PUT /identity/v3/projects/4496529ed1544b56b9b64f951b308869/users/497ade3d350c4f719b816567974857d1/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:09.808350 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddcd47-412f-4d23-8c3a-5d4efb8f6bdd service neutron] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:09.818747 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddcd47-412f-4d23-8c3a-5d4efb8f6bdd service neutron] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:09.877447 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4a0db-c2f5-496a-bd0e-cba4c03a33a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:09.878536 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4a0db-c2f5-496a-bd0e-cba4c03a33a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:09.878769 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4a0db-c2f5-496a-bd0e-cba4c03a33a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:09.879145 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4a0db-c2f5-496a-bd0e-cba4c03a33a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:09.879977 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4a0db-c2f5-496a-bd0e-cba4c03a33a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:09.881910 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4a0db-c2f5-496a-bd0e-cba4c03a33a0 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:09.897732 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 917/1832] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:09 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:09.899044 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68238e-ce31-4bcc-b21a-0349fd1d354f admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:09.909597 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68238e-ce31-4bcc-b21a-0349fd1d354f admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:09.914539 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21db7c-c058-4b1f-9cfc-eca713ef29c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:09.915431 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21db7c-c058-4b1f-9cfc-eca713ef29c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:09.915716 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21db7c-c058-4b1f-9cfc-eca713ef29c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:09.916148 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21db7c-c058-4b1f-9cfc-eca713ef29c6 admin admin] PATH_INFO: `/v3/projects/4496529ed1544b56b9b64f951b308869/users/497ade3d350c4f719b816567974857d1/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:09.918334 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21db7c-c058-4b1f-9cfc-eca713ef29c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4496529ed1544b56b9b64f951b308869, user_id=497ade3d350c4f719b816567974857d1, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:09.921120 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21db7c-c058-4b1f-9cfc-eca713ef29c6 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:09.933139 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 916/1833] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:09 2021] PUT /identity/v3/projects/4496529ed1544b56b9b64f951b308869/users/497ade3d350c4f719b816567974857d1/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:09.944516 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169a3e8-cafc-47ec-ab6a-58fc315d6589 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:09.944808 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169a3e8-cafc-47ec-ab6a-58fc315d6589 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:09.945130 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169a3e8-cafc-47ec-ab6a-58fc315d6589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:09.978136 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-0169a3e8-cafc-47ec-ab6a-58fc315d6589 None None] MFA Rules not processed for user `497ade3d350c4f719b816567974857d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:09.979311 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-0169a3e8-cafc-47ec-ab6a-58fc315d6589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:10.077533 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 918/1834] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:09 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:10.087152 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21db7c-c058-4b1f-9cfc-eca713ef29c6 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:10.089031 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-6d21db7c-c058-4b1f-9cfc-eca713ef29c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:10.126185 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169a3e8-cafc-47ec-ab6a-58fc315d6589 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:10.127792 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-0169a3e8-cafc-47ec-ab6a-58fc315d6589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:10.149743 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21db7c-c058-4b1f-9cfc-eca713ef29c6 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:10.153802 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2368e-c360-4269-90ee-571575219b81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:10.154487 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2368e-c360-4269-90ee-571575219b81 service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:10.154779 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2368e-c360-4269-90ee-571575219b81 service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:10.155063 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2368e-c360-4269-90ee-571575219b81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:10.156940 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-dad2368e-c360-4269-90ee-571575219b81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:10.204024 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169a3e8-cafc-47ec-ab6a-58fc315d6589 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:10.209083 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9381abf-0377-4c21-912b-5028c339e0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:10.210075 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9381abf-0377-4c21-912b-5028c339e0bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:10.210376 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9381abf-0377-4c21-912b-5028c339e0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:10.210737 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9381abf-0377-4c21-912b-5028c339e0bf admin admin] PATH_INFO: `/v3/projects/ecc53043b8e8417db1627282285f5bdb` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:10.212224 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9381abf-0377-4c21-912b-5028c339e0bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecc53043b8e8417db1627282285f5bdb)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:10.214040 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2368e-c360-4269-90ee-571575219b81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:10.214311 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9381abf-0377-4c21-912b-5028c339e0bf admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:10.215454 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2368e-c360-4269-90ee-571575219b81 service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:10.224535 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 917/1835] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:10 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:11:10.262243 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-c9381abf-0377-4c21-912b-5028c339e0bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecc53043b8e8417db1627282285f5bdb', 'request_id': 'req-c9381abf-0377-4c21-912b-5028c339e0bf'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:10.269730 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-c9381abf-0377-4c21-912b-5028c339e0bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecc53043b8e8417db1627282285f5bdb', 'request_id': 'req-c9381abf-0377-4c21-912b-5028c339e0bf'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:10.275659 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-c9381abf-0377-4c21-912b-5028c339e0bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecc53043b8e8417db1627282285f5bdb', 'request_id': 'req-c9381abf-0377-4c21-912b-5028c339e0bf'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:10.287022 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-c9381abf-0377-4c21-912b-5028c339e0bf admin admin] The token cache is being invalidate because project ecc53043b8e8417db1627282285f5bdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:10.287832 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-c9381abf-0377-4c21-912b-5028c339e0bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:10.288484 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-c9381abf-0377-4c21-912b-5028c339e0bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:10.290822 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 919/1836] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:10 2021] DELETE /identity/v3/projects/ecc53043b8e8417db1627282285f5bdb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:10.294738 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2368e-c360-4269-90ee-571575219b81 service cinder] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:10.304873 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2368e-c360-4269-90ee-571575219b81 service cinder] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:10.371605 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1564a2-f9f5-4aff-a43e-052ba1aed748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:10.372477 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1564a2-f9f5-4aff-a43e-052ba1aed748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:10.372766 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1564a2-f9f5-4aff-a43e-052ba1aed748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:10.373043 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1564a2-f9f5-4aff-a43e-052ba1aed748 admin admin] PATH_INFO: `/v3/users/0111ac49a7364f93836b19d51cc7dc71` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:10.374307 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1564a2-f9f5-4aff-a43e-052ba1aed748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0111ac49a7364f93836b19d51cc7dc71)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:10.376264 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1564a2-f9f5-4aff-a43e-052ba1aed748 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:10.422443 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4e1564a2-f9f5-4aff-a43e-052ba1aed748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0111ac49a7364f93836b19d51cc7dc71'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:10.423119 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4e1564a2-f9f5-4aff-a43e-052ba1aed748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0111ac49a7364f93836b19d51cc7dc71'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:10.423866 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4e1564a2-f9f5-4aff-a43e-052ba1aed748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0111ac49a7364f93836b19d51cc7dc71'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:10.437242 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4e1564a2-f9f5-4aff-a43e-052ba1aed748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0111ac49a7364f93836b19d51cc7dc71'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:10.445971 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4e1564a2-f9f5-4aff-a43e-052ba1aed748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0111ac49a7364f93836b19d51cc7dc71'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:10.459657 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 918/1837] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:10 2021] DELETE /identity/v3/users/0111ac49a7364f93836b19d51cc7dc71 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:10.735061 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9381abf-0377-4c21-912b-5028c339e0bf admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:10.736588 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-c9381abf-0377-4c21-912b-5028c339e0bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:10.754088 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9381abf-0377-4c21-912b-5028c339e0bf admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:10.812712 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f3013-60f2-467b-8180-8546732afeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:10.813789 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f3013-60f2-467b-8180-8546732afeae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:10.814089 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f3013-60f2-467b-8180-8546732afeae admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:10.814341 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f3013-60f2-467b-8180-8546732afeae admin admin] PATH_INFO: `/v3/projects/64a0ea03d21246e6b38026c23a2bf342` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:10.815514 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f3013-60f2-467b-8180-8546732afeae admin admin] RBAC: Authorizing `identity:delete_project(project_id=64a0ea03d21246e6b38026c23a2bf342)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:10.817422 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f3013-60f2-467b-8180-8546732afeae admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:10.863393 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5d1f3013-60f2-467b-8180-8546732afeae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64a0ea03d21246e6b38026c23a2bf342', 'request_id': 'req-5d1f3013-60f2-467b-8180-8546732afeae'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:10.870673 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5d1f3013-60f2-467b-8180-8546732afeae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64a0ea03d21246e6b38026c23a2bf342', 'request_id': 'req-5d1f3013-60f2-467b-8180-8546732afeae'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:10.876119 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5d1f3013-60f2-467b-8180-8546732afeae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64a0ea03d21246e6b38026c23a2bf342', 'request_id': 'req-5d1f3013-60f2-467b-8180-8546732afeae'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:10.887826 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5d1f3013-60f2-467b-8180-8546732afeae admin admin] The token cache is being invalidate because project 64a0ea03d21246e6b38026c23a2bf342 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:10.888108 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5d1f3013-60f2-467b-8180-8546732afeae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:10.888744 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5d1f3013-60f2-467b-8180-8546732afeae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:10.890320 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 920/1838] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:10 2021] DELETE /identity/v3/projects/64a0ea03d21246e6b38026c23a2bf342 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:10.897915 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96cc4a-49d7-4e08-af0c-2bb878113320 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:10.898204 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96cc4a-49d7-4e08-af0c-2bb878113320 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:10.898479 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96cc4a-49d7-4e08-af0c-2bb878113320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:10.919802 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-8c96cc4a-49d7-4e08-af0c-2bb878113320 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:10.921125 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-8c96cc4a-49d7-4e08-af0c-2bb878113320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:10.983981 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 919/1839] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:10.991694 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906fcd0-0bb2-4bef-ac52-b4daed08fa38 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:10.991910 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906fcd0-0bb2-4bef-ac52-b4daed08fa38 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:10.992209 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906fcd0-0bb2-4bef-ac52-b4daed08fa38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:11.017228 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-f906fcd0-0bb2-4bef-ac52-b4daed08fa38 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:11.018538 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-f906fcd0-0bb2-4bef-ac52-b4daed08fa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:11.026590 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 921/1840] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:11.030809 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96cc4a-49d7-4e08-af0c-2bb878113320 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:11.041248 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96cc4a-49d7-4e08-af0c-2bb878113320 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:11.046359 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039402aa-34d9-4311-988d-50e0d1dd38c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:11.047021 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039402aa-34d9-4311-988d-50e0d1dd38c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:11.047300 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039402aa-34d9-4311-988d-50e0d1dd38c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:11.047573 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039402aa-34d9-4311-988d-50e0d1dd38c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:11.048304 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039402aa-34d9-4311-988d-50e0d1dd38c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:11.048605 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039402aa-34d9-4311-988d-50e0d1dd38c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:11.050226 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039402aa-34d9-4311-988d-50e0d1dd38c7 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:11.064073 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 920/1841] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:11:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:11:11.068298 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906fcd0-0bb2-4bef-ac52-b4daed08fa38 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:11.077944 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906fcd0-0bb2-4bef-ac52-b4daed08fa38 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:11.082586 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80485c4-5498-4f32-9cc8-6efebac07ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:11.083230 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80485c4-5498-4f32-9cc8-6efebac07ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:11.083511 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80485c4-5498-4f32-9cc8-6efebac07ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:11.083784 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80485c4-5498-4f32-9cc8-6efebac07ac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:11.084482 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80485c4-5498-4f32-9cc8-6efebac07ac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:11.086621 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80485c4-5498-4f32-9cc8-6efebac07ac2 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:11.113281 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 922/1842] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:11 2021] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:11.117425 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039402aa-34d9-4311-988d-50e0d1dd38c7 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:11.128360 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039402aa-34d9-4311-988d-50e0d1dd38c7 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:11.183631 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e54f95-e1fb-42dc-82e3-70f079ac38fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:11.184307 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e54f95-e1fb-42dc-82e3-70f079ac38fa admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:11.184632 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e54f95-e1fb-42dc-82e3-70f079ac38fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:11.184851 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e54f95-e1fb-42dc-82e3-70f079ac38fa admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:11.185759 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e54f95-e1fb-42dc-82e3-70f079ac38fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:11.187673 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e54f95-e1fb-42dc-82e3-70f079ac38fa admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:11.207722 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 921/1843] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:11 2021] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:11:11.213129 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80485c4-5498-4f32-9cc8-6efebac07ac2 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:11.223302 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80485c4-5498-4f32-9cc8-6efebac07ac2 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:11.227956 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e39703-73bd-49df-901b-2633ba837b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:11.228616 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e39703-73bd-49df-901b-2633ba837b08 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:11.228899 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e39703-73bd-49df-901b-2633ba837b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:11.229172 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e39703-73bd-49df-901b-2633ba837b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:11.229935 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e39703-73bd-49df-901b-2633ba837b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:11.231545 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e39703-73bd-49df-901b-2633ba837b08 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:11.243722 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 923/1844] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:11 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:11.247942 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e54f95-e1fb-42dc-82e3-70f079ac38fa admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:11.257849 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e54f95-e1fb-42dc-82e3-70f079ac38fa admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:11.263045 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cb218-4a0f-446d-9275-72a37680db6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:11.263695 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cb218-4a0f-446d-9275-72a37680db6f admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:11.264014 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cb218-4a0f-446d-9275-72a37680db6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:11.264275 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cb218-4a0f-446d-9275-72a37680db6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:11.265008 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cb218-4a0f-446d-9275-72a37680db6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:11.266615 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cb218-4a0f-446d-9275-72a37680db6f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:11.276251 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 922/1845] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:11 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:11.280161 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e39703-73bd-49df-901b-2633ba837b08 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:11.290068 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e39703-73bd-49df-901b-2633ba837b08 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:11.294576 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961384a9-a301-4a83-abae-d297119bf6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:11.295435 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961384a9-a301-4a83-abae-d297119bf6af admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:11.295708 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961384a9-a301-4a83-abae-d297119bf6af admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:11.295971 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961384a9-a301-4a83-abae-d297119bf6af admin admin] PATH_INFO: `/v3/projects/5065267910ae454ca415751735b80de4/users/e7ac243874254172b29887c47d1c59c8/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:11.310785 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961384a9-a301-4a83-abae-d297119bf6af admin admin] RBAC: Authorizing `identity:create_grant(project_id=5065267910ae454ca415751735b80de4, user_id=e7ac243874254172b29887c47d1c59c8, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:11.313499 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961384a9-a301-4a83-abae-d297119bf6af admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:11.327396 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 924/1846] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:11 2021] PUT /identity/v3/projects/5065267910ae454ca415751735b80de4/users/e7ac243874254172b29887c47d1c59c8/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:11.337706 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ab2e6-b151-41e2-bb5a-5ad770c860b9 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:11.337957 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ab2e6-b151-41e2-bb5a-5ad770c860b9 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:11.338255 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ab2e6-b151-41e2-bb5a-5ad770c860b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:11.364010 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-bf8ab2e6-b151-41e2-bb5a-5ad770c860b9 None None] MFA Rules not processed for user `e7ac243874254172b29887c47d1c59c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:11.365196 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-bf8ab2e6-b151-41e2-bb5a-5ad770c860b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:11.426255 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 923/1847] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:11 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:11.431444 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961384a9-a301-4a83-abae-d297119bf6af admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:11.489798 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961384a9-a301-4a83-abae-d297119bf6af admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:11.494609 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51c8b7-160b-4dcc-8ace-b6eec71ea926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:11.495195 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51c8b7-160b-4dcc-8ace-b6eec71ea926 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:11.495477 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51c8b7-160b-4dcc-8ace-b6eec71ea926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:11.495750 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51c8b7-160b-4dcc-8ace-b6eec71ea926 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:11.496445 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51c8b7-160b-4dcc-8ace-b6eec71ea926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:11.498384 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51c8b7-160b-4dcc-8ace-b6eec71ea926 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:11.525613 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 925/1848] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:11 2021] POST /identity/v3/projects => generated 387 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:11.526988 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ab2e6-b151-41e2-bb5a-5ad770c860b9 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:11.537810 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ab2e6-b151-41e2-bb5a-5ad770c860b9 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:11.595873 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2fad4-0add-469c-bd3b-fa7ef24a566d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:11.596544 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2fad4-0add-469c-bd3b-fa7ef24a566d admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:11.596830 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2fad4-0add-469c-bd3b-fa7ef24a566d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:11.597105 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2fad4-0add-469c-bd3b-fa7ef24a566d admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:11.597873 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2fad4-0add-469c-bd3b-fa7ef24a566d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:11.599790 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2fad4-0add-469c-bd3b-fa7ef24a566d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:11.619411 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 924/1849] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:11 2021] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:11.623393 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51c8b7-160b-4dcc-8ace-b6eec71ea926 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:11.633333 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51c8b7-160b-4dcc-8ace-b6eec71ea926 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:11.638186 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8260397-df44-43b2-b62b-2559cafaeb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:11.638839 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8260397-df44-43b2-b62b-2559cafaeb7f admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:11.639121 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8260397-df44-43b2-b62b-2559cafaeb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:11.639394 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8260397-df44-43b2-b62b-2559cafaeb7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:11.640123 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8260397-df44-43b2-b62b-2559cafaeb7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:11.641761 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8260397-df44-43b2-b62b-2559cafaeb7f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:11.652567 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 926/1850] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:11 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:11.656830 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2fad4-0add-469c-bd3b-fa7ef24a566d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:11.667662 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2fad4-0add-469c-bd3b-fa7ef24a566d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:11.672362 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838671a-fc14-4fb6-be21-e2f173ec5d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:11.673234 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838671a-fc14-4fb6-be21-e2f173ec5d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:11.673548 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838671a-fc14-4fb6-be21-e2f173ec5d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:11.673822 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838671a-fc14-4fb6-be21-e2f173ec5d32 admin admin] PATH_INFO: `/v3/projects/8df51562f0b8479a8b0c70b1290f0fff/users/2e296a1d7442454a8bd71cb6f61a7970/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:11.688441 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838671a-fc14-4fb6-be21-e2f173ec5d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df51562f0b8479a8b0c70b1290f0fff, user_id=2e296a1d7442454a8bd71cb6f61a7970, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:11.691138 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838671a-fc14-4fb6-be21-e2f173ec5d32 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:11.703478 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 925/1851] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:11 2021] PUT /identity/v3/projects/8df51562f0b8479a8b0c70b1290f0fff/users/2e296a1d7442454a8bd71cb6f61a7970/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:11.707491 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8260397-df44-43b2-b62b-2559cafaeb7f admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:11.717298 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8260397-df44-43b2-b62b-2559cafaeb7f admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:11.771788 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cf4ae-4d22-4705-a3a1-3e5f2bce36a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:11.772434 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cf4ae-4d22-4705-a3a1-3e5f2bce36a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:11.772652 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cf4ae-4d22-4705-a3a1-3e5f2bce36a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:11.772934 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cf4ae-4d22-4705-a3a1-3e5f2bce36a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:11.773702 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cf4ae-4d22-4705-a3a1-3e5f2bce36a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:11.775767 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cf4ae-4d22-4705-a3a1-3e5f2bce36a7 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:11.785683 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 927/1852] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:11 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:11.790457 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838671a-fc14-4fb6-be21-e2f173ec5d32 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:11.800867 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838671a-fc14-4fb6-be21-e2f173ec5d32 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:11.806447 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ff09d-3e36-4899-90c1-beb6d4839b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:11.807333 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ff09d-3e36-4899-90c1-beb6d4839b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:11.807616 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ff09d-3e36-4899-90c1-beb6d4839b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:11.807894 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ff09d-3e36-4899-90c1-beb6d4839b09 admin admin] PATH_INFO: `/v3/projects/8df51562f0b8479a8b0c70b1290f0fff/users/2e296a1d7442454a8bd71cb6f61a7970/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:11.809945 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ff09d-3e36-4899-90c1-beb6d4839b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df51562f0b8479a8b0c70b1290f0fff, user_id=2e296a1d7442454a8bd71cb6f61a7970, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:11.812602 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ff09d-3e36-4899-90c1-beb6d4839b09 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:11.823409 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 926/1853] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:11 2021] PUT /identity/v3/projects/8df51562f0b8479a8b0c70b1290f0fff/users/2e296a1d7442454a8bd71cb6f61a7970/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:11.834317 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f115c-06ce-461d-b09d-cb23f48a7dd8 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:11.834610 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f115c-06ce-461d-b09d-cb23f48a7dd8 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:11.834893 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f115c-06ce-461d-b09d-cb23f48a7dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:11.862463 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-ea5f115c-06ce-461d-b09d-cb23f48a7dd8 None None] MFA Rules not processed for user `2e296a1d7442454a8bd71cb6f61a7970`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:11.863693 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-ea5f115c-06ce-461d-b09d-cb23f48a7dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:11.931838 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 928/1854] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:11 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:11.942302 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ff09d-3e36-4899-90c1-beb6d4839b09 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:11.944044 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-d13ff09d-3e36-4899-90c1-beb6d4839b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:12.004796 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ff09d-3e36-4899-90c1-beb6d4839b09 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:12.008972 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07efb7-6d8d-40dd-8ba0-dbf34d01f7a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:12.009636 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07efb7-6d8d-40dd-8ba0-dbf34d01f7a1 service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:12.009916 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07efb7-6d8d-40dd-8ba0-dbf34d01f7a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:12.010189 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07efb7-6d8d-40dd-8ba0-dbf34d01f7a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:12.018943 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07efb7-6d8d-40dd-8ba0-dbf34d01f7a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:12.020366 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07efb7-6d8d-40dd-8ba0-dbf34d01f7a1 service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:12.032098 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 927/1855] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:11 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:12.059430 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f115c-06ce-461d-b09d-cb23f48a7dd8 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:12.130039 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f115c-06ce-461d-b09d-cb23f48a7dd8 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:12.135288 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b01d32-7134-41e1-978a-6e89c22801e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:12.136187 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b01d32-7134-41e1-978a-6e89c22801e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:12.136474 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b01d32-7134-41e1-978a-6e89c22801e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:12.136737 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b01d32-7134-41e1-978a-6e89c22801e5 admin admin] PATH_INFO: `/v3/users/e7ac243874254172b29887c47d1c59c8` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:12.138290 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b01d32-7134-41e1-978a-6e89c22801e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ac243874254172b29887c47d1c59c8)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:12.140387 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b01d32-7134-41e1-978a-6e89c22801e5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:12.204918 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-77b01d32-7134-41e1-978a-6e89c22801e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ac243874254172b29887c47d1c59c8'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:12.205593 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-77b01d32-7134-41e1-978a-6e89c22801e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ac243874254172b29887c47d1c59c8'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:12.212818 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-77b01d32-7134-41e1-978a-6e89c22801e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ac243874254172b29887c47d1c59c8'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:12.213503 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-77b01d32-7134-41e1-978a-6e89c22801e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ac243874254172b29887c47d1c59c8'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:12.225414 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-77b01d32-7134-41e1-978a-6e89c22801e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ac243874254172b29887c47d1c59c8'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:12.240220 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 929/1856] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:12 2021] DELETE /identity/v3/users/e7ac243874254172b29887c47d1c59c8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:12.245446 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7794b-202a-4c27-9fb8-f8c4cc8fb52a None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:12.245743 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7794b-202a-4c27-9fb8-f8c4cc8fb52a None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:12.246018 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7794b-202a-4c27-9fb8-f8c4cc8fb52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:12.264278 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-27d7794b-202a-4c27-9fb8-f8c4cc8fb52a None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:12.266110 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-27d7794b-202a-4c27-9fb8-f8c4cc8fb52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:12.336582 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 928/1857] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:11:12.344680 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b01d32-7134-41e1-978a-6e89c22801e5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:12.346353 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-77b01d32-7134-41e1-978a-6e89c22801e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:12.411957 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b01d32-7134-41e1-978a-6e89c22801e5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:12.416567 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb51477-839d-49d5-b2ea-5aaa18e0ddd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:12.417228 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb51477-839d-49d5-b2ea-5aaa18e0ddd5 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:12.417697 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb51477-839d-49d5-b2ea-5aaa18e0ddd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:12.418046 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb51477-839d-49d5-b2ea-5aaa18e0ddd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:12.427501 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb51477-839d-49d5-b2ea-5aaa18e0ddd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:12.428940 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb51477-839d-49d5-b2ea-5aaa18e0ddd5 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:12.439631 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 930/1858] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:12.704286 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7794b-202a-4c27-9fb8-f8c4cc8fb52a None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:12.705755 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-27d7794b-202a-4c27-9fb8-f8c4cc8fb52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:12.719363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7794b-202a-4c27-9fb8-f8c4cc8fb52a None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:12.723898 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e9d5c-b1e2-4165-bc41-ef11fee6958e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:12.724744 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e9d5c-b1e2-4165-bc41-ef11fee6958e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:12.725470 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e9d5c-b1e2-4165-bc41-ef11fee6958e admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:12.725757 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e9d5c-b1e2-4165-bc41-ef11fee6958e admin admin] PATH_INFO: `/v3/projects/5065267910ae454ca415751735b80de4` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:12.727992 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e9d5c-b1e2-4165-bc41-ef11fee6958e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5065267910ae454ca415751735b80de4)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:12.729794 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e9d5c-b1e2-4165-bc41-ef11fee6958e admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:12.775672 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-502e9d5c-b1e2-4165-bc41-ef11fee6958e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5065267910ae454ca415751735b80de4', 'request_id': 'req-502e9d5c-b1e2-4165-bc41-ef11fee6958e'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:12.782619 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-502e9d5c-b1e2-4165-bc41-ef11fee6958e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5065267910ae454ca415751735b80de4', 'request_id': 'req-502e9d5c-b1e2-4165-bc41-ef11fee6958e'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:12.788186 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-502e9d5c-b1e2-4165-bc41-ef11fee6958e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5065267910ae454ca415751735b80de4', 'request_id': 'req-502e9d5c-b1e2-4165-bc41-ef11fee6958e'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:12.799701 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-502e9d5c-b1e2-4165-bc41-ef11fee6958e admin admin] The token cache is being invalidate because project 5065267910ae454ca415751735b80de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:12.799983 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-502e9d5c-b1e2-4165-bc41-ef11fee6958e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:12.800607 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-502e9d5c-b1e2-4165-bc41-ef11fee6958e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:12.802150 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 929/1859] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:12 2021] DELETE /identity/v3/projects/5065267910ae454ca415751735b80de4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:12.806875 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb51477-839d-49d5-b2ea-5aaa18e0ddd5 service neutron] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:12.816444 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb51477-839d-49d5-b2ea-5aaa18e0ddd5 service neutron] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:12.871734 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186aa3b7-d9fb-44d2-a4e6-c53158cd696b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:12.872528 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186aa3b7-d9fb-44d2-a4e6-c53158cd696b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:12.872815 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186aa3b7-d9fb-44d2-a4e6-c53158cd696b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:12.873090 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186aa3b7-d9fb-44d2-a4e6-c53158cd696b admin admin] PATH_INFO: `/v3/users/2e296a1d7442454a8bd71cb6f61a7970` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:12.874387 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186aa3b7-d9fb-44d2-a4e6-c53158cd696b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e296a1d7442454a8bd71cb6f61a7970)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:12.876378 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186aa3b7-d9fb-44d2-a4e6-c53158cd696b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:12.922911 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-186aa3b7-d9fb-44d2-a4e6-c53158cd696b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e296a1d7442454a8bd71cb6f61a7970'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:12.923633 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-186aa3b7-d9fb-44d2-a4e6-c53158cd696b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e296a1d7442454a8bd71cb6f61a7970'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:12.931480 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-186aa3b7-d9fb-44d2-a4e6-c53158cd696b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e296a1d7442454a8bd71cb6f61a7970'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:12.932123 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-186aa3b7-d9fb-44d2-a4e6-c53158cd696b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e296a1d7442454a8bd71cb6f61a7970'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:12.943376 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-186aa3b7-d9fb-44d2-a4e6-c53158cd696b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e296a1d7442454a8bd71cb6f61a7970'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:12.957093 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 931/1860] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:12 2021] DELETE /identity/v3/users/2e296a1d7442454a8bd71cb6f61a7970 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:13.236946 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e9d5c-b1e2-4165-bc41-ef11fee6958e admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:13.238317 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-502e9d5c-b1e2-4165-bc41-ef11fee6958e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:13.250856 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e9d5c-b1e2-4165-bc41-ef11fee6958e admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:13.316616 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af65208-d820-42af-afdd-752c23119bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:13.317509 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af65208-d820-42af-afdd-752c23119bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:13.317795 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af65208-d820-42af-afdd-752c23119bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:13.318071 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af65208-d820-42af-afdd-752c23119bcd admin admin] PATH_INFO: `/v3/projects/8df51562f0b8479a8b0c70b1290f0fff` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:13.319274 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af65208-d820-42af-afdd-752c23119bcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df51562f0b8479a8b0c70b1290f0fff)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:13.321762 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af65208-d820-42af-afdd-752c23119bcd admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:13.367306 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-7af65208-d820-42af-afdd-752c23119bcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df51562f0b8479a8b0c70b1290f0fff', 'request_id': 'req-7af65208-d820-42af-afdd-752c23119bcd'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:13.374824 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-7af65208-d820-42af-afdd-752c23119bcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df51562f0b8479a8b0c70b1290f0fff', 'request_id': 'req-7af65208-d820-42af-afdd-752c23119bcd'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:13.380209 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-7af65208-d820-42af-afdd-752c23119bcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df51562f0b8479a8b0c70b1290f0fff', 'request_id': 'req-7af65208-d820-42af-afdd-752c23119bcd'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:13.390856 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-7af65208-d820-42af-afdd-752c23119bcd admin admin] The token cache is being invalidate because project 8df51562f0b8479a8b0c70b1290f0fff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:13.391143 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-7af65208-d820-42af-afdd-752c23119bcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:13.391775 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-7af65208-d820-42af-afdd-752c23119bcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:13.393288 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 930/1861] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:13 2021] DELETE /identity/v3/projects/8df51562f0b8479a8b0c70b1290f0fff => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:13.399212 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbab331-be51-4348-aed6-42ed1b16a758 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:13.399713 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbab331-be51-4348-aed6-42ed1b16a758 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:13.400063 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbab331-be51-4348-aed6-42ed1b16a758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:13.419936 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af65208-d820-42af-afdd-752c23119bcd admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:13.420626 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-2cbab331-be51-4348-aed6-42ed1b16a758 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:13.421299 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-7af65208-d820-42af-afdd-752c23119bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:13.421835 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-2cbab331-be51-4348-aed6-42ed1b16a758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:13.489416 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af65208-d820-42af-afdd-752c23119bcd admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:13.493588 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad7806-8cb5-4c49-ac75-1388a7051765 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:13.494243 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad7806-8cb5-4c49-ac75-1388a7051765 service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:13.494522 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad7806-8cb5-4c49-ac75-1388a7051765 service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:13.494895 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad7806-8cb5-4c49-ac75-1388a7051765 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:13.496907 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-1fad7806-8cb5-4c49-ac75-1388a7051765 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:13.518680 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 932/1862] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:13.527845 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5096217-9087-45e9-87b4-d4a11f50a18d None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:13.528205 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5096217-9087-45e9-87b4-d4a11f50a18d None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:13.528634 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5096217-9087-45e9-87b4-d4a11f50a18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:13.550704 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-e5096217-9087-45e9-87b4-d4a11f50a18d None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:13.552213 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-e5096217-9087-45e9-87b4-d4a11f50a18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:13.564871 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 933/1863] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:13.565919 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5096217-9087-45e9-87b4-d4a11f50a18d None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:13.576043 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5096217-9087-45e9-87b4-d4a11f50a18d None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:13.579130 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad7806-8cb5-4c49-ac75-1388a7051765 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:13.581258 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad7806-8cb5-4c49-ac75-1388a7051765 service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:13.582288 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e139511-ce79-4cab-9b00-c83118e98896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:13.583022 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e139511-ce79-4cab-9b00-c83118e98896 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:13.584034 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e139511-ce79-4cab-9b00-c83118e98896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:13.584393 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e139511-ce79-4cab-9b00-c83118e98896 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:13.585376 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e139511-ce79-4cab-9b00-c83118e98896 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:13.585719 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e139511-ce79-4cab-9b00-c83118e98896 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:13.589006 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e139511-ce79-4cab-9b00-c83118e98896 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:13.604379 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 934/1864] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:11:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:13.606871 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e139511-ce79-4cab-9b00-c83118e98896 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:13.607443 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 931/1865] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:13 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:11:13.618060 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e139511-ce79-4cab-9b00-c83118e98896 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:13.623963 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55eb0b6-95fb-4d30-8ce0-06bd710f5829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:13.624746 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55eb0b6-95fb-4d30-8ce0-06bd710f5829 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:13.625133 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55eb0b6-95fb-4d30-8ce0-06bd710f5829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:13.625555 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55eb0b6-95fb-4d30-8ce0-06bd710f5829 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:13.626378 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55eb0b6-95fb-4d30-8ce0-06bd710f5829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:13.628377 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55eb0b6-95fb-4d30-8ce0-06bd710f5829 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:13.660057 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 935/1866] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:13 2021] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:11:13.662385 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad7806-8cb5-4c49-ac75-1388a7051765 service cinder] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:13.674466 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad7806-8cb5-4c49-ac75-1388a7051765 service cinder] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:13.744249 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7138e-02cb-42f4-9921-99660826cd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:13.745853 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7138e-02cb-42f4-9921-99660826cd28 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:13.746148 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7138e-02cb-42f4-9921-99660826cd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:13.746458 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7138e-02cb-42f4-9921-99660826cd28 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:13.747333 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7138e-02cb-42f4-9921-99660826cd28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:13.749755 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7138e-02cb-42f4-9921-99660826cd28 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:13.778866 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 932/1867] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:13 2021] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:13.780057 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55eb0b6-95fb-4d30-8ce0-06bd710f5829 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:13.791751 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55eb0b6-95fb-4d30-8ce0-06bd710f5829 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:13.796864 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec5644-21ac-4f4d-816c-d13a288b4d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:13.797644 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec5644-21ac-4f4d-816c-d13a288b4d7b admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:13.798223 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec5644-21ac-4f4d-816c-d13a288b4d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:13.798585 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec5644-21ac-4f4d-816c-d13a288b4d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:13.799677 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec5644-21ac-4f4d-816c-d13a288b4d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:13.801429 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec5644-21ac-4f4d-816c-d13a288b4d7b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:13.813913 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 936/1868] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:13 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:13.817747 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7138e-02cb-42f4-9921-99660826cd28 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:13.829358 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7138e-02cb-42f4-9921-99660826cd28 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:13.834333 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6693ea3-ef2b-4696-87be-ef2661ceccba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:13.835024 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6693ea3-ef2b-4696-87be-ef2661ceccba admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:13.835355 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6693ea3-ef2b-4696-87be-ef2661ceccba admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:13.835632 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6693ea3-ef2b-4696-87be-ef2661ceccba admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:13.836485 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6693ea3-ef2b-4696-87be-ef2661ceccba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:13.838202 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6693ea3-ef2b-4696-87be-ef2661ceccba admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:13.848754 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 933/1869] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:13 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:13.853761 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec5644-21ac-4f4d-816c-d13a288b4d7b admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:13.864833 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec5644-21ac-4f4d-816c-d13a288b4d7b admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:13.869953 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeca9ff-30ff-4f01-90cf-a9a8c1ea1d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:13.870890 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeca9ff-30ff-4f01-90cf-a9a8c1ea1d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:13.871172 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeca9ff-30ff-4f01-90cf-a9a8c1ea1d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:13.871446 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeca9ff-30ff-4f01-90cf-a9a8c1ea1d03 admin admin] PATH_INFO: `/v3/projects/a88c21fd0a924b1788d711a323172fd6/users/66b3b824d2104863820747f90369af0d/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:13.888737 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeca9ff-30ff-4f01-90cf-a9a8c1ea1d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a88c21fd0a924b1788d711a323172fd6, user_id=66b3b824d2104863820747f90369af0d, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:13.892961 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeca9ff-30ff-4f01-90cf-a9a8c1ea1d03 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:13.909879 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 937/1870] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:13 2021] PUT /identity/v3/projects/a88c21fd0a924b1788d711a323172fd6/users/66b3b824d2104863820747f90369af0d/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:11:13.920747 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2d84e-2499-4a45-bb45-d3f3c1b03b87 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:13.921220 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2d84e-2499-4a45-bb45-d3f3c1b03b87 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:13.921691 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2d84e-2499-4a45-bb45-d3f3c1b03b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:13.963930 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-92b2d84e-2499-4a45-bb45-d3f3c1b03b87 None None] MFA Rules not processed for user `66b3b824d2104863820747f90369af0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:13.965347 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-92b2d84e-2499-4a45-bb45-d3f3c1b03b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:14.047588 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 934/1871] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:13 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:14.052494 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeca9ff-30ff-4f01-90cf-a9a8c1ea1d03 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:14.123336 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeca9ff-30ff-4f01-90cf-a9a8c1ea1d03 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:14.128919 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efff5b-9759-4443-83bb-f471c0cba7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:14.130132 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efff5b-9759-4443-83bb-f471c0cba7c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:14.130627 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efff5b-9759-4443-83bb-f471c0cba7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:14.131051 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efff5b-9759-4443-83bb-f471c0cba7c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:14.131868 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2efff5b-9759-4443-83bb-f471c0cba7c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:14.134522 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2efff5b-9759-4443-83bb-f471c0cba7c4 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:14.174137 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 938/1872] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:14 2021] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:14.179586 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2d84e-2499-4a45-bb45-d3f3c1b03b87 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:14.191241 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2d84e-2499-4a45-bb45-d3f3c1b03b87 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:14.258011 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb8932-074b-48ea-aaf9-06bbe08054e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:14.259289 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb8932-074b-48ea-aaf9-06bbe08054e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:14.259566 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb8932-074b-48ea-aaf9-06bbe08054e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:14.259835 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb8932-074b-48ea-aaf9-06bbe08054e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:14.260545 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb8932-074b-48ea-aaf9-06bbe08054e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:14.262530 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb8932-074b-48ea-aaf9-06bbe08054e8 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:14.285233 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 935/1873] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:14 2021] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:11:14.290796 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efff5b-9759-4443-83bb-f471c0cba7c4 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:14.303090 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efff5b-9759-4443-83bb-f471c0cba7c4 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:14.309364 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc87e40-95e4-44ac-881f-7095bb113b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:14.310333 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc87e40-95e4-44ac-881f-7095bb113b3c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:14.310772 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc87e40-95e4-44ac-881f-7095bb113b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:14.311049 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc87e40-95e4-44ac-881f-7095bb113b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:14.312386 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc87e40-95e4-44ac-881f-7095bb113b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:14.315287 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc87e40-95e4-44ac-881f-7095bb113b3c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:14.331910 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 939/1874] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:14 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:14.336341 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb8932-074b-48ea-aaf9-06bbe08054e8 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:14.346476 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb8932-074b-48ea-aaf9-06bbe08054e8 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:14.351412 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e0d29-1ca0-4467-9e86-e41faba715f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:14.352345 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e0d29-1ca0-4467-9e86-e41faba715f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:14.352624 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e0d29-1ca0-4467-9e86-e41faba715f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:14.352897 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e0d29-1ca0-4467-9e86-e41faba715f4 admin admin] PATH_INFO: `/v3/projects/92e89b1fecfb4883b450879ce1294dc2/users/a09a5b9642344a9ca935b2ced30c3637/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:14.369061 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e0d29-1ca0-4467-9e86-e41faba715f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92e89b1fecfb4883b450879ce1294dc2, user_id=a09a5b9642344a9ca935b2ced30c3637, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:14.371751 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e0d29-1ca0-4467-9e86-e41faba715f4 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:14.385837 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 936/1875] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:14 2021] PUT /identity/v3/projects/92e89b1fecfb4883b450879ce1294dc2/users/a09a5b9642344a9ca935b2ced30c3637/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:14.389625 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc87e40-95e4-44ac-881f-7095bb113b3c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:14.402963 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc87e40-95e4-44ac-881f-7095bb113b3c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:14.462032 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c62d8e-38b3-4992-9854-ba6e88cf4af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:14.462705 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c62d8e-38b3-4992-9854-ba6e88cf4af3 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:14.462984 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c62d8e-38b3-4992-9854-ba6e88cf4af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:14.463254 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c62d8e-38b3-4992-9854-ba6e88cf4af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:14.463989 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c62d8e-38b3-4992-9854-ba6e88cf4af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:14.465615 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c62d8e-38b3-4992-9854-ba6e88cf4af3 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:14.476351 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 940/1876] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:14 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:11:14.481054 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e0d29-1ca0-4467-9e86-e41faba715f4 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:14.491416 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e0d29-1ca0-4467-9e86-e41faba715f4 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:14.496819 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf75621-1705-4a47-a545-e852c7407e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:14.497732 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf75621-1705-4a47-a545-e852c7407e16 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:14.498009 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf75621-1705-4a47-a545-e852c7407e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:14.498281 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf75621-1705-4a47-a545-e852c7407e16 admin admin] PATH_INFO: `/v3/projects/92e89b1fecfb4883b450879ce1294dc2/users/a09a5b9642344a9ca935b2ced30c3637/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:14.500262 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf75621-1705-4a47-a545-e852c7407e16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92e89b1fecfb4883b450879ce1294dc2, user_id=a09a5b9642344a9ca935b2ced30c3637, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:14.502940 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf75621-1705-4a47-a545-e852c7407e16 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:14.514875 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 937/1877] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:14 2021] PUT /identity/v3/projects/92e89b1fecfb4883b450879ce1294dc2/users/a09a5b9642344a9ca935b2ced30c3637/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:14.528099 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b4901-0ad2-4774-9493-0daad85b873c None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:14.528576 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b4901-0ad2-4774-9493-0daad85b873c None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:14.529051 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b4901-0ad2-4774-9493-0daad85b873c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:14.564397 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-c05b4901-0ad2-4774-9493-0daad85b873c None None] MFA Rules not processed for user `a09a5b9642344a9ca935b2ced30c3637`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:14.565797 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-c05b4901-0ad2-4774-9493-0daad85b873c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:14.645094 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 941/1878] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:14 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:11:14.655498 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf75621-1705-4a47-a545-e852c7407e16 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:14.725626 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf75621-1705-4a47-a545-e852c7407e16 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:14.731821 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1619a-8348-465e-859e-e51ee9f2728a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:14.732484 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1619a-8348-465e-859e-e51ee9f2728a service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:14.733686 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1619a-8348-465e-859e-e51ee9f2728a service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:14.733686 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1619a-8348-465e-859e-e51ee9f2728a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:14.747375 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1619a-8348-465e-859e-e51ee9f2728a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:14.754732 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1619a-8348-465e-859e-e51ee9f2728a service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:14.785722 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 938/1879] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:14 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:14.875360 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b4901-0ad2-4774-9493-0daad85b873c None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:14.884650 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b4901-0ad2-4774-9493-0daad85b873c None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:14.888262 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f4a97-5ffe-4e39-b507-f08f06e3011c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:14.888897 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f4a97-5ffe-4e39-b507-f08f06e3011c service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:14.889182 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f4a97-5ffe-4e39-b507-f08f06e3011c service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:14.889484 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f4a97-5ffe-4e39-b507-f08f06e3011c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:14.943568 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f4a97-5ffe-4e39-b507-f08f06e3011c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:14.944926 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f4a97-5ffe-4e39-b507-f08f06e3011c service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:14.953865 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 942/1880] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:14 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:15.019899 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1619a-8348-465e-859e-e51ee9f2728a service cinder] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:15.021439 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-97e1619a-8348-465e-859e-e51ee9f2728a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:15.089125 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1619a-8348-465e-859e-e51ee9f2728a service cinder] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:15.094616 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c52631-ee2e-4b3e-ae84-3a58dbc22b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:15.095523 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c52631-ee2e-4b3e-ae84-3a58dbc22b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:15.095806 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c52631-ee2e-4b3e-ae84-3a58dbc22b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:15.096084 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c52631-ee2e-4b3e-ae84-3a58dbc22b7f admin admin] PATH_INFO: `/v3/users/8bf6e9d8757d4794b0e3df1ed362043c` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:15.097430 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c52631-ee2e-4b3e-ae84-3a58dbc22b7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bf6e9d8757d4794b0e3df1ed362043c)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:15.099709 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c52631-ee2e-4b3e-ae84-3a58dbc22b7f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:15.146977 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-69c52631-ee2e-4b3e-ae84-3a58dbc22b7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bf6e9d8757d4794b0e3df1ed362043c'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:15.147697 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-69c52631-ee2e-4b3e-ae84-3a58dbc22b7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bf6e9d8757d4794b0e3df1ed362043c'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:15.148448 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-69c52631-ee2e-4b3e-ae84-3a58dbc22b7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bf6e9d8757d4794b0e3df1ed362043c'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:15.169073 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-69c52631-ee2e-4b3e-ae84-3a58dbc22b7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bf6e9d8757d4794b0e3df1ed362043c'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:15.179224 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-69c52631-ee2e-4b3e-ae84-3a58dbc22b7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bf6e9d8757d4794b0e3df1ed362043c'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:15.197201 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 939/1881] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:15 2021] DELETE /identity/v3/users/8bf6e9d8757d4794b0e3df1ed362043c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:15.202965 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171ed40-d120-48a0-b304-c775dea62e85 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:15.203468 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171ed40-d120-48a0-b304-c775dea62e85 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:15.203608 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171ed40-d120-48a0-b304-c775dea62e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:15.232814 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-5171ed40-d120-48a0-b304-c775dea62e85 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:15.232814 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-5171ed40-d120-48a0-b304-c775dea62e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:15.309005 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 943/1882] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:15.318881 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c52631-ee2e-4b3e-ae84-3a58dbc22b7f admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:15.320382 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-69c52631-ee2e-4b3e-ae84-3a58dbc22b7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:15.385121 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c52631-ee2e-4b3e-ae84-3a58dbc22b7f admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:15.389048 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93961b-db03-4f4b-b82f-b13abac496cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:15.389840 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93961b-db03-4f4b-b82f-b13abac496cf service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:15.390259 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93961b-db03-4f4b-b82f-b13abac496cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:15.390652 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93961b-db03-4f4b-b82f-b13abac496cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:15.402538 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93961b-db03-4f4b-b82f-b13abac496cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:15.404127 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93961b-db03-4f4b-b82f-b13abac496cf service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:15.415085 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 940/1883] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:15.697190 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbb493-b888-4de2-83b7-2eeee0c4f332 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:15.697559 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbb493-b888-4de2-83b7-2eeee0c4f332 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:15.697939 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbb493-b888-4de2-83b7-2eeee0c4f332 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:15.700695 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 944/1884] 10.222.0.36 () {54 vars in 921 bytes} [Wed Dec 15 16:11:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:11:15.716658 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c8368-f630-4915-89df-464cc70f1237 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:15.716958 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c8368-f630-4915-89df-464cc70f1237 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:15.717227 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c8368-f630-4915-89df-464cc70f1237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:15.720429 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbb493-b888-4de2-83b7-2eeee0c4f332 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:15.722861 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-7dfbb493-b888-4de2-83b7-2eeee0c4f332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:15.747012 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-964c8368-f630-4915-89df-464cc70f1237 None None] MFA Rules not processed for user `bc13934328e742f9a1a85d1c84ab83dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:15.748248 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-964c8368-f630-4915-89df-464cc70f1237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:15.752804 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbb493-b888-4de2-83b7-2eeee0c4f332 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:15.758561 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d6f8a-f417-48c6-92cc-531539fbec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:15.760205 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d6f8a-f417-48c6-92cc-531539fbec7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:15.760551 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d6f8a-f417-48c6-92cc-531539fbec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:15.760894 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d6f8a-f417-48c6-92cc-531539fbec7d admin admin] PATH_INFO: `/v3/projects/b82d06d1c4f84b8baa79ed95d3d0283b` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:15.762771 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d6f8a-f417-48c6-92cc-531539fbec7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b82d06d1c4f84b8baa79ed95d3d0283b)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:15.765193 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d6f8a-f417-48c6-92cc-531539fbec7d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:15.818334 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 941/1885] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Dec 15 16:11:15 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:15.819686 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-ab3d6f8a-f417-48c6-92cc-531539fbec7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b82d06d1c4f84b8baa79ed95d3d0283b', 'request_id': 'req-ab3d6f8a-f417-48c6-92cc-531539fbec7d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:15.831405 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-ab3d6f8a-f417-48c6-92cc-531539fbec7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b82d06d1c4f84b8baa79ed95d3d0283b', 'request_id': 'req-ab3d6f8a-f417-48c6-92cc-531539fbec7d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:15.845727 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-ab3d6f8a-f417-48c6-92cc-531539fbec7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b82d06d1c4f84b8baa79ed95d3d0283b', 'request_id': 'req-ab3d6f8a-f417-48c6-92cc-531539fbec7d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:15.872251 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-ab3d6f8a-f417-48c6-92cc-531539fbec7d admin admin] The token cache is being invalidate because project b82d06d1c4f84b8baa79ed95d3d0283b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:15.872556 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-ab3d6f8a-f417-48c6-92cc-531539fbec7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:15.873576 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-ab3d6f8a-f417-48c6-92cc-531539fbec7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:15.878122 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 945/1886] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:15 2021] DELETE /identity/v3/projects/b82d06d1c4f84b8baa79ed95d3d0283b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:15.879872 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c8368-f630-4915-89df-464cc70f1237 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:15.893327 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c8368-f630-4915-89df-464cc70f1237 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:15.972828 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae23af-bfcb-4fe6-9990-3c37bf26fe4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:15.973788 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae23af-bfcb-4fe6-9990-3c37bf26fe4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:15.974322 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae23af-bfcb-4fe6-9990-3c37bf26fe4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:15.974322 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae23af-bfcb-4fe6-9990-3c37bf26fe4e admin admin] PATH_INFO: `/v3/users/497ade3d350c4f719b816567974857d1` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:15.975767 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae23af-bfcb-4fe6-9990-3c37bf26fe4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=497ade3d350c4f719b816567974857d1)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:15.978122 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae23af-bfcb-4fe6-9990-3c37bf26fe4e admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:16.031469 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d6f8a-f417-48c6-92cc-531539fbec7d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:16.033616 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-ab3d6f8a-f417-48c6-92cc-531539fbec7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:16.053415 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-9aae23af-bfcb-4fe6-9990-3c37bf26fe4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '497ade3d350c4f719b816567974857d1'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:16.056356 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-9aae23af-bfcb-4fe6-9990-3c37bf26fe4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '497ade3d350c4f719b816567974857d1'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:16.056356 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-9aae23af-bfcb-4fe6-9990-3c37bf26fe4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '497ade3d350c4f719b816567974857d1'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:16.069800 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-9aae23af-bfcb-4fe6-9990-3c37bf26fe4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '497ade3d350c4f719b816567974857d1'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:16.100365 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-9aae23af-bfcb-4fe6-9990-3c37bf26fe4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '497ade3d350c4f719b816567974857d1'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:16.116859 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d6f8a-f417-48c6-92cc-531539fbec7d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:16.117733 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 942/1887] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:15 2021] DELETE /identity/v3/users/497ade3d350c4f719b816567974857d1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:11:16.196194 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e165d39-2295-48b8-995f-1041a993dcd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:16.196993 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e165d39-2295-48b8-995f-1041a993dcd2 service nova] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:16.197277 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e165d39-2295-48b8-995f-1041a993dcd2 service nova] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:16.197581 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e165d39-2295-48b8-995f-1041a993dcd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:16.199554 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-0e165d39-2295-48b8-995f-1041a993dcd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:16.214584 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e165d39-2295-48b8-995f-1041a993dcd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:16.216386 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e165d39-2295-48b8-995f-1041a993dcd2 service nova] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:16.229951 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 946/1888] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:16 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:16.406269 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae23af-bfcb-4fe6-9990-3c37bf26fe4e admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:16.408538 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-9aae23af-bfcb-4fe6-9990-3c37bf26fe4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:16.473838 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae23af-bfcb-4fe6-9990-3c37bf26fe4e admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:16.478960 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7f8db-1e52-4629-adbb-dde7a9ec76c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:16.479803 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7f8db-1e52-4629-adbb-dde7a9ec76c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:16.480079 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7f8db-1e52-4629-adbb-dde7a9ec76c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:16.480350 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7f8db-1e52-4629-adbb-dde7a9ec76c9 admin admin] PATH_INFO: `/v3/projects/4496529ed1544b56b9b64f951b308869` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:16.481573 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7f8db-1e52-4629-adbb-dde7a9ec76c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4496529ed1544b56b9b64f951b308869)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:16.483481 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7f8db-1e52-4629-adbb-dde7a9ec76c9 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:16.528372 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-23a7f8db-1e52-4629-adbb-dde7a9ec76c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4496529ed1544b56b9b64f951b308869', 'request_id': 'req-23a7f8db-1e52-4629-adbb-dde7a9ec76c9'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:16.535825 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-23a7f8db-1e52-4629-adbb-dde7a9ec76c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4496529ed1544b56b9b64f951b308869', 'request_id': 'req-23a7f8db-1e52-4629-adbb-dde7a9ec76c9'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:16.541031 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-23a7f8db-1e52-4629-adbb-dde7a9ec76c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4496529ed1544b56b9b64f951b308869', 'request_id': 'req-23a7f8db-1e52-4629-adbb-dde7a9ec76c9'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:16.552377 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-23a7f8db-1e52-4629-adbb-dde7a9ec76c9 admin admin] The token cache is being invalidate because project 4496529ed1544b56b9b64f951b308869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:16.552663 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-23a7f8db-1e52-4629-adbb-dde7a9ec76c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:16.553303 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-23a7f8db-1e52-4629-adbb-dde7a9ec76c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:16.554868 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 943/1889] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:16 2021] DELETE /identity/v3/projects/4496529ed1544b56b9b64f951b308869 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:16.561197 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4b65e-9843-43c5-94c9-f855e126da8c None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:16.561516 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4b65e-9843-43c5-94c9-f855e126da8c None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:16.561795 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4b65e-9843-43c5-94c9-f855e126da8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:16.579631 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-14e4b65e-9843-43c5-94c9-f855e126da8c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:16.580831 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-14e4b65e-9843-43c5-94c9-f855e126da8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:16.639378 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 947/1890] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:16.647311 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216a312-c0d9-4757-b34a-e430ae9c1776 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:16.647602 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216a312-c0d9-4757-b34a-e430ae9c1776 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:16.647880 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216a312-c0d9-4757-b34a-e430ae9c1776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:16.666551 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-8216a312-c0d9-4757-b34a-e430ae9c1776 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:16.667826 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-8216a312-c0d9-4757-b34a-e430ae9c1776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:16.676286 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 944/1891] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:16.680923 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4b65e-9843-43c5-94c9-f855e126da8c None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:16.690657 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4b65e-9843-43c5-94c9-f855e126da8c None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:16.695244 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c0175-1255-4a54-8842-150091257735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:16.696482 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c0175-1255-4a54-8842-150091257735 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:16.696766 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c0175-1255-4a54-8842-150091257735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:16.697042 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c0175-1255-4a54-8842-150091257735 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:16.697840 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c0175-1255-4a54-8842-150091257735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:16.698151 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c0175-1255-4a54-8842-150091257735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:16.699761 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c0175-1255-4a54-8842-150091257735 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:16.711271 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 948/1892] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:11:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:16.715633 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216a312-c0d9-4757-b34a-e430ae9c1776 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:16.724599 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216a312-c0d9-4757-b34a-e430ae9c1776 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:16.729442 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade13f8c-eacd-4f14-9882-7d5268a2b281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:16.730082 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade13f8c-eacd-4f14-9882-7d5268a2b281 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:16.730360 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade13f8c-eacd-4f14-9882-7d5268a2b281 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:16.730628 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade13f8c-eacd-4f14-9882-7d5268a2b281 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:16.731331 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade13f8c-eacd-4f14-9882-7d5268a2b281 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:16.733209 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade13f8c-eacd-4f14-9882-7d5268a2b281 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:16.759551 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 945/1893] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:16 2021] POST /identity/v3/projects => generated 397 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:16.763826 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c0175-1255-4a54-8842-150091257735 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:16.774049 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c0175-1255-4a54-8842-150091257735 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:16.833649 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce03bd-87c7-4bd8-9abc-257f6b9533f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:16.834323 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce03bd-87c7-4bd8-9abc-257f6b9533f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:16.834604 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce03bd-87c7-4bd8-9abc-257f6b9533f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:16.834883 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce03bd-87c7-4bd8-9abc-257f6b9533f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:16.835583 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce03bd-87c7-4bd8-9abc-257f6b9533f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:16.837943 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce03bd-87c7-4bd8-9abc-257f6b9533f8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:16.863073 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 949/1894] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:16 2021] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:11:16.864703 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade13f8c-eacd-4f14-9882-7d5268a2b281 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:16.875165 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade13f8c-eacd-4f14-9882-7d5268a2b281 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:16.879767 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61429d60-1a1f-4b0b-b904-128b7388e178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:16.880419 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61429d60-1a1f-4b0b-b904-128b7388e178 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:16.880700 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61429d60-1a1f-4b0b-b904-128b7388e178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:16.880970 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61429d60-1a1f-4b0b-b904-128b7388e178 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:16.881737 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61429d60-1a1f-4b0b-b904-128b7388e178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:16.883359 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61429d60-1a1f-4b0b-b904-128b7388e178 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:16.894040 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 946/1895] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:16 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:16.897961 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce03bd-87c7-4bd8-9abc-257f6b9533f8 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:16.908339 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce03bd-87c7-4bd8-9abc-257f6b9533f8 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:16.912924 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8a38a-d832-4891-8c3e-d16eb884f0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:16.913613 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8a38a-d832-4891-8c3e-d16eb884f0fb admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:16.913901 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8a38a-d832-4891-8c3e-d16eb884f0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:16.914176 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8a38a-d832-4891-8c3e-d16eb884f0fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:16.915741 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec8a38a-d832-4891-8c3e-d16eb884f0fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:16.917340 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec8a38a-d832-4891-8c3e-d16eb884f0fb admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:16.926956 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 950/1896] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:16 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:11:16.931923 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61429d60-1a1f-4b0b-b904-128b7388e178 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:16.941763 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61429d60-1a1f-4b0b-b904-128b7388e178 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:16.946990 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f5df5-ef8d-43a4-ad75-165fd0646edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:16.947851 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f5df5-ef8d-43a4-ad75-165fd0646edc admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:16.948131 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f5df5-ef8d-43a4-ad75-165fd0646edc admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:16.948407 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f5df5-ef8d-43a4-ad75-165fd0646edc admin admin] PATH_INFO: `/v3/projects/74d19275f27a4ab6a8193b8143040d3f/users/8bcb40c8602d4f0f9ac0b200f78c63cc/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:16.962953 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f5df5-ef8d-43a4-ad75-165fd0646edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=74d19275f27a4ab6a8193b8143040d3f, user_id=8bcb40c8602d4f0f9ac0b200f78c63cc, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:16.965617 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f5df5-ef8d-43a4-ad75-165fd0646edc admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:16.978025 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 947/1897] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:16 2021] PUT /identity/v3/projects/74d19275f27a4ab6a8193b8143040d3f/users/8bcb40c8602d4f0f9ac0b200f78c63cc/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:11:16.988109 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146afcfe-cd21-4cc6-8f8a-aa488b3deef4 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:16.988400 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146afcfe-cd21-4cc6-8f8a-aa488b3deef4 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:16.988678 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146afcfe-cd21-4cc6-8f8a-aa488b3deef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:17.015510 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-146afcfe-cd21-4cc6-8f8a-aa488b3deef4 None None] MFA Rules not processed for user `8bcb40c8602d4f0f9ac0b200f78c63cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:17.016700 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-146afcfe-cd21-4cc6-8f8a-aa488b3deef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:17.079782 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 951/1898] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:16 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:17.094437 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f5df5-ef8d-43a4-ad75-165fd0646edc admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:17.096270 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-3b0f5df5-ef8d-43a4-ad75-165fd0646edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:17.157119 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f5df5-ef8d-43a4-ad75-165fd0646edc admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:17.161200 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ab868-de32-4fd4-9212-15ef6b467f61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:17.161889 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ab868-de32-4fd4-9212-15ef6b467f61 service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:17.162175 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ab868-de32-4fd4-9212-15ef6b467f61 service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:17.162454 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ab868-de32-4fd4-9212-15ef6b467f61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:17.172053 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ab868-de32-4fd4-9212-15ef6b467f61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:17.174503 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ab868-de32-4fd4-9212-15ef6b467f61 service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:17.184259 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 948/1899] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:17 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:19.683802 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146afcfe-cd21-4cc6-8f8a-aa488b3deef4 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:19.685243 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-146afcfe-cd21-4cc6-8f8a-aa488b3deef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:19.748522 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146afcfe-cd21-4cc6-8f8a-aa488b3deef4 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:19.753198 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a571dc4-fa2b-49db-9dee-067a3b006bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:19.754099 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a571dc4-fa2b-49db-9dee-067a3b006bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:19.754436 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a571dc4-fa2b-49db-9dee-067a3b006bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:19.754628 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a571dc4-fa2b-49db-9dee-067a3b006bd0 admin admin] PATH_INFO: `/v3/users/66b3b824d2104863820747f90369af0d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:19.755830 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a571dc4-fa2b-49db-9dee-067a3b006bd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b3b824d2104863820747f90369af0d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:19.757801 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a571dc4-fa2b-49db-9dee-067a3b006bd0 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:19.805573 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-3a571dc4-fa2b-49db-9dee-067a3b006bd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b3b824d2104863820747f90369af0d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:19.806279 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-3a571dc4-fa2b-49db-9dee-067a3b006bd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b3b824d2104863820747f90369af0d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:19.812893 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-3a571dc4-fa2b-49db-9dee-067a3b006bd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b3b824d2104863820747f90369af0d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:19.813564 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-3a571dc4-fa2b-49db-9dee-067a3b006bd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b3b824d2104863820747f90369af0d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:19.825908 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-3a571dc4-fa2b-49db-9dee-067a3b006bd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b3b824d2104863820747f90369af0d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:19.839542 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 952/1900] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:19 2021] DELETE /identity/v3/users/66b3b824d2104863820747f90369af0d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:19.844200 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a833b38-98b8-46ff-9022-ba001aea9ea5 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:19.844690 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a833b38-98b8-46ff-9022-ba001aea9ea5 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:19.844815 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a833b38-98b8-46ff-9022-ba001aea9ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:19.862771 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-6a833b38-98b8-46ff-9022-ba001aea9ea5 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:19.863972 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-6a833b38-98b8-46ff-9022-ba001aea9ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:19.926462 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 949/1901] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:11:19.937282 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a571dc4-fa2b-49db-9dee-067a3b006bd0 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:19.938704 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-3a571dc4-fa2b-49db-9dee-067a3b006bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:19.998654 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a571dc4-fa2b-49db-9dee-067a3b006bd0 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:20.002644 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d2ef3-47de-407a-8607-4f2aecdc1841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:20.003281 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d2ef3-47de-407a-8607-4f2aecdc1841 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:20.003565 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d2ef3-47de-407a-8607-4f2aecdc1841 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:20.003830 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d2ef3-47de-407a-8607-4f2aecdc1841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:20.014619 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d2ef3-47de-407a-8607-4f2aecdc1841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:20.016058 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d2ef3-47de-407a-8607-4f2aecdc1841 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:20.027730 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 953/1902] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:20.335715 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a833b38-98b8-46ff-9022-ba001aea9ea5 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:20.338113 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-6a833b38-98b8-46ff-9022-ba001aea9ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:20.350251 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a833b38-98b8-46ff-9022-ba001aea9ea5 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:20.355618 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d6bbd-1b9f-4413-abd1-9a52b1b6cd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:20.356469 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d6bbd-1b9f-4413-abd1-9a52b1b6cd4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:20.356754 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d6bbd-1b9f-4413-abd1-9a52b1b6cd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:20.357030 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d6bbd-1b9f-4413-abd1-9a52b1b6cd4e admin admin] PATH_INFO: `/v3/projects/a88c21fd0a924b1788d711a323172fd6` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:20.358314 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d6bbd-1b9f-4413-abd1-9a52b1b6cd4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a88c21fd0a924b1788d711a323172fd6)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:20.360225 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d6bbd-1b9f-4413-abd1-9a52b1b6cd4e admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:20.410163 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-776d6bbd-1b9f-4413-abd1-9a52b1b6cd4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a88c21fd0a924b1788d711a323172fd6', 'request_id': 'req-776d6bbd-1b9f-4413-abd1-9a52b1b6cd4e'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:20.418311 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-776d6bbd-1b9f-4413-abd1-9a52b1b6cd4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a88c21fd0a924b1788d711a323172fd6', 'request_id': 'req-776d6bbd-1b9f-4413-abd1-9a52b1b6cd4e'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:20.424254 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-776d6bbd-1b9f-4413-abd1-9a52b1b6cd4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a88c21fd0a924b1788d711a323172fd6', 'request_id': 'req-776d6bbd-1b9f-4413-abd1-9a52b1b6cd4e'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:20.435395 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-776d6bbd-1b9f-4413-abd1-9a52b1b6cd4e admin admin] The token cache is being invalidate because project a88c21fd0a924b1788d711a323172fd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:20.435683 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-776d6bbd-1b9f-4413-abd1-9a52b1b6cd4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:20.436337 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-776d6bbd-1b9f-4413-abd1-9a52b1b6cd4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:20.437906 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 950/1903] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:20 2021] DELETE /identity/v3/projects/a88c21fd0a924b1788d711a323172fd6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:20.441788 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d2ef3-47de-407a-8607-4f2aecdc1841 service neutron] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:20.451542 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d2ef3-47de-407a-8607-4f2aecdc1841 service neutron] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:20.504464 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e8e99-cf85-4765-ad20-76e104e0f161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:20.505314 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e8e99-cf85-4765-ad20-76e104e0f161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:20.505622 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e8e99-cf85-4765-ad20-76e104e0f161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:20.505892 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e8e99-cf85-4765-ad20-76e104e0f161 admin admin] PATH_INFO: `/v3/users/a09a5b9642344a9ca935b2ced30c3637` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:20.507058 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e8e99-cf85-4765-ad20-76e104e0f161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a09a5b9642344a9ca935b2ced30c3637)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:20.509048 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e8e99-cf85-4765-ad20-76e104e0f161 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:20.551782 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-048e8e99-cf85-4765-ad20-76e104e0f161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a09a5b9642344a9ca935b2ced30c3637'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:20.552421 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-048e8e99-cf85-4765-ad20-76e104e0f161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a09a5b9642344a9ca935b2ced30c3637'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:20.558901 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-048e8e99-cf85-4765-ad20-76e104e0f161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a09a5b9642344a9ca935b2ced30c3637'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:20.559522 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-048e8e99-cf85-4765-ad20-76e104e0f161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a09a5b9642344a9ca935b2ced30c3637'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:20.571477 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-048e8e99-cf85-4765-ad20-76e104e0f161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a09a5b9642344a9ca935b2ced30c3637'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:20.585920 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 954/1904] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:20 2021] DELETE /identity/v3/users/a09a5b9642344a9ca935b2ced30c3637 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:11:20.929899 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d6bbd-1b9f-4413-abd1-9a52b1b6cd4e admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:20.931953 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-776d6bbd-1b9f-4413-abd1-9a52b1b6cd4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:20.947337 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d6bbd-1b9f-4413-abd1-9a52b1b6cd4e admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:21.004301 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2560f46-6993-468c-8de7-593f99ed77bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:21.005150 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2560f46-6993-468c-8de7-593f99ed77bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:21.005466 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2560f46-6993-468c-8de7-593f99ed77bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:21.005746 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2560f46-6993-468c-8de7-593f99ed77bf admin admin] PATH_INFO: `/v3/projects/92e89b1fecfb4883b450879ce1294dc2` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:21.006926 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2560f46-6993-468c-8de7-593f99ed77bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=92e89b1fecfb4883b450879ce1294dc2)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:21.008919 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2560f46-6993-468c-8de7-593f99ed77bf admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:21.053965 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-d2560f46-6993-468c-8de7-593f99ed77bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92e89b1fecfb4883b450879ce1294dc2', 'request_id': 'req-d2560f46-6993-468c-8de7-593f99ed77bf'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:21.061661 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-d2560f46-6993-468c-8de7-593f99ed77bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92e89b1fecfb4883b450879ce1294dc2', 'request_id': 'req-d2560f46-6993-468c-8de7-593f99ed77bf'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:21.066911 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-d2560f46-6993-468c-8de7-593f99ed77bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92e89b1fecfb4883b450879ce1294dc2', 'request_id': 'req-d2560f46-6993-468c-8de7-593f99ed77bf'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:21.078887 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-d2560f46-6993-468c-8de7-593f99ed77bf admin admin] The token cache is being invalidate because project 92e89b1fecfb4883b450879ce1294dc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:21.079519 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-d2560f46-6993-468c-8de7-593f99ed77bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:21.079794 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-d2560f46-6993-468c-8de7-593f99ed77bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:21.081359 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 951/1905] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:20 2021] DELETE /identity/v3/projects/92e89b1fecfb4883b450879ce1294dc2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:11:21.087899 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03daeb1-5a6c-4deb-8c38-ae83f5044b8b None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:21.088385 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03daeb1-5a6c-4deb-8c38-ae83f5044b8b None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:21.088584 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03daeb1-5a6c-4deb-8c38-ae83f5044b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:21.108539 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-d03daeb1-5a6c-4deb-8c38-ae83f5044b8b None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:21.109854 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-d03daeb1-5a6c-4deb-8c38-ae83f5044b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:21.304460 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 955/1906] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:11:21.305901 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f23eb-e803-4c80-984f-ce2fa8a388ae None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:21.306216 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f23eb-e803-4c80-984f-ce2fa8a388ae None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:21.306516 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f23eb-e803-4c80-984f-ce2fa8a388ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:21.326600 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-b47f23eb-e803-4c80-984f-ce2fa8a388ae None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:21.327816 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-b47f23eb-e803-4c80-984f-ce2fa8a388ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:21.339388 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 952/1907] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:21.343618 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03daeb1-5a6c-4deb-8c38-ae83f5044b8b None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:21.354191 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03daeb1-5a6c-4deb-8c38-ae83f5044b8b None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:21.361945 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c355f-8158-4cda-baf3-5fc151f163a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:21.364881 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c355f-8158-4cda-baf3-5fc151f163a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:21.365254 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c355f-8158-4cda-baf3-5fc151f163a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:21.365711 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c355f-8158-4cda-baf3-5fc151f163a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:21.367377 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c355f-8158-4cda-baf3-5fc151f163a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:21.367901 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c355f-8158-4cda-baf3-5fc151f163a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:21.369598 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c355f-8158-4cda-baf3-5fc151f163a9 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:21.385871 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 956/1908] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:11:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:21.389970 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f23eb-e803-4c80-984f-ce2fa8a388ae None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:21.400666 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f23eb-e803-4c80-984f-ce2fa8a388ae None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:21.413566 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0fcee-d0bd-4f86-9032-0636d6456024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:21.416001 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0fcee-d0bd-4f86-9032-0636d6456024 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:21.416403 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0fcee-d0bd-4f86-9032-0636d6456024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:21.416787 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0fcee-d0bd-4f86-9032-0636d6456024 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:21.417671 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0fcee-d0bd-4f86-9032-0636d6456024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:21.420810 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0fcee-d0bd-4f86-9032-0636d6456024 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:21.470737 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 953/1909] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:21 2021] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:11:21.472201 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c355f-8158-4cda-baf3-5fc151f163a9 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:21.483165 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c355f-8158-4cda-baf3-5fc151f163a9 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:21.543737 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc21ad-1286-4704-946f-9da159a3a522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:21.544452 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc21ad-1286-4704-946f-9da159a3a522 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:21.544737 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc21ad-1286-4704-946f-9da159a3a522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:21.545021 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc21ad-1286-4704-946f-9da159a3a522 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:21.545771 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc21ad-1286-4704-946f-9da159a3a522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:21.547786 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc21ad-1286-4704-946f-9da159a3a522 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:21.577737 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 957/1910] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:21 2021] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:21.578553 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0fcee-d0bd-4f86-9032-0636d6456024 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:21.589068 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0fcee-d0bd-4f86-9032-0636d6456024 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:21.595407 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e2e05-f894-4efa-a226-f4e8dfe3d612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:21.595719 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e2e05-f894-4efa-a226-f4e8dfe3d612 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:21.596007 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e2e05-f894-4efa-a226-f4e8dfe3d612 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:21.596292 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e2e05-f894-4efa-a226-f4e8dfe3d612 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:21.597030 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e2e05-f894-4efa-a226-f4e8dfe3d612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:21.598677 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e2e05-f894-4efa-a226-f4e8dfe3d612 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:21.620969 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 954/1911] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:21 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:21.626028 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc21ad-1286-4704-946f-9da159a3a522 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:21.637590 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc21ad-1286-4704-946f-9da159a3a522 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:21.642314 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28775689-f8bc-4c08-8d1b-93924540bea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:21.643077 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28775689-f8bc-4c08-8d1b-93924540bea9 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:21.643367 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28775689-f8bc-4c08-8d1b-93924540bea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:21.643642 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28775689-f8bc-4c08-8d1b-93924540bea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:21.644379 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28775689-f8bc-4c08-8d1b-93924540bea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:21.646038 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28775689-f8bc-4c08-8d1b-93924540bea9 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:21.657094 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 958/1912] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:21 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:21.661775 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e2e05-f894-4efa-a226-f4e8dfe3d612 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:21.672031 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e2e05-f894-4efa-a226-f4e8dfe3d612 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:21.676838 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd515736-9432-46ea-9f7f-7689ce5f21ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:21.677743 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd515736-9432-46ea-9f7f-7689ce5f21ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:21.678028 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd515736-9432-46ea-9f7f-7689ce5f21ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:21.678306 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd515736-9432-46ea-9f7f-7689ce5f21ab admin admin] PATH_INFO: `/v3/projects/4aa6f29a9e8d4b8386000fb73f13d57e/users/e80fb86028af473195562ba4d6a59a5b/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:21.693380 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd515736-9432-46ea-9f7f-7689ce5f21ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa6f29a9e8d4b8386000fb73f13d57e, user_id=e80fb86028af473195562ba4d6a59a5b, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:21.696631 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd515736-9432-46ea-9f7f-7689ce5f21ab admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:21.709293 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 955/1913] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:21 2021] PUT /identity/v3/projects/4aa6f29a9e8d4b8386000fb73f13d57e/users/e80fb86028af473195562ba4d6a59a5b/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:11:21.721290 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c7366-6a9b-454e-a064-ee405dd9afa1 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:21.721552 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c7366-6a9b-454e-a064-ee405dd9afa1 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:21.721831 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c7366-6a9b-454e-a064-ee405dd9afa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:21.750606 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-976c7366-6a9b-454e-a064-ee405dd9afa1 None None] MFA Rules not processed for user `e80fb86028af473195562ba4d6a59a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:21.751852 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-976c7366-6a9b-454e-a064-ee405dd9afa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:21.817514 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 959/1914] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:21 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:11:21.828435 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd515736-9432-46ea-9f7f-7689ce5f21ab admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:21.830202 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-bd515736-9432-46ea-9f7f-7689ce5f21ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:21.922299 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd515736-9432-46ea-9f7f-7689ce5f21ab admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:21.926878 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d2b67-5835-45d3-bb3f-08584ef45820 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:21.927533 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d2b67-5835-45d3-bb3f-08584ef45820 service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:21.927830 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d2b67-5835-45d3-bb3f-08584ef45820 service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:21.928243 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d2b67-5835-45d3-bb3f-08584ef45820 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:21.938817 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d2b67-5835-45d3-bb3f-08584ef45820 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:21.940471 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d2b67-5835-45d3-bb3f-08584ef45820 service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:21.953682 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 956/1915] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:21 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:11:27.380099 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c7366-6a9b-454e-a064-ee405dd9afa1 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:27.381605 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-976c7366-6a9b-454e-a064-ee405dd9afa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:27.444217 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c7366-6a9b-454e-a064-ee405dd9afa1 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:27.449088 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8f573-89a8-4bd3-be0a-585ac34db82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:27.449992 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8f573-89a8-4bd3-be0a-585ac34db82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:27.450276 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8f573-89a8-4bd3-be0a-585ac34db82c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:27.450551 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8f573-89a8-4bd3-be0a-585ac34db82c admin admin] PATH_INFO: `/v3/users/8bcb40c8602d4f0f9ac0b200f78c63cc` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:27.451740 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8f573-89a8-4bd3-be0a-585ac34db82c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bcb40c8602d4f0f9ac0b200f78c63cc)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:27.453705 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8f573-89a8-4bd3-be0a-585ac34db82c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:27.497164 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-30e8f573-89a8-4bd3-be0a-585ac34db82c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bcb40c8602d4f0f9ac0b200f78c63cc'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:27.497825 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-30e8f573-89a8-4bd3-be0a-585ac34db82c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bcb40c8602d4f0f9ac0b200f78c63cc'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:27.504727 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-30e8f573-89a8-4bd3-be0a-585ac34db82c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bcb40c8602d4f0f9ac0b200f78c63cc'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:27.505356 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-30e8f573-89a8-4bd3-be0a-585ac34db82c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bcb40c8602d4f0f9ac0b200f78c63cc'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:27.517180 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-30e8f573-89a8-4bd3-be0a-585ac34db82c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bcb40c8602d4f0f9ac0b200f78c63cc'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:27.529797 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 960/1916] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:27 2021] DELETE /identity/v3/users/8bcb40c8602d4f0f9ac0b200f78c63cc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:27.534785 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ae487-a68c-49d8-a14a-fb59d55f7857 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:27.535292 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ae487-a68c-49d8-a14a-fb59d55f7857 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:27.535454 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ae487-a68c-49d8-a14a-fb59d55f7857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:27.553265 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-5f3ae487-a68c-49d8-a14a-fb59d55f7857 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:27.554489 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-5f3ae487-a68c-49d8-a14a-fb59d55f7857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:27.610215 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 957/1917] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:27.620605 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8f573-89a8-4bd3-be0a-585ac34db82c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:27.622024 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-30e8f573-89a8-4bd3-be0a-585ac34db82c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:27.675685 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8f573-89a8-4bd3-be0a-585ac34db82c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:27.679277 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03966a4-7d41-4a3f-8acd-3c772bb0d032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:27.680500 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03966a4-7d41-4a3f-8acd-3c772bb0d032 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:27.680791 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03966a4-7d41-4a3f-8acd-3c772bb0d032 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:27.681053 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03966a4-7d41-4a3f-8acd-3c772bb0d032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:27.701217 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03966a4-7d41-4a3f-8acd-3c772bb0d032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:27.702739 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03966a4-7d41-4a3f-8acd-3c772bb0d032 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:27.712557 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 961/1918] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:27.968427 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ae487-a68c-49d8-a14a-fb59d55f7857 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:27.969908 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-5f3ae487-a68c-49d8-a14a-fb59d55f7857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:27.982467 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ae487-a68c-49d8-a14a-fb59d55f7857 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:27.987000 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5e77b-ac09-4398-8f44-1fef4902af55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:27.987883 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5e77b-ac09-4398-8f44-1fef4902af55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:27.988167 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5e77b-ac09-4398-8f44-1fef4902af55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:27.988444 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5e77b-ac09-4398-8f44-1fef4902af55 admin admin] PATH_INFO: `/v3/projects/74d19275f27a4ab6a8193b8143040d3f` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:27.989664 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5e77b-ac09-4398-8f44-1fef4902af55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74d19275f27a4ab6a8193b8143040d3f)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:27.991574 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5e77b-ac09-4398-8f44-1fef4902af55 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:28.037221 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-65c5e77b-ac09-4398-8f44-1fef4902af55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74d19275f27a4ab6a8193b8143040d3f', 'request_id': 'req-65c5e77b-ac09-4398-8f44-1fef4902af55'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:28.045584 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-65c5e77b-ac09-4398-8f44-1fef4902af55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74d19275f27a4ab6a8193b8143040d3f', 'request_id': 'req-65c5e77b-ac09-4398-8f44-1fef4902af55'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:28.051078 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-65c5e77b-ac09-4398-8f44-1fef4902af55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74d19275f27a4ab6a8193b8143040d3f', 'request_id': 'req-65c5e77b-ac09-4398-8f44-1fef4902af55'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:28.062361 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-65c5e77b-ac09-4398-8f44-1fef4902af55 admin admin] The token cache is being invalidate because project 74d19275f27a4ab6a8193b8143040d3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:28.062652 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-65c5e77b-ac09-4398-8f44-1fef4902af55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:28.063281 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-65c5e77b-ac09-4398-8f44-1fef4902af55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:28.064841 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 958/1919] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:27 2021] DELETE /identity/v3/projects/74d19275f27a4ab6a8193b8143040d3f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:28.071045 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1548566-4e54-45e2-97bf-1f317dfe186f None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:28.071573 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1548566-4e54-45e2-97bf-1f317dfe186f None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:28.071873 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1548566-4e54-45e2-97bf-1f317dfe186f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:28.090194 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-d1548566-4e54-45e2-97bf-1f317dfe186f None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:28.091399 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-d1548566-4e54-45e2-97bf-1f317dfe186f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:28.156599 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 962/1920] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:28.172586 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6f564-e912-4eb7-9262-16884af79305 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:28.172874 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6f564-e912-4eb7-9262-16884af79305 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:28.173152 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6f564-e912-4eb7-9262-16884af79305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:28.191504 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-e4e6f564-e912-4eb7-9262-16884af79305 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:28.192714 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-e4e6f564-e912-4eb7-9262-16884af79305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:28.201650 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 959/1921] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:28.206055 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1548566-4e54-45e2-97bf-1f317dfe186f None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:28.216715 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1548566-4e54-45e2-97bf-1f317dfe186f None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:28.221274 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ea106-3ded-4db9-a2f9-917a198606c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:28.221983 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ea106-3ded-4db9-a2f9-917a198606c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:28.222266 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ea106-3ded-4db9-a2f9-917a198606c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:28.222540 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ea106-3ded-4db9-a2f9-917a198606c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:28.223273 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ea106-3ded-4db9-a2f9-917a198606c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:28.223600 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ea106-3ded-4db9-a2f9-917a198606c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:28.225204 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ea106-3ded-4db9-a2f9-917a198606c3 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:28.236893 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 963/1922] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:11:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:28.241269 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6f564-e912-4eb7-9262-16884af79305 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:28.251458 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6f564-e912-4eb7-9262-16884af79305 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:28.256103 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471e100-088f-49e8-aa84-6a83158230ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:28.256750 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471e100-088f-49e8-aa84-6a83158230ef admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:28.257030 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471e100-088f-49e8-aa84-6a83158230ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:28.257311 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471e100-088f-49e8-aa84-6a83158230ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:28.258074 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471e100-088f-49e8-aa84-6a83158230ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:28.259978 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471e100-088f-49e8-aa84-6a83158230ef admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:28.288976 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 960/1923] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:28 2021] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:28.294449 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ea106-3ded-4db9-a2f9-917a198606c3 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:28.307570 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ea106-3ded-4db9-a2f9-917a198606c3 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:28.369211 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd36b50-d961-4d8f-8cdc-bbe9c5695acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:28.369938 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd36b50-d961-4d8f-8cdc-bbe9c5695acb admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:28.370210 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd36b50-d961-4d8f-8cdc-bbe9c5695acb admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:28.370487 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd36b50-d961-4d8f-8cdc-bbe9c5695acb admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:28.371190 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd36b50-d961-4d8f-8cdc-bbe9c5695acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:28.373116 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd36b50-d961-4d8f-8cdc-bbe9c5695acb admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:28.394690 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 964/1924] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:28 2021] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:28.398309 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471e100-088f-49e8-aa84-6a83158230ef admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:28.410882 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471e100-088f-49e8-aa84-6a83158230ef admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:28.415720 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024c04d-8098-4589-b623-91261123144a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:28.416381 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024c04d-8098-4589-b623-91261123144a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:28.416662 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024c04d-8098-4589-b623-91261123144a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:28.416937 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024c04d-8098-4589-b623-91261123144a admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:28.417718 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024c04d-8098-4589-b623-91261123144a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:28.419297 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024c04d-8098-4589-b623-91261123144a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:28.430297 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 961/1925] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:28 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:11:28.434688 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd36b50-d961-4d8f-8cdc-bbe9c5695acb admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:28.446078 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd36b50-d961-4d8f-8cdc-bbe9c5695acb admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:28.451251 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80011f6-4d72-46ae-a472-27e5541c3311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:28.451909 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80011f6-4d72-46ae-a472-27e5541c3311 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:28.452217 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80011f6-4d72-46ae-a472-27e5541c3311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:28.452492 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80011f6-4d72-46ae-a472-27e5541c3311 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:28.453226 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80011f6-4d72-46ae-a472-27e5541c3311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:28.454868 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80011f6-4d72-46ae-a472-27e5541c3311 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:28.468977 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 965/1926] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:28 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:28.470117 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024c04d-8098-4589-b623-91261123144a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:28.481479 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024c04d-8098-4589-b623-91261123144a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:28.486558 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64abd9c-5641-4f1e-b483-467f56d62d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:28.487531 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64abd9c-5641-4f1e-b483-467f56d62d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:28.487961 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64abd9c-5641-4f1e-b483-467f56d62d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:28.488245 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64abd9c-5641-4f1e-b483-467f56d62d14 admin admin] PATH_INFO: `/v3/projects/174453a286344e0fa34d91d3ebcb8436/users/0a15ca0a8cc74415815f5613f72b8105/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:28.504851 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64abd9c-5641-4f1e-b483-467f56d62d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=174453a286344e0fa34d91d3ebcb8436, user_id=0a15ca0a8cc74415815f5613f72b8105, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:28.507718 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64abd9c-5641-4f1e-b483-467f56d62d14 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:28.527250 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 962/1927] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:28 2021] PUT /identity/v3/projects/174453a286344e0fa34d91d3ebcb8436/users/0a15ca0a8cc74415815f5613f72b8105/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:28.531062 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a6be7-082e-433d-baa1-f75a417d2014 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:28.531350 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a6be7-082e-433d-baa1-f75a417d2014 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:28.531633 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a6be7-082e-433d-baa1-f75a417d2014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:28.549664 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-897a6be7-082e-433d-baa1-f75a417d2014 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:28.550918 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-897a6be7-082e-433d-baa1-f75a417d2014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:28.608243 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 966/1928] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:28.618285 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64abd9c-5641-4f1e-b483-467f56d62d14 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:28.619982 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c64abd9c-5641-4f1e-b483-467f56d62d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:28.673908 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64abd9c-5641-4f1e-b483-467f56d62d14 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:28.677532 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4438d8-5f98-4a64-8cc3-c11e83aa27a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:28.678161 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4438d8-5f98-4a64-8cc3-c11e83aa27a5 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:28.678444 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4438d8-5f98-4a64-8cc3-c11e83aa27a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:28.678715 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4438d8-5f98-4a64-8cc3-c11e83aa27a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:28.688082 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4438d8-5f98-4a64-8cc3-c11e83aa27a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:28.689528 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4438d8-5f98-4a64-8cc3-c11e83aa27a5 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:28.699053 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 963/1929] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:31.688122 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a6be7-082e-433d-baa1-f75a417d2014 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:31.691382 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-897a6be7-082e-433d-baa1-f75a417d2014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:31.735077 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a6be7-082e-433d-baa1-f75a417d2014 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:31.755385 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608687b7-328b-4d9f-bd1e-e486e6f7eed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:31.766320 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608687b7-328b-4d9f-bd1e-e486e6f7eed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:31.768285 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608687b7-328b-4d9f-bd1e-e486e6f7eed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:31.768854 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608687b7-328b-4d9f-bd1e-e486e6f7eed9 admin admin] PATH_INFO: `/v3/users/e80fb86028af473195562ba4d6a59a5b` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:31.774070 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608687b7-328b-4d9f-bd1e-e486e6f7eed9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e80fb86028af473195562ba4d6a59a5b)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:31.791430 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608687b7-328b-4d9f-bd1e-e486e6f7eed9 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:32.006863 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-608687b7-328b-4d9f-bd1e-e486e6f7eed9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e80fb86028af473195562ba4d6a59a5b'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:32.012572 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-608687b7-328b-4d9f-bd1e-e486e6f7eed9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e80fb86028af473195562ba4d6a59a5b'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:32.045954 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-608687b7-328b-4d9f-bd1e-e486e6f7eed9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e80fb86028af473195562ba4d6a59a5b'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:32.046864 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-608687b7-328b-4d9f-bd1e-e486e6f7eed9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e80fb86028af473195562ba4d6a59a5b'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:32.089654 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-608687b7-328b-4d9f-bd1e-e486e6f7eed9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e80fb86028af473195562ba4d6a59a5b'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:32.129480 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 967/1930] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:31 2021] DELETE /identity/v3/users/e80fb86028af473195562ba4d6a59a5b => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:32.136822 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6573c-de02-4488-a3e2-f478ec448da2 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:32.137354 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6573c-de02-4488-a3e2-f478ec448da2 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:32.137354 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6573c-de02-4488-a3e2-f478ec448da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:32.175116 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-5bf6573c-de02-4488-a3e2-f478ec448da2 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:32.176358 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-5bf6573c-de02-4488-a3e2-f478ec448da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:32.352553 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 964/1931] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:32.413356 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608687b7-328b-4d9f-bd1e-e486e6f7eed9 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:32.415100 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-608687b7-328b-4d9f-bd1e-e486e6f7eed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:32.516090 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608687b7-328b-4d9f-bd1e-e486e6f7eed9 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:32.522378 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156b6af-cea1-4145-9580-c7de980140ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:32.524514 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156b6af-cea1-4145-9580-c7de980140ef service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:32.524928 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156b6af-cea1-4145-9580-c7de980140ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:32.525592 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156b6af-cea1-4145-9580-c7de980140ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:32.542961 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156b6af-cea1-4145-9580-c7de980140ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:32.544953 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156b6af-cea1-4145-9580-c7de980140ef service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:32.577440 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 968/1932] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:33.151746 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6573c-de02-4488-a3e2-f478ec448da2 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:33.153199 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-5bf6573c-de02-4488-a3e2-f478ec448da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:33.169906 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6573c-de02-4488-a3e2-f478ec448da2 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:33.176432 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628244e-b0c0-4e34-801a-c47f4c26af8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:33.177812 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628244e-b0c0-4e34-801a-c47f4c26af8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:33.178564 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628244e-b0c0-4e34-801a-c47f4c26af8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:33.179026 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628244e-b0c0-4e34-801a-c47f4c26af8d admin admin] PATH_INFO: `/v3/projects/4aa6f29a9e8d4b8386000fb73f13d57e` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:33.181066 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628244e-b0c0-4e34-801a-c47f4c26af8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aa6f29a9e8d4b8386000fb73f13d57e)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:33.183525 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628244e-b0c0-4e34-801a-c47f4c26af8d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:33.247759 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-6628244e-b0c0-4e34-801a-c47f4c26af8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aa6f29a9e8d4b8386000fb73f13d57e', 'request_id': 'req-6628244e-b0c0-4e34-801a-c47f4c26af8d'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:33.255674 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-6628244e-b0c0-4e34-801a-c47f4c26af8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aa6f29a9e8d4b8386000fb73f13d57e', 'request_id': 'req-6628244e-b0c0-4e34-801a-c47f4c26af8d'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:33.264261 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-6628244e-b0c0-4e34-801a-c47f4c26af8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aa6f29a9e8d4b8386000fb73f13d57e', 'request_id': 'req-6628244e-b0c0-4e34-801a-c47f4c26af8d'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:33.282853 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-6628244e-b0c0-4e34-801a-c47f4c26af8d admin admin] The token cache is being invalidate because project 4aa6f29a9e8d4b8386000fb73f13d57e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:33.283154 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-6628244e-b0c0-4e34-801a-c47f4c26af8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:33.284674 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-6628244e-b0c0-4e34-801a-c47f4c26af8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:33.287047 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 965/1933] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:33 2021] DELETE /identity/v3/projects/4aa6f29a9e8d4b8386000fb73f13d57e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:33.293250 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8ff8b-c1ab-4722-bc87-ccfd728b1078 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:33.294016 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8ff8b-c1ab-4722-bc87-ccfd728b1078 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:33.294016 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8ff8b-c1ab-4722-bc87-ccfd728b1078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:33.321224 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-2cc8ff8b-c1ab-4722-bc87-ccfd728b1078 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:33.322472 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-2cc8ff8b-c1ab-4722-bc87-ccfd728b1078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:33.388492 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 969/1934] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:33.396492 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89e9bf-9e29-4022-8186-db32c384b68a None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:33.396780 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89e9bf-9e29-4022-8186-db32c384b68a None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:33.397084 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89e9bf-9e29-4022-8186-db32c384b68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:33.430389 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-bd89e9bf-9e29-4022-8186-db32c384b68a None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:33.431494 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-bd89e9bf-9e29-4022-8186-db32c384b68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:33.446222 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 966/1935] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:33.450367 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8ff8b-c1ab-4722-bc87-ccfd728b1078 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:33.460671 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8ff8b-c1ab-4722-bc87-ccfd728b1078 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:33.467554 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dda580-c8dd-4746-b629-f08c927e19c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:33.468317 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dda580-c8dd-4746-b629-f08c927e19c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:33.468750 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dda580-c8dd-4746-b629-f08c927e19c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:33.469310 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dda580-c8dd-4746-b629-f08c927e19c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:33.470210 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dda580-c8dd-4746-b629-f08c927e19c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:33.471347 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dda580-c8dd-4746-b629-f08c927e19c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:33.473142 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dda580-c8dd-4746-b629-f08c927e19c5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:33.493833 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 970/1936] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:11:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:33.498385 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89e9bf-9e29-4022-8186-db32c384b68a None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:33.516977 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89e9bf-9e29-4022-8186-db32c384b68a None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:33.522584 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47186d09-0b6b-43a3-96f2-df938c9ca0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:33.523418 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47186d09-0b6b-43a3-96f2-df938c9ca0b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:33.524693 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47186d09-0b6b-43a3-96f2-df938c9ca0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:33.524972 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47186d09-0b6b-43a3-96f2-df938c9ca0b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:33.525984 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47186d09-0b6b-43a3-96f2-df938c9ca0b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:33.527879 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47186d09-0b6b-43a3-96f2-df938c9ca0b2 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:33.579591 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 967/1937] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:33 2021] POST /identity/v3/projects => generated 385 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:33.583900 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dda580-c8dd-4746-b629-f08c927e19c5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:33.599885 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dda580-c8dd-4746-b629-f08c927e19c5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:33.703746 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150a83a-7ca6-4e57-8407-3a6cac47da29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:33.704999 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150a83a-7ca6-4e57-8407-3a6cac47da29 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:33.705551 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150a83a-7ca6-4e57-8407-3a6cac47da29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:33.706042 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150a83a-7ca6-4e57-8407-3a6cac47da29 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:33.707096 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150a83a-7ca6-4e57-8407-3a6cac47da29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:33.710069 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150a83a-7ca6-4e57-8407-3a6cac47da29 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:33.753776 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47186d09-0b6b-43a3-96f2-df938c9ca0b2 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:33.754624 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 971/1938] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:33 2021] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:33.767051 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47186d09-0b6b-43a3-96f2-df938c9ca0b2 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:33.778269 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4eb28-3ab4-49cc-ae49-c12c3f33ec0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:33.779349 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4eb28-3ab4-49cc-ae49-c12c3f33ec0d admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:33.779992 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4eb28-3ab4-49cc-ae49-c12c3f33ec0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:33.780525 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4eb28-3ab4-49cc-ae49-c12c3f33ec0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:33.781874 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4eb28-3ab4-49cc-ae49-c12c3f33ec0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:33.784183 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4eb28-3ab4-49cc-ae49-c12c3f33ec0d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:33.803384 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 968/1939] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:33 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:11:33.807928 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150a83a-7ca6-4e57-8407-3a6cac47da29 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:33.821127 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150a83a-7ca6-4e57-8407-3a6cac47da29 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:33.833340 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a319a-3d7b-467c-8ee8-1d6696bb8e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:33.834167 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a319a-3d7b-467c-8ee8-1d6696bb8e2d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:33.834521 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a319a-3d7b-467c-8ee8-1d6696bb8e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:33.834871 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a319a-3d7b-467c-8ee8-1d6696bb8e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:33.835696 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a319a-3d7b-467c-8ee8-1d6696bb8e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:33.840233 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a319a-3d7b-467c-8ee8-1d6696bb8e2d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:33.869120 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 972/1940] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:33 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:33.870052 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4eb28-3ab4-49cc-ae49-c12c3f33ec0d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:33.890663 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4eb28-3ab4-49cc-ae49-c12c3f33ec0d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:33.898090 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1988160-6499-486b-a1f5-d040fff8a9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:33.899478 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1988160-6499-486b-a1f5-d040fff8a9bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:33.900016 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1988160-6499-486b-a1f5-d040fff8a9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:33.900401 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1988160-6499-486b-a1f5-d040fff8a9bd admin admin] PATH_INFO: `/v3/projects/f7d1407cfc40425bb01f950031f39a66/users/c919f38afff54924b40b8206f80c8ec4/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:33.922943 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1988160-6499-486b-a1f5-d040fff8a9bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7d1407cfc40425bb01f950031f39a66, user_id=c919f38afff54924b40b8206f80c8ec4, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:33.931025 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1988160-6499-486b-a1f5-d040fff8a9bd admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:33.980210 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 969/1941] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:33 2021] PUT /identity/v3/projects/f7d1407cfc40425bb01f950031f39a66/users/c919f38afff54924b40b8206f80c8ec4/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:33.991112 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590ea71-2bd0-4e63-8034-de2eaff0b8e9 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:33.991550 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590ea71-2bd0-4e63-8034-de2eaff0b8e9 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:33.992032 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590ea71-2bd0-4e63-8034-de2eaff0b8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:34.064084 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-e590ea71-2bd0-4e63-8034-de2eaff0b8e9 None None] MFA Rules not processed for user `c919f38afff54924b40b8206f80c8ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:34.065331 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-e590ea71-2bd0-4e63-8034-de2eaff0b8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:34.199790 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 973/1942] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:33 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:34.208730 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1988160-6499-486b-a1f5-d040fff8a9bd admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:34.210317 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590ea71-2bd0-4e63-8034-de2eaff0b8e9 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:34.211524 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-b1988160-6499-486b-a1f5-d040fff8a9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:34.212496 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-e590ea71-2bd0-4e63-8034-de2eaff0b8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:34.306997 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590ea71-2bd0-4e63-8034-de2eaff0b8e9 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:34.313920 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba1a1f-3c8e-4468-b0ee-a8496d0a3092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:34.318408 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba1a1f-3c8e-4468-b0ee-a8496d0a3092 service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:34.318914 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba1a1f-3c8e-4468-b0ee-a8496d0a3092 service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:34.319398 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba1a1f-3c8e-4468-b0ee-a8496d0a3092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:34.346321 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba1a1f-3c8e-4468-b0ee-a8496d0a3092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:34.348225 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba1a1f-3c8e-4468-b0ee-a8496d0a3092 service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:34.361536 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 974/1943] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:34 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:11:34.382142 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1988160-6499-486b-a1f5-d040fff8a9bd admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:34.389618 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb1200-d343-4600-8e3f-bbd3bddee5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:34.391169 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb1200-d343-4600-8e3f-bbd3bddee5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:34.391870 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb1200-d343-4600-8e3f-bbd3bddee5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:34.392567 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb1200-d343-4600-8e3f-bbd3bddee5ff admin admin] PATH_INFO: `/v3/users/0888ea1a0e6e47dab38c211d3540a464` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:34.395247 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb1200-d343-4600-8e3f-bbd3bddee5ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=0888ea1a0e6e47dab38c211d3540a464)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:34.397975 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb1200-d343-4600-8e3f-bbd3bddee5ff admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:34.476391 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-00cb1200-d343-4600-8e3f-bbd3bddee5ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0888ea1a0e6e47dab38c211d3540a464'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:34.478201 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-00cb1200-d343-4600-8e3f-bbd3bddee5ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0888ea1a0e6e47dab38c211d3540a464'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:34.479077 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-00cb1200-d343-4600-8e3f-bbd3bddee5ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0888ea1a0e6e47dab38c211d3540a464'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:34.495979 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-00cb1200-d343-4600-8e3f-bbd3bddee5ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0888ea1a0e6e47dab38c211d3540a464'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:34.504749 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-00cb1200-d343-4600-8e3f-bbd3bddee5ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0888ea1a0e6e47dab38c211d3540a464'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:34.523954 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 970/1944] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:34 2021] DELETE /identity/v3/users/0888ea1a0e6e47dab38c211d3540a464 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:34.525795 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16194a7-12e5-4b74-9ee4-4c5d28f9a6fa None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:34.526213 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16194a7-12e5-4b74-9ee4-4c5d28f9a6fa None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:34.526496 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16194a7-12e5-4b74-9ee4-4c5d28f9a6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:34.547791 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-c16194a7-12e5-4b74-9ee4-4c5d28f9a6fa None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:34.548517 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-c16194a7-12e5-4b74-9ee4-4c5d28f9a6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:34.620464 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 975/1945] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:34.631482 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb1200-d343-4600-8e3f-bbd3bddee5ff admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:34.633647 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-00cb1200-d343-4600-8e3f-bbd3bddee5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:34.707491 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb1200-d343-4600-8e3f-bbd3bddee5ff admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:34.712101 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3320a8c-e405-4df0-a510-b07472f66785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:34.713052 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3320a8c-e405-4df0-a510-b07472f66785 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:34.713533 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3320a8c-e405-4df0-a510-b07472f66785 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:34.714093 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3320a8c-e405-4df0-a510-b07472f66785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:34.731095 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3320a8c-e405-4df0-a510-b07472f66785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:34.732786 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3320a8c-e405-4df0-a510-b07472f66785 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:34.762819 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 971/1946] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:35.469095 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16194a7-12e5-4b74-9ee4-4c5d28f9a6fa None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:35.472197 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-c16194a7-12e5-4b74-9ee4-4c5d28f9a6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:35.485531 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16194a7-12e5-4b74-9ee4-4c5d28f9a6fa None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:35.500953 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5ca10-4d06-492c-a0e7-34935937d715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:35.501862 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5ca10-4d06-492c-a0e7-34935937d715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:35.502140 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5ca10-4d06-492c-a0e7-34935937d715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:35.502419 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5ca10-4d06-492c-a0e7-34935937d715 admin admin] PATH_INFO: `/v3/projects/a4a109f1f5954fd997092dcd73c6680f` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:35.503902 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5ca10-4d06-492c-a0e7-34935937d715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4a109f1f5954fd997092dcd73c6680f)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:35.505943 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5ca10-4d06-492c-a0e7-34935937d715 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:35.565827 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-9bd5ca10-4d06-492c-a0e7-34935937d715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4a109f1f5954fd997092dcd73c6680f', 'request_id': 'req-9bd5ca10-4d06-492c-a0e7-34935937d715'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:35.580457 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-9bd5ca10-4d06-492c-a0e7-34935937d715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4a109f1f5954fd997092dcd73c6680f', 'request_id': 'req-9bd5ca10-4d06-492c-a0e7-34935937d715'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:35.587161 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-9bd5ca10-4d06-492c-a0e7-34935937d715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4a109f1f5954fd997092dcd73c6680f', 'request_id': 'req-9bd5ca10-4d06-492c-a0e7-34935937d715'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:35.602441 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-9bd5ca10-4d06-492c-a0e7-34935937d715 admin admin] The token cache is being invalidate because project a4a109f1f5954fd997092dcd73c6680f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:35.602966 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-9bd5ca10-4d06-492c-a0e7-34935937d715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:35.603772 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-9bd5ca10-4d06-492c-a0e7-34935937d715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:35.608509 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 976/1947] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:35 2021] DELETE /identity/v3/projects/a4a109f1f5954fd997092dcd73c6680f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:35.610051 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3320a8c-e405-4df0-a510-b07472f66785 service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:35.620126 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3320a8c-e405-4df0-a510-b07472f66785 service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:35.689930 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995567e0-75c7-4ee9-ab8b-9d37172e90b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:35.690827 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995567e0-75c7-4ee9-ab8b-9d37172e90b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:35.691115 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995567e0-75c7-4ee9-ab8b-9d37172e90b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:35.691392 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995567e0-75c7-4ee9-ab8b-9d37172e90b3 admin admin] PATH_INFO: `/v3/users/ccf0da921dc44896bb42df6f2028ad02` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:35.692796 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995567e0-75c7-4ee9-ab8b-9d37172e90b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccf0da921dc44896bb42df6f2028ad02)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:35.695778 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995567e0-75c7-4ee9-ab8b-9d37172e90b3 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:35.732243 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e9763-1e05-471b-b448-87d83ccceeab None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:35.732810 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e9763-1e05-471b-b448-87d83ccceeab None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:35.733275 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e9763-1e05-471b-b448-87d83ccceeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:35.787357 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-995567e0-75c7-4ee9-ab8b-9d37172e90b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccf0da921dc44896bb42df6f2028ad02'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:35.788556 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-e67e9763-1e05-471b-b448-87d83ccceeab None None] MFA Rules not processed for user `0a15ca0a8cc74415815f5613f72b8105`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:35.789851 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-995567e0-75c7-4ee9-ab8b-9d37172e90b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccf0da921dc44896bb42df6f2028ad02'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:35.790956 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-995567e0-75c7-4ee9-ab8b-9d37172e90b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccf0da921dc44896bb42df6f2028ad02'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:35.792054 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-e67e9763-1e05-471b-b448-87d83ccceeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:35.815574 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-995567e0-75c7-4ee9-ab8b-9d37172e90b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccf0da921dc44896bb42df6f2028ad02'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:35.835292 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-995567e0-75c7-4ee9-ab8b-9d37172e90b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccf0da921dc44896bb42df6f2028ad02'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:35.860440 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 972/1948] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:35 2021] DELETE /identity/v3/users/ccf0da921dc44896bb42df6f2028ad02 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:35.912462 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 977/1949] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:35 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:35.917355 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995567e0-75c7-4ee9-ab8b-9d37172e90b3 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:35.918859 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-995567e0-75c7-4ee9-ab8b-9d37172e90b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:36.082457 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995567e0-75c7-4ee9-ab8b-9d37172e90b3 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:36.092140 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83f9b0-beb2-4f51-9e61-6fda5159a3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:36.092538 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83f9b0-beb2-4f51-9e61-6fda5159a3ec admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:36.093180 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83f9b0-beb2-4f51-9e61-6fda5159a3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:36.094916 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83f9b0-beb2-4f51-9e61-6fda5159a3ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:36.096130 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83f9b0-beb2-4f51-9e61-6fda5159a3ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:36.099715 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83f9b0-beb2-4f51-9e61-6fda5159a3ec admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:36.181184 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 973/1950] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:35 2021] POST /identity/v3/projects => generated 383 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:36.185201 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e9763-1e05-471b-b448-87d83ccceeab None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:36.199140 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e9763-1e05-471b-b448-87d83ccceeab None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:36.343160 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02089391-b4b9-4da7-b4ca-bad57d139345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:36.343853 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02089391-b4b9-4da7-b4ca-bad57d139345 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:36.344178 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02089391-b4b9-4da7-b4ca-bad57d139345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:36.344405 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02089391-b4b9-4da7-b4ca-bad57d139345 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:36.345113 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02089391-b4b9-4da7-b4ca-bad57d139345 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:36.347063 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02089391-b4b9-4da7-b4ca-bad57d139345 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:36.376921 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 978/1951] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:36 2021] POST /identity/v3/users => generated 298 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:36.382415 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83f9b0-beb2-4f51-9e61-6fda5159a3ec admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:36.399718 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83f9b0-beb2-4f51-9e61-6fda5159a3ec admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:36.406486 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b10ef-0c89-431d-9a8e-4f8d69c879ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:36.407613 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b10ef-0c89-431d-9a8e-4f8d69c879ab admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:36.408447 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b10ef-0c89-431d-9a8e-4f8d69c879ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:36.408547 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b10ef-0c89-431d-9a8e-4f8d69c879ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:36.411756 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b10ef-0c89-431d-9a8e-4f8d69c879ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:36.411756 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b10ef-0c89-431d-9a8e-4f8d69c879ab admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:36.412999 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02089391-b4b9-4da7-b4ca-bad57d139345 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:36.415757 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-02089391-b4b9-4da7-b4ca-bad57d139345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:36.449725 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02089391-b4b9-4da7-b4ca-bad57d139345 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:36.457148 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 974/1952] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:36 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:36.459068 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b10ef-0c89-431d-9a8e-4f8d69c879ab admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:36.466208 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaeaf78-dd14-4f01-815d-8958bd85ddc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:36.468194 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaeaf78-dd14-4f01-815d-8958bd85ddc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:36.468481 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaeaf78-dd14-4f01-815d-8958bd85ddc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:36.468875 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaeaf78-dd14-4f01-815d-8958bd85ddc8 admin admin] PATH_INFO: `/v3/projects/de7eaf7bf4c247d98d8e57590c97fcd3` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:36.470693 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaeaf78-dd14-4f01-815d-8958bd85ddc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de7eaf7bf4c247d98d8e57590c97fcd3)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:36.477198 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaeaf78-dd14-4f01-815d-8958bd85ddc8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:36.484040 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b10ef-0c89-431d-9a8e-4f8d69c879ab admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:36.491737 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333c06b-d421-4d7d-b8ed-2dee245edbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:36.493781 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333c06b-d421-4d7d-b8ed-2dee245edbe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:36.494233 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333c06b-d421-4d7d-b8ed-2dee245edbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:36.494518 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333c06b-d421-4d7d-b8ed-2dee245edbe2 admin admin] PATH_INFO: `/v3/projects/73d03ff8f09641ccbcc93172836636f2/users/ebc99962f1494b4ab39ccedced417d4e/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:36.517640 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333c06b-d421-4d7d-b8ed-2dee245edbe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d03ff8f09641ccbcc93172836636f2, user_id=ebc99962f1494b4ab39ccedced417d4e, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:36.521562 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333c06b-d421-4d7d-b8ed-2dee245edbe2 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:36.555224 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 975/1953] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:36 2021] PUT /identity/v3/projects/73d03ff8f09641ccbcc93172836636f2/users/ebc99962f1494b4ab39ccedced417d4e/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:36.559377 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333c06b-d421-4d7d-b8ed-2dee245edbe2 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:36.614273 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-dcaeaf78-dd14-4f01-815d-8958bd85ddc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de7eaf7bf4c247d98d8e57590c97fcd3', 'request_id': 'req-dcaeaf78-dd14-4f01-815d-8958bd85ddc8'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:36.639923 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-dcaeaf78-dd14-4f01-815d-8958bd85ddc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de7eaf7bf4c247d98d8e57590c97fcd3', 'request_id': 'req-dcaeaf78-dd14-4f01-815d-8958bd85ddc8'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:36.647760 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-dcaeaf78-dd14-4f01-815d-8958bd85ddc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de7eaf7bf4c247d98d8e57590c97fcd3', 'request_id': 'req-dcaeaf78-dd14-4f01-815d-8958bd85ddc8'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:36.676253 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-dcaeaf78-dd14-4f01-815d-8958bd85ddc8 admin admin] The token cache is being invalidate because project de7eaf7bf4c247d98d8e57590c97fcd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:36.676552 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-dcaeaf78-dd14-4f01-815d-8958bd85ddc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:36.678242 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-dcaeaf78-dd14-4f01-815d-8958bd85ddc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:36.682073 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 979/1954] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:36 2021] DELETE /identity/v3/projects/de7eaf7bf4c247d98d8e57590c97fcd3 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:11:36.687984 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0291c7c-fd53-4b47-9147-911cd0f505ee None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:36.688260 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0291c7c-fd53-4b47-9147-911cd0f505ee None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:36.688734 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0291c7c-fd53-4b47-9147-911cd0f505ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:36.711572 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333c06b-d421-4d7d-b8ed-2dee245edbe2 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:36.733670 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-d0291c7c-fd53-4b47-9147-911cd0f505ee None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:36.735000 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-d0291c7c-fd53-4b47-9147-911cd0f505ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:36.824147 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745a647-3ca4-4930-bfc4-824901770ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:36.824827 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745a647-3ca4-4930-bfc4-824901770ffb admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:36.825108 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745a647-3ca4-4930-bfc4-824901770ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:36.825405 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745a647-3ca4-4930-bfc4-824901770ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:36.826149 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745a647-3ca4-4930-bfc4-824901770ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:36.827759 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745a647-3ca4-4930-bfc4-824901770ffb admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:36.857175 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 976/1955] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:36 2021] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:36.858439 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745a647-3ca4-4930-bfc4-824901770ffb admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:36.860523 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-4745a647-3ca4-4930-bfc4-824901770ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:36.874694 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745a647-3ca4-4930-bfc4-824901770ffb admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:36.878489 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 980/1956] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:36.888321 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa6474-6932-4ea8-8073-344c4f72e80f None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:36.888618 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa6474-6932-4ea8-8073-344c4f72e80f None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:36.888946 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa6474-6932-4ea8-8073-344c4f72e80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:36.889658 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad692c-61a0-4afc-a5fb-ca2b92d3cf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:36.890943 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad692c-61a0-4afc-a5fb-ca2b92d3cf90 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:36.891421 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad692c-61a0-4afc-a5fb-ca2b92d3cf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:36.891876 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad692c-61a0-4afc-a5fb-ca2b92d3cf90 admin admin] PATH_INFO: `/v3/projects/73d03ff8f09641ccbcc93172836636f2/users/ebc99962f1494b4ab39ccedced417d4e/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:36.897929 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad692c-61a0-4afc-a5fb-ca2b92d3cf90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d03ff8f09641ccbcc93172836636f2, user_id=ebc99962f1494b4ab39ccedced417d4e, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:36.904809 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad692c-61a0-4afc-a5fb-ca2b92d3cf90 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:36.918253 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-6baa6474-6932-4ea8-8073-344c4f72e80f None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:36.919778 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-6baa6474-6932-4ea8-8073-344c4f72e80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:36.931571 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 977/1957] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:36 2021] PUT /identity/v3/projects/73d03ff8f09641ccbcc93172836636f2/users/ebc99962f1494b4ab39ccedced417d4e/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:37.008169 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 981/1958] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:37.010025 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad692c-61a0-4afc-a5fb-ca2b92d3cf90 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:37.031702 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad692c-61a0-4afc-a5fb-ca2b92d3cf90 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:37.060311 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03627eae-7858-4530-a16a-a34573efec94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:37.061007 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03627eae-7858-4530-a16a-a34573efec94 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:37.061306 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03627eae-7858-4530-a16a-a34573efec94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:37.061643 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03627eae-7858-4530-a16a-a34573efec94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:37.062413 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03627eae-7858-4530-a16a-a34573efec94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:37.062766 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03627eae-7858-4530-a16a-a34573efec94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:37.066795 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03627eae-7858-4530-a16a-a34573efec94 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:37.106551 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 978/1959] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:11:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:37.110849 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa6474-6932-4ea8-8073-344c4f72e80f None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:37.121008 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa6474-6932-4ea8-8073-344c4f72e80f None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:37.127202 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93004c-d380-4446-a78a-bc1a3461570f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:37.128015 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93004c-d380-4446-a78a-bc1a3461570f admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:37.128461 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93004c-d380-4446-a78a-bc1a3461570f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:37.128743 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93004c-d380-4446-a78a-bc1a3461570f admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:37.129690 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93004c-d380-4446-a78a-bc1a3461570f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:37.134699 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93004c-d380-4446-a78a-bc1a3461570f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:37.199018 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03627eae-7858-4530-a16a-a34573efec94 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:37.209752 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 982/1960] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:37 2021] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:37.210237 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03627eae-7858-4530-a16a-a34573efec94 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:37.363299 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8d467-011b-41ec-a752-1bc163cafc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:37.365141 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8d467-011b-41ec-a752-1bc163cafc84 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:37.365462 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8d467-011b-41ec-a752-1bc163cafc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:37.367500 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8d467-011b-41ec-a752-1bc163cafc84 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:37.369849 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8d467-011b-41ec-a752-1bc163cafc84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:37.374414 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8d467-011b-41ec-a752-1bc163cafc84 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:37.425618 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93004c-d380-4446-a78a-bc1a3461570f admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:37.426061 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 979/1961] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:37 2021] POST /identity/v3/users => generated 290 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:37.441881 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93004c-d380-4446-a78a-bc1a3461570f admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:37.455889 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc5749-0ce7-4e25-b46c-ca836042d357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:37.456585 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc5749-0ce7-4e25-b46c-ca836042d357 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:37.457538 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc5749-0ce7-4e25-b46c-ca836042d357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:37.457538 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc5749-0ce7-4e25-b46c-ca836042d357 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:37.458289 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc5749-0ce7-4e25-b46c-ca836042d357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:37.461855 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc5749-0ce7-4e25-b46c-ca836042d357 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:37.488985 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8d467-011b-41ec-a752-1bc163cafc84 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:37.490159 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 983/1962] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:37 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:37.501725 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8d467-011b-41ec-a752-1bc163cafc84 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:37.512672 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49caeb-1bcd-4dd0-a52f-9b5bc7deaee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:37.513776 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49caeb-1bcd-4dd0-a52f-9b5bc7deaee5 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:37.514057 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49caeb-1bcd-4dd0-a52f-9b5bc7deaee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:37.514668 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49caeb-1bcd-4dd0-a52f-9b5bc7deaee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:37.515100 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49caeb-1bcd-4dd0-a52f-9b5bc7deaee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:37.516699 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49caeb-1bcd-4dd0-a52f-9b5bc7deaee5 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:37.546767 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc5749-0ce7-4e25-b46c-ca836042d357 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:37.563443 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 980/1963] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:37 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:37.567060 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc5749-0ce7-4e25-b46c-ca836042d357 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:37.579190 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e93136-2292-4466-838f-2ce0feeb226f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:37.581643 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e93136-2292-4466-838f-2ce0feeb226f admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:37.582358 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e93136-2292-4466-838f-2ce0feeb226f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:37.582796 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e93136-2292-4466-838f-2ce0feeb226f admin admin] PATH_INFO: `/v3/projects/f32f64f3988042edbf07c65f4ac094b0/users/a1c6314e602245688a36f52fc3030219/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:37.615551 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e93136-2292-4466-838f-2ce0feeb226f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f32f64f3988042edbf07c65f4ac094b0, user_id=a1c6314e602245688a36f52fc3030219, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:37.619504 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e93136-2292-4466-838f-2ce0feeb226f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:37.661374 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bae11b-072a-44f8-bc44-e9a47a932ef2 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:37.661756 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bae11b-072a-44f8-bc44-e9a47a932ef2 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:37.661836 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 984/1964] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:37 2021] PUT /identity/v3/projects/f32f64f3988042edbf07c65f4ac094b0/users/a1c6314e602245688a36f52fc3030219/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:37.662013 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bae11b-072a-44f8-bc44-e9a47a932ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:37.727225 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-c0bae11b-072a-44f8-bc44-e9a47a932ef2 None None] MFA Rules not processed for user `a1c6314e602245688a36f52fc3030219`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:37.727225 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c0bae11b-072a-44f8-bc44-e9a47a932ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:37.888839 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 981/1965] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:37 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:37.893507 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e93136-2292-4466-838f-2ce0feeb226f admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:37.984441 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e93136-2292-4466-838f-2ce0feeb226f admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:38.004451 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1fb07-dbd1-456b-bd3f-574ddeaf3830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:38.005040 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1fb07-dbd1-456b-bd3f-574ddeaf3830 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:38.005324 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1fb07-dbd1-456b-bd3f-574ddeaf3830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:38.005627 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1fb07-dbd1-456b-bd3f-574ddeaf3830 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:38.006337 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1fb07-dbd1-456b-bd3f-574ddeaf3830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:38.008983 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1fb07-dbd1-456b-bd3f-574ddeaf3830 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:38.061480 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 985/1966] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:37 2021] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:11:38.063160 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bae11b-072a-44f8-bc44-e9a47a932ef2 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:38.084513 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bae11b-072a-44f8-bc44-e9a47a932ef2 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:38.232623 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776bde2-76fa-4bee-a926-fe993c196af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:38.235452 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776bde2-76fa-4bee-a926-fe993c196af4 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:38.235763 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776bde2-76fa-4bee-a926-fe993c196af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:38.236378 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776bde2-76fa-4bee-a926-fe993c196af4 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:38.236786 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776bde2-76fa-4bee-a926-fe993c196af4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:38.245629 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776bde2-76fa-4bee-a926-fe993c196af4 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:38.295713 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1fb07-dbd1-456b-bd3f-574ddeaf3830 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:38.296611 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 982/1967] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:38 2021] POST /identity/v3/users => generated 297 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:38.307855 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1fb07-dbd1-456b-bd3f-574ddeaf3830 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:38.312763 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c8154-14bd-430a-b3ce-2e892f764228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:38.313475 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c8154-14bd-430a-b3ce-2e892f764228 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:38.313763 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c8154-14bd-430a-b3ce-2e892f764228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:38.314043 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c8154-14bd-430a-b3ce-2e892f764228 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:38.314835 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c8154-14bd-430a-b3ce-2e892f764228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:38.316555 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c8154-14bd-430a-b3ce-2e892f764228 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:38.334564 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 986/1968] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:38 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:38.336490 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776bde2-76fa-4bee-a926-fe993c196af4 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:38.348136 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776bde2-76fa-4bee-a926-fe993c196af4 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:38.353869 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf261a7-73ce-43cf-bcf2-4357f6be8c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:38.354900 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf261a7-73ce-43cf-bcf2-4357f6be8c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:38.355196 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf261a7-73ce-43cf-bcf2-4357f6be8c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:38.355460 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf261a7-73ce-43cf-bcf2-4357f6be8c04 admin admin] PATH_INFO: `/v3/projects/128a4614c4c14a4cb989e72f7ad969f5/users/99671ecdaaca4addaddcbec560e61fe5/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:38.376062 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf261a7-73ce-43cf-bcf2-4357f6be8c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=128a4614c4c14a4cb989e72f7ad969f5, user_id=99671ecdaaca4addaddcbec560e61fe5, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:38.378798 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf261a7-73ce-43cf-bcf2-4357f6be8c04 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:38.455431 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 983/1969] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:38 2021] PUT /identity/v3/projects/128a4614c4c14a4cb989e72f7ad969f5/users/99671ecdaaca4addaddcbec560e61fe5/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:11:38.459708 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c8154-14bd-430a-b3ce-2e892f764228 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:38.470923 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf261a7-73ce-43cf-bcf2-4357f6be8c04 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:38.489651 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c8154-14bd-430a-b3ce-2e892f764228 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:38.491512 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-abf261a7-73ce-43cf-bcf2-4357f6be8c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:38.626734 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd39d61-ed4f-4b3f-ac0b-b13e6cd9291b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:38.628714 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd39d61-ed4f-4b3f-ac0b-b13e6cd9291b admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:38.629172 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd39d61-ed4f-4b3f-ac0b-b13e6cd9291b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:38.629626 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd39d61-ed4f-4b3f-ac0b-b13e6cd9291b admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:38.630537 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd39d61-ed4f-4b3f-ac0b-b13e6cd9291b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:38.632416 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd39d61-ed4f-4b3f-ac0b-b13e6cd9291b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:38.650139 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf261a7-73ce-43cf-bcf2-4357f6be8c04 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:38.651143 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 987/1970] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:38 2021] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:38.655414 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd39d61-ed4f-4b3f-ac0b-b13e6cd9291b admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:38.660583 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af812c0-0600-4e02-9e6b-b001c16649cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:38.663281 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af812c0-0600-4e02-9e6b-b001c16649cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:38.664515 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af812c0-0600-4e02-9e6b-b001c16649cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:38.665173 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af812c0-0600-4e02-9e6b-b001c16649cc admin admin] PATH_INFO: `/v3/users/c919f38afff54924b40b8206f80c8ec4` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:38.667258 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af812c0-0600-4e02-9e6b-b001c16649cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c919f38afff54924b40b8206f80c8ec4)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:38.668375 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd39d61-ed4f-4b3f-ac0b-b13e6cd9291b admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:38.670126 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af812c0-0600-4e02-9e6b-b001c16649cc admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:38.673583 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a275a8-7f16-4ffa-b1bf-4dcc4a51ec4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:38.674779 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a275a8-7f16-4ffa-b1bf-4dcc4a51ec4f admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:38.676014 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a275a8-7f16-4ffa-b1bf-4dcc4a51ec4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:38.676293 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a275a8-7f16-4ffa-b1bf-4dcc4a51ec4f admin admin] PATH_INFO: `/v3/projects/128a4614c4c14a4cb989e72f7ad969f5/users/99671ecdaaca4addaddcbec560e61fe5/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:38.681810 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a275a8-7f16-4ffa-b1bf-4dcc4a51ec4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=128a4614c4c14a4cb989e72f7ad969f5, user_id=99671ecdaaca4addaddcbec560e61fe5, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:38.684506 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a275a8-7f16-4ffa-b1bf-4dcc4a51ec4f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:38.703575 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 988/1971] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:38 2021] PUT /identity/v3/projects/128a4614c4c14a4cb989e72f7ad969f5/users/99671ecdaaca4addaddcbec560e61fe5/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:38.714875 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8b4fe-7c48-4b0c-918f-663552525faa None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:38.717831 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8b4fe-7c48-4b0c-918f-663552525faa None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:38.718633 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8b4fe-7c48-4b0c-918f-663552525faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:38.752038 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-3af812c0-0600-4e02-9e6b-b001c16649cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c919f38afff54924b40b8206f80c8ec4'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:38.753742 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-3af812c0-0600-4e02-9e6b-b001c16649cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c919f38afff54924b40b8206f80c8ec4'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:38.755111 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-3af812c0-0600-4e02-9e6b-b001c16649cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c919f38afff54924b40b8206f80c8ec4'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:38.760217 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-0be8b4fe-7c48-4b0c-918f-663552525faa None None] MFA Rules not processed for user `99671ecdaaca4addaddcbec560e61fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:38.761850 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-0be8b4fe-7c48-4b0c-918f-663552525faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:38.796418 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-3af812c0-0600-4e02-9e6b-b001c16649cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c919f38afff54924b40b8206f80c8ec4'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:38.813255 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-3af812c0-0600-4e02-9e6b-b001c16649cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c919f38afff54924b40b8206f80c8ec4'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:38.842621 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 984/1972] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:38 2021] DELETE /identity/v3/users/c919f38afff54924b40b8206f80c8ec4 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:38.844337 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b498923-b7f0-4403-b05e-950eba7dc5eb None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:38.845590 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b498923-b7f0-4403-b05e-950eba7dc5eb None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:38.847187 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b498923-b7f0-4403-b05e-950eba7dc5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:38.881856 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-0b498923-b7f0-4403-b05e-950eba7dc5eb None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:38.884135 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-0b498923-b7f0-4403-b05e-950eba7dc5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:38.890089 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 989/1973] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:38 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:38.906951 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8b4fe-7c48-4b0c-918f-663552525faa None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:38.909038 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-0be8b4fe-7c48-4b0c-918f-663552525faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:38.974081 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 985/1974] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:38.982694 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b498923-b7f0-4403-b05e-950eba7dc5eb None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:38.985611 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-0b498923-b7f0-4403-b05e-950eba7dc5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:39.024598 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8b4fe-7c48-4b0c-918f-663552525faa None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:39.030076 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343485e-5aaa-4ef9-b41e-fcca6339ec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:39.031012 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343485e-5aaa-4ef9-b41e-fcca6339ec67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:39.031305 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343485e-5aaa-4ef9-b41e-fcca6339ec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:39.031789 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343485e-5aaa-4ef9-b41e-fcca6339ec67 admin admin] PATH_INFO: `/v3/users/a1c6314e602245688a36f52fc3030219` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:39.033609 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343485e-5aaa-4ef9-b41e-fcca6339ec67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1c6314e602245688a36f52fc3030219)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:39.035699 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343485e-5aaa-4ef9-b41e-fcca6339ec67 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:39.114853 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-8343485e-5aaa-4ef9-b41e-fcca6339ec67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1c6314e602245688a36f52fc3030219'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:39.115610 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-8343485e-5aaa-4ef9-b41e-fcca6339ec67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1c6314e602245688a36f52fc3030219'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:39.127449 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-8343485e-5aaa-4ef9-b41e-fcca6339ec67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1c6314e602245688a36f52fc3030219'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:39.127793 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-8343485e-5aaa-4ef9-b41e-fcca6339ec67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1c6314e602245688a36f52fc3030219'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:39.138692 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b498923-b7f0-4403-b05e-950eba7dc5eb None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:39.143340 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-8343485e-5aaa-4ef9-b41e-fcca6339ec67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1c6314e602245688a36f52fc3030219'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:39.152546 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12daacea-3f09-4326-863b-8995955e8139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:39.153217 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12daacea-3f09-4326-863b-8995955e8139 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:39.153567 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12daacea-3f09-4326-863b-8995955e8139 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:39.157670 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12daacea-3f09-4326-863b-8995955e8139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:39.161081 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 990/1975] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:38 2021] DELETE /identity/v3/users/a1c6314e602245688a36f52fc3030219 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:39.163443 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-12daacea-3f09-4326-863b-8995955e8139 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:39.164542 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a415c7e-9d67-4875-b3b2-0c03ef18d52f None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:39.164889 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a415c7e-9d67-4875-b3b2-0c03ef18d52f None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:39.165364 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a415c7e-9d67-4875-b3b2-0c03ef18d52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:39.187111 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-9a415c7e-9d67-4875-b3b2-0c03ef18d52f None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:39.188475 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-9a415c7e-9d67-4875-b3b2-0c03ef18d52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:39.193895 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12daacea-3f09-4326-863b-8995955e8139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:39.195532 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12daacea-3f09-4326-863b-8995955e8139 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:39.222891 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 986/1976] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:11:39.287109 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 991/1977] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:11:39.347236 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12daacea-3f09-4326-863b-8995955e8139 service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:39.348809 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-12daacea-3f09-4326-863b-8995955e8139 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:39.370886 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12daacea-3f09-4326-863b-8995955e8139 service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:39.472158 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4cf57-f229-4bcd-bd80-d3f583666502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:39.473606 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4cf57-f229-4bcd-bd80-d3f583666502 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:39.474101 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4cf57-f229-4bcd-bd80-d3f583666502 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:39.474691 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4cf57-f229-4bcd-bd80-d3f583666502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:39.488753 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4cf57-f229-4bcd-bd80-d3f583666502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:39.490576 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d4cf57-f229-4bcd-bd80-d3f583666502 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:39.507927 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 987/1978] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:39.715519 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a415c7e-9d67-4875-b3b2-0c03ef18d52f None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:39.717018 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-9a415c7e-9d67-4875-b3b2-0c03ef18d52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:39.730708 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a415c7e-9d67-4875-b3b2-0c03ef18d52f None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:39.743675 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dab17b-51a4-4405-9339-e1337c777f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:39.744995 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dab17b-51a4-4405-9339-e1337c777f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:39.745686 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dab17b-51a4-4405-9339-e1337c777f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:39.746829 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dab17b-51a4-4405-9339-e1337c777f87 admin admin] PATH_INFO: `/v3/projects/f7d1407cfc40425bb01f950031f39a66` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:39.753104 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dab17b-51a4-4405-9339-e1337c777f87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7d1407cfc40425bb01f950031f39a66)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:39.762422 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dab17b-51a4-4405-9339-e1337c777f87 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:39.828941 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-43dab17b-51a4-4405-9339-e1337c777f87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7d1407cfc40425bb01f950031f39a66', 'request_id': 'req-43dab17b-51a4-4405-9339-e1337c777f87'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:39.839377 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-43dab17b-51a4-4405-9339-e1337c777f87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7d1407cfc40425bb01f950031f39a66', 'request_id': 'req-43dab17b-51a4-4405-9339-e1337c777f87'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:39.849045 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-43dab17b-51a4-4405-9339-e1337c777f87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7d1407cfc40425bb01f950031f39a66', 'request_id': 'req-43dab17b-51a4-4405-9339-e1337c777f87'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:39.865656 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-43dab17b-51a4-4405-9339-e1337c777f87 admin admin] The token cache is being invalidate because project f7d1407cfc40425bb01f950031f39a66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:39.865960 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-43dab17b-51a4-4405-9339-e1337c777f87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:39.866623 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-43dab17b-51a4-4405-9339-e1337c777f87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:39.868754 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 992/1979] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:39 2021] DELETE /identity/v3/projects/f7d1407cfc40425bb01f950031f39a66 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:11:39.874430 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d6b8b-0ae0-484d-8435-56840a343fcb None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:39.874856 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d6b8b-0ae0-484d-8435-56840a343fcb None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:39.875038 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d6b8b-0ae0-484d-8435-56840a343fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:39.919374 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-156d6b8b-0ae0-484d-8435-56840a343fcb None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:39.920939 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-156d6b8b-0ae0-484d-8435-56840a343fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:40.031421 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 988/1980] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:40.046585 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af7435-9b99-4921-adc4-849e3abd3b32 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:40.046906 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af7435-9b99-4921-adc4-849e3abd3b32 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:40.047138 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af7435-9b99-4921-adc4-849e3abd3b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:40.082917 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-f8af7435-9b99-4921-adc4-849e3abd3b32 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:40.084262 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-f8af7435-9b99-4921-adc4-849e3abd3b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:40.111523 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 993/1981] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:40.115600 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d6b8b-0ae0-484d-8435-56840a343fcb None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:40.129575 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d6b8b-0ae0-484d-8435-56840a343fcb None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:40.158299 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af7435-9b99-4921-adc4-849e3abd3b32 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:40.159054 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2e268-ccd4-49f6-90a2-6bd64f613569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:40.159746 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2e268-ccd4-49f6-90a2-6bd64f613569 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:40.160469 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2e268-ccd4-49f6-90a2-6bd64f613569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:40.160469 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2e268-ccd4-49f6-90a2-6bd64f613569 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:40.161034 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2e268-ccd4-49f6-90a2-6bd64f613569 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:40.161338 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2e268-ccd4-49f6-90a2-6bd64f613569 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:40.163064 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2e268-ccd4-49f6-90a2-6bd64f613569 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:40.166495 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-f8af7435-9b99-4921-adc4-849e3abd3b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:40.191599 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af7435-9b99-4921-adc4-849e3abd3b32 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:40.202196 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9e3c5-f5e8-40a5-b6e9-3f41729373cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:40.207100 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9e3c5-f5e8-40a5-b6e9-3f41729373cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:40.207506 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9e3c5-f5e8-40a5-b6e9-3f41729373cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:40.207906 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9e3c5-f5e8-40a5-b6e9-3f41729373cd admin admin] PATH_INFO: `/v3/projects/f32f64f3988042edbf07c65f4ac094b0` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:40.213097 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 989/1982] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:11:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:40.214249 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2e268-ccd4-49f6-90a2-6bd64f613569 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:40.215150 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9e3c5-f5e8-40a5-b6e9-3f41729373cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f32f64f3988042edbf07c65f4ac094b0)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:40.217098 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9e3c5-f5e8-40a5-b6e9-3f41729373cd admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:40.232461 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2e268-ccd4-49f6-90a2-6bd64f613569 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:40.246079 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb3008-e1f9-4cdb-bf8f-cdf06e102e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:40.246834 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb3008-e1f9-4cdb-bf8f-cdf06e102e2c admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:40.247010 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb3008-e1f9-4cdb-bf8f-cdf06e102e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:40.247318 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb3008-e1f9-4cdb-bf8f-cdf06e102e2c admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:40.247989 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb3008-e1f9-4cdb-bf8f-cdf06e102e2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:40.259407 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb3008-e1f9-4cdb-bf8f-cdf06e102e2c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:40.325423 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 990/1983] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:40 2021] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:40.328589 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb3008-e1f9-4cdb-bf8f-cdf06e102e2c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:40.333525 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-3ef9e3c5-f5e8-40a5-b6e9-3f41729373cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f32f64f3988042edbf07c65f4ac094b0', 'request_id': 'req-3ef9e3c5-f5e8-40a5-b6e9-3f41729373cd'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:40.345766 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-3ef9e3c5-f5e8-40a5-b6e9-3f41729373cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f32f64f3988042edbf07c65f4ac094b0', 'request_id': 'req-3ef9e3c5-f5e8-40a5-b6e9-3f41729373cd'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:40.358576 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-3ef9e3c5-f5e8-40a5-b6e9-3f41729373cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f32f64f3988042edbf07c65f4ac094b0', 'request_id': 'req-3ef9e3c5-f5e8-40a5-b6e9-3f41729373cd'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:40.380708 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-3ef9e3c5-f5e8-40a5-b6e9-3f41729373cd admin admin] The token cache is being invalidate because project f32f64f3988042edbf07c65f4ac094b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:40.380999 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-3ef9e3c5-f5e8-40a5-b6e9-3f41729373cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:40.382472 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-3ef9e3c5-f5e8-40a5-b6e9-3f41729373cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:40.395493 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 994/1984] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:40 2021] DELETE /identity/v3/projects/f32f64f3988042edbf07c65f4ac094b0 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:11:40.404506 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9e3c5-f5e8-40a5-b6e9-3f41729373cd admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:40.408643 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-3ef9e3c5-f5e8-40a5-b6e9-3f41729373cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:40.445939 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb3008-e1f9-4cdb-bf8f-cdf06e102e2c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:40.453800 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc3c48-4268-4123-96ee-c3a704ceb50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:40.455348 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc3c48-4268-4123-96ee-c3a704ceb50a admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:40.455805 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc3c48-4268-4123-96ee-c3a704ceb50a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:40.456242 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc3c48-4268-4123-96ee-c3a704ceb50a admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:40.457316 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc3c48-4268-4123-96ee-c3a704ceb50a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:40.461422 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc3c48-4268-4123-96ee-c3a704ceb50a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:40.494569 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 991/1985] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:40 2021] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:40.498175 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc3c48-4268-4123-96ee-c3a704ceb50a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:40.499989 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-2cfc3c48-4268-4123-96ee-c3a704ceb50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:40.521119 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc3c48-4268-4123-96ee-c3a704ceb50a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:40.535083 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3feccf3-78d5-4229-9de0-12608ea5e05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:40.535769 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3feccf3-78d5-4229-9de0-12608ea5e05a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:40.536056 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3feccf3-78d5-4229-9de0-12608ea5e05a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:40.536339 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3feccf3-78d5-4229-9de0-12608ea5e05a admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:40.537083 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3feccf3-78d5-4229-9de0-12608ea5e05a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:40.538765 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3feccf3-78d5-4229-9de0-12608ea5e05a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:40.551295 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 992/1986] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:40 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:40.555615 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9e3c5-f5e8-40a5-b6e9-3f41729373cd admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:40.556702 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3feccf3-78d5-4229-9de0-12608ea5e05a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:40.562671 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f332d-679f-4861-ba54-3988edcf15a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:40.564596 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f332d-679f-4861-ba54-3988edcf15a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:40.565226 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f332d-679f-4861-ba54-3988edcf15a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:40.565875 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f332d-679f-4861-ba54-3988edcf15a8 admin admin] PATH_INFO: `/v3/users/99671ecdaaca4addaddcbec560e61fe5` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:40.568124 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3feccf3-78d5-4229-9de0-12608ea5e05a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:40.568251 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f332d-679f-4861-ba54-3988edcf15a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99671ecdaaca4addaddcbec560e61fe5)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:40.572057 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f332d-679f-4861-ba54-3988edcf15a8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:40.574071 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244104f4-41e9-4f66-bb21-0e4ce67be23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:40.575045 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244104f4-41e9-4f66-bb21-0e4ce67be23c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:40.575475 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244104f4-41e9-4f66-bb21-0e4ce67be23c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:40.575901 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244104f4-41e9-4f66-bb21-0e4ce67be23c admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:40.576785 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244104f4-41e9-4f66-bb21-0e4ce67be23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:40.578816 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244104f4-41e9-4f66-bb21-0e4ce67be23c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:40.594226 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 993/1987] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:40 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:40.595463 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244104f4-41e9-4f66-bb21-0e4ce67be23c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:40.607310 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244104f4-41e9-4f66-bb21-0e4ce67be23c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:40.615421 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b83787-125d-4d36-9fdf-5822dfd4a34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:40.616397 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b83787-125d-4d36-9fdf-5822dfd4a34c admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:40.616677 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b83787-125d-4d36-9fdf-5822dfd4a34c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:40.617633 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b83787-125d-4d36-9fdf-5822dfd4a34c admin admin] PATH_INFO: `/v3/projects/27b15d4316704cdcad0ad543faef625e/users/4753209e143d4633a4e40f09bd4b5da7/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:40.664805 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b83787-125d-4d36-9fdf-5822dfd4a34c admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b15d4316704cdcad0ad543faef625e, user_id=4753209e143d4633a4e40f09bd4b5da7, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:40.667598 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b83787-125d-4d36-9fdf-5822dfd4a34c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:40.670537 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-a51f332d-679f-4861-ba54-3988edcf15a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99671ecdaaca4addaddcbec560e61fe5'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:40.672099 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-a51f332d-679f-4861-ba54-3988edcf15a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99671ecdaaca4addaddcbec560e61fe5'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:40.692349 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-a51f332d-679f-4861-ba54-3988edcf15a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99671ecdaaca4addaddcbec560e61fe5'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:40.693107 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-a51f332d-679f-4861-ba54-3988edcf15a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99671ecdaaca4addaddcbec560e61fe5'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:40.699555 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 994/1988] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:40 2021] PUT /identity/v3/projects/27b15d4316704cdcad0ad543faef625e/users/4753209e143d4633a4e40f09bd4b5da7/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:40.712699 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-a51f332d-679f-4861-ba54-3988edcf15a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99671ecdaaca4addaddcbec560e61fe5'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:40.713960 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961166f-8014-45dc-807c-34d362535443 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:40.714766 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961166f-8014-45dc-807c-34d362535443 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:40.715131 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961166f-8014-45dc-807c-34d362535443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:40.734431 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 995/1989] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:40 2021] DELETE /identity/v3/users/99671ecdaaca4addaddcbec560e61fe5 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:40.753847 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-1961166f-8014-45dc-807c-34d362535443 None None] MFA Rules not processed for user `4753209e143d4633a4e40f09bd4b5da7`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:40.755977 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-1961166f-8014-45dc-807c-34d362535443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:40.855082 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 995/1990] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:40 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:40.865551 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f332d-679f-4861-ba54-3988edcf15a8 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:40.867527 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-a51f332d-679f-4861-ba54-3988edcf15a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:40.941451 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f332d-679f-4861-ba54-3988edcf15a8 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:40.947034 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a654b4-18f1-404b-b4ab-44dd3f535fc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:40.947835 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a654b4-18f1-404b-b4ab-44dd3f535fc4 service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:40.948214 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a654b4-18f1-404b-b4ab-44dd3f535fc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:40.948585 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a654b4-18f1-404b-b4ab-44dd3f535fc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:40.958732 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a654b4-18f1-404b-b4ab-44dd3f535fc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:40.960198 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a654b4-18f1-404b-b4ab-44dd3f535fc4 service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:40.970753 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 996/1991] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:40 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:41.113229 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961166f-8014-45dc-807c-34d362535443 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:41.115446 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-1961166f-8014-45dc-807c-34d362535443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:41.237214 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961166f-8014-45dc-807c-34d362535443 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:41.244742 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0eb7cc-dd97-454d-bec7-79c0f3982b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:41.245794 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0eb7cc-dd97-454d-bec7-79c0f3982b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:41.246148 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0eb7cc-dd97-454d-bec7-79c0f3982b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:41.246502 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0eb7cc-dd97-454d-bec7-79c0f3982b8f admin admin] PATH_INFO: `/v3/projects/128a4614c4c14a4cb989e72f7ad969f5` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:41.248259 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0eb7cc-dd97-454d-bec7-79c0f3982b8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=128a4614c4c14a4cb989e72f7ad969f5)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:41.250605 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0eb7cc-dd97-454d-bec7-79c0f3982b8f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:41.350909 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4a0eb7cc-dd97-454d-bec7-79c0f3982b8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '128a4614c4c14a4cb989e72f7ad969f5', 'request_id': 'req-4a0eb7cc-dd97-454d-bec7-79c0f3982b8f'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:41.370933 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4a0eb7cc-dd97-454d-bec7-79c0f3982b8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '128a4614c4c14a4cb989e72f7ad969f5', 'request_id': 'req-4a0eb7cc-dd97-454d-bec7-79c0f3982b8f'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:41.377501 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4a0eb7cc-dd97-454d-bec7-79c0f3982b8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '128a4614c4c14a4cb989e72f7ad969f5', 'request_id': 'req-4a0eb7cc-dd97-454d-bec7-79c0f3982b8f'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:41.394575 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4a0eb7cc-dd97-454d-bec7-79c0f3982b8f admin admin] The token cache is being invalidate because project 128a4614c4c14a4cb989e72f7ad969f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:41.394900 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4a0eb7cc-dd97-454d-bec7-79c0f3982b8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:41.395750 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4a0eb7cc-dd97-454d-bec7-79c0f3982b8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:41.397693 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 996/1992] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:41 2021] DELETE /identity/v3/projects/128a4614c4c14a4cb989e72f7ad969f5 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:41.403884 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31175cd-8b54-4d93-8f42-e7213260ddb3 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:41.404176 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31175cd-8b54-4d93-8f42-e7213260ddb3 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:41.404469 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31175cd-8b54-4d93-8f42-e7213260ddb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:41.448899 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-d31175cd-8b54-4d93-8f42-e7213260ddb3 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:41.450232 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-d31175cd-8b54-4d93-8f42-e7213260ddb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:41.589480 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 997/1993] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:41.597004 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5634dc-7d30-479a-b612-d8fedc355297 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:41.597428 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5634dc-7d30-479a-b612-d8fedc355297 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:41.597854 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5634dc-7d30-479a-b612-d8fedc355297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:41.626397 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-db5634dc-7d30-479a-b612-d8fedc355297 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:41.628091 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-db5634dc-7d30-479a-b612-d8fedc355297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:41.646469 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 997/1994] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:41.647203 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31175cd-8b54-4d93-8f42-e7213260ddb3 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:41.659429 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31175cd-8b54-4d93-8f42-e7213260ddb3 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:41.668757 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77b484-caf4-4aef-aad4-71f5336a5da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:41.668757 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77b484-caf4-4aef-aad4-71f5336a5da5 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:41.668757 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77b484-caf4-4aef-aad4-71f5336a5da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:41.668757 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77b484-caf4-4aef-aad4-71f5336a5da5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:41.669837 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77b484-caf4-4aef-aad4-71f5336a5da5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:41.670262 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77b484-caf4-4aef-aad4-71f5336a5da5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:41.672787 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77b484-caf4-4aef-aad4-71f5336a5da5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:41.697198 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 998/1995] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:11:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:11:41.701337 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5634dc-7d30-479a-b612-d8fedc355297 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:41.721705 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5634dc-7d30-479a-b612-d8fedc355297 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:41.738334 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7edd7-c815-4e9c-8878-346f5cb174e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:41.739478 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7edd7-c815-4e9c-8878-346f5cb174e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:41.739947 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7edd7-c815-4e9c-8878-346f5cb174e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:41.740614 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7edd7-c815-4e9c-8878-346f5cb174e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:41.742620 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7edd7-c815-4e9c-8878-346f5cb174e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:41.751818 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7edd7-c815-4e9c-8878-346f5cb174e8 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:41.797420 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 998/1996] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:41 2021] POST /identity/v3/projects => generated 363 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:41.801055 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77b484-caf4-4aef-aad4-71f5336a5da5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:41.812250 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77b484-caf4-4aef-aad4-71f5336a5da5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:41.877250 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e049729-9a40-4524-a21b-119eaec72be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:41.877966 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e049729-9a40-4524-a21b-119eaec72be9 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:41.878248 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e049729-9a40-4524-a21b-119eaec72be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:41.878524 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e049729-9a40-4524-a21b-119eaec72be9 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:41.879339 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e049729-9a40-4524-a21b-119eaec72be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:41.881280 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e049729-9a40-4524-a21b-119eaec72be9 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:41.908111 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 999/1997] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:41 2021] POST /identity/v3/users => generated 282 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:41.911857 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7edd7-c815-4e9c-8878-346f5cb174e8 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:41.924470 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7edd7-c815-4e9c-8878-346f5cb174e8 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:41.930156 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c2200-6ec2-47c5-9740-76652ec5a4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:41.930841 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c2200-6ec2-47c5-9740-76652ec5a4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:41.931124 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c2200-6ec2-47c5-9740-76652ec5a4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:41.931393 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c2200-6ec2-47c5-9740-76652ec5a4e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:41.932148 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c2200-6ec2-47c5-9740-76652ec5a4e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:41.934494 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c2200-6ec2-47c5-9740-76652ec5a4e8 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:41.952873 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e049729-9a40-4524-a21b-119eaec72be9 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:41.960274 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 999/1998] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:41 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:41.964808 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e049729-9a40-4524-a21b-119eaec72be9 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:41.971312 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1904b61-f470-4683-85e8-61fd19dd73e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:41.971997 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1904b61-f470-4683-85e8-61fd19dd73e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:41.972276 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1904b61-f470-4683-85e8-61fd19dd73e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:41.973119 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1904b61-f470-4683-85e8-61fd19dd73e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:41.973941 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1904b61-f470-4683-85e8-61fd19dd73e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:41.975904 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1904b61-f470-4683-85e8-61fd19dd73e6 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:42.008693 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1000/1999] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:41 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:42.014593 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c2200-6ec2-47c5-9740-76652ec5a4e8 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:42.030352 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c2200-6ec2-47c5-9740-76652ec5a4e8 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:42.051714 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e57a9-9f76-4ae3-a971-ce3e07467ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:42.052627 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e57a9-9f76-4ae3-a971-ce3e07467ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:42.053046 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e57a9-9f76-4ae3-a971-ce3e07467ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:42.053330 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e57a9-9f76-4ae3-a971-ce3e07467ae1 admin admin] PATH_INFO: `/v3/projects/73aab94df1de47578973edb76979fd77/users/9c13e41c0299477682bd838fde9e1f14/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:42.090017 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e57a9-9f76-4ae3-a971-ce3e07467ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73aab94df1de47578973edb76979fd77, user_id=9c13e41c0299477682bd838fde9e1f14, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:42.095364 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e57a9-9f76-4ae3-a971-ce3e07467ae1 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:42.114769 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1000/2000] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:42 2021] PUT /identity/v3/projects/73aab94df1de47578973edb76979fd77/users/9c13e41c0299477682bd838fde9e1f14/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:42.126617 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1bb8d-0fce-47ff-91c7-2b12b0f2d240 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:42.127058 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1bb8d-0fce-47ff-91c7-2b12b0f2d240 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:42.127333 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1bb8d-0fce-47ff-91c7-2b12b0f2d240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:42.162018 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-34c1bb8d-0fce-47ff-91c7-2b12b0f2d240 None None] MFA Rules not processed for user `9c13e41c0299477682bd838fde9e1f14`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:42.163327 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-34c1bb8d-0fce-47ff-91c7-2b12b0f2d240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:42.250447 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1001/2001] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:42 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:42.256148 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e57a9-9f76-4ae3-a971-ce3e07467ae1 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:42.349502 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e57a9-9f76-4ae3-a971-ce3e07467ae1 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:42.355621 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911de24b-e016-4368-87eb-39b577f2c301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:42.356571 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911de24b-e016-4368-87eb-39b577f2c301 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:42.356854 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911de24b-e016-4368-87eb-39b577f2c301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:42.357134 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911de24b-e016-4368-87eb-39b577f2c301 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:42.358346 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911de24b-e016-4368-87eb-39b577f2c301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:42.360710 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911de24b-e016-4368-87eb-39b577f2c301 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:42.424869 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1bb8d-0fce-47ff-91c7-2b12b0f2d240 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:42.426827 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1001/2002] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:42 2021] POST /identity/v3/projects => generated 363 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:42.440306 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1bb8d-0fce-47ff-91c7-2b12b0f2d240 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:42.584758 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188d759-6bc7-42fd-afc0-31aabd76b8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:42.587280 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188d759-6bc7-42fd-afc0-31aabd76b8c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:42.588240 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188d759-6bc7-42fd-afc0-31aabd76b8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:42.589620 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188d759-6bc7-42fd-afc0-31aabd76b8c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:42.591530 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188d759-6bc7-42fd-afc0-31aabd76b8c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:42.594312 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188d759-6bc7-42fd-afc0-31aabd76b8c2 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:42.645340 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1002/2003] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:42 2021] POST /identity/v3/users => generated 288 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:42.646586 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911de24b-e016-4368-87eb-39b577f2c301 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:42.664240 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911de24b-e016-4368-87eb-39b577f2c301 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:42.698746 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275dc05-c136-417f-9a6e-a1dffd45cdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:42.699445 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275dc05-c136-417f-9a6e-a1dffd45cdd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:42.699738 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275dc05-c136-417f-9a6e-a1dffd45cdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:42.700022 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275dc05-c136-417f-9a6e-a1dffd45cdd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:42.701843 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275dc05-c136-417f-9a6e-a1dffd45cdd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:42.703485 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275dc05-c136-417f-9a6e-a1dffd45cdd2 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:42.752861 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1002/2004] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:42 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:42.757083 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188d759-6bc7-42fd-afc0-31aabd76b8c2 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:42.774231 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188d759-6bc7-42fd-afc0-31aabd76b8c2 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:42.785306 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973cc1a-f656-4c0a-87fa-4b0437ea39ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:42.787171 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973cc1a-f656-4c0a-87fa-4b0437ea39ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:42.787171 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973cc1a-f656-4c0a-87fa-4b0437ea39ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:42.792884 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973cc1a-f656-4c0a-87fa-4b0437ea39ae admin admin] PATH_INFO: `/v3/projects/d99c9f518c3f4847aeaf02ceceb0f905/users/04efde36b3cf420ebb26036462527426/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:42.818256 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973cc1a-f656-4c0a-87fa-4b0437ea39ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=d99c9f518c3f4847aeaf02ceceb0f905, user_id=04efde36b3cf420ebb26036462527426, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:42.822252 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973cc1a-f656-4c0a-87fa-4b0437ea39ae admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:42.844709 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1003/2005] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:42 2021] PUT /identity/v3/projects/d99c9f518c3f4847aeaf02ceceb0f905/users/04efde36b3cf420ebb26036462527426/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:42.848775 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275dc05-c136-417f-9a6e-a1dffd45cdd2 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:42.863128 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275dc05-c136-417f-9a6e-a1dffd45cdd2 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:42.956567 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfd271-30a7-49c3-a343-e42392944036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:42.957897 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfd271-30a7-49c3-a343-e42392944036 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:42.958237 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfd271-30a7-49c3-a343-e42392944036 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:42.958575 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfd271-30a7-49c3-a343-e42392944036 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:42.959838 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfd271-30a7-49c3-a343-e42392944036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:42.963685 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfd271-30a7-49c3-a343-e42392944036 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:42.978507 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1003/2006] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:42 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:42.983774 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973cc1a-f656-4c0a-87fa-4b0437ea39ae admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:42.996751 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973cc1a-f656-4c0a-87fa-4b0437ea39ae admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:43.014584 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6f3aa-9545-463a-a69e-00469987613b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:43.015483 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6f3aa-9545-463a-a69e-00469987613b admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:43.016206 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6f3aa-9545-463a-a69e-00469987613b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:43.016460 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6f3aa-9545-463a-a69e-00469987613b admin admin] PATH_INFO: `/v3/projects/d99c9f518c3f4847aeaf02ceceb0f905/users/04efde36b3cf420ebb26036462527426/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:43.019785 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6f3aa-9545-463a-a69e-00469987613b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d99c9f518c3f4847aeaf02ceceb0f905, user_id=04efde36b3cf420ebb26036462527426, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:43.022536 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6f3aa-9545-463a-a69e-00469987613b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:43.057312 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1004/2007] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:42 2021] PUT /identity/v3/projects/d99c9f518c3f4847aeaf02ceceb0f905/users/04efde36b3cf420ebb26036462527426/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:43.064937 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9af5b-718f-4640-bcf6-98bf1dfc391f None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:43.065240 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9af5b-718f-4640-bcf6-98bf1dfc391f None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:43.065563 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9af5b-718f-4640-bcf6-98bf1dfc391f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:43.107883 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-5af9af5b-718f-4640-bcf6-98bf1dfc391f None None] MFA Rules not processed for user `04efde36b3cf420ebb26036462527426`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:43.109167 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-5af9af5b-718f-4640-bcf6-98bf1dfc391f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:43.238810 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1004/2008] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:43 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:43.254163 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6f3aa-9545-463a-a69e-00469987613b admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:43.257042 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-aad6f3aa-9545-463a-a69e-00469987613b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:43.440336 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6f3aa-9545-463a-a69e-00469987613b admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:43.452670 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee9143-8ec1-4d57-8fd9-1ad7fb52fcfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:43.453433 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee9143-8ec1-4d57-8fd9-1ad7fb52fcfe service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:43.453818 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee9143-8ec1-4d57-8fd9-1ad7fb52fcfe service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:43.454195 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee9143-8ec1-4d57-8fd9-1ad7fb52fcfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:43.490933 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee9143-8ec1-4d57-8fd9-1ad7fb52fcfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:43.493249 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee9143-8ec1-4d57-8fd9-1ad7fb52fcfe service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:43.529174 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1005/2009] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:43 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:43.812018 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9af5b-718f-4640-bcf6-98bf1dfc391f None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:43.929045 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967260b-9bcf-4235-bdc0-d70520f5bc14 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:43.930750 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967260b-9bcf-4235-bdc0-d70520f5bc14 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:43.930750 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967260b-9bcf-4235-bdc0-d70520f5bc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:43.936126 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9af5b-718f-4640-bcf6-98bf1dfc391f None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:43.945891 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f55d62-86e9-4283-aa97-f9b6c585cfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:43.946861 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f55d62-86e9-4283-aa97-f9b6c585cfcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:43.947143 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f55d62-86e9-4283-aa97-f9b6c585cfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:43.947419 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f55d62-86e9-4283-aa97-f9b6c585cfcc admin admin] PATH_INFO: `/v3/users/9c13e41c0299477682bd838fde9e1f14` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:43.949573 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f55d62-86e9-4283-aa97-f9b6c585cfcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c13e41c0299477682bd838fde9e1f14)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:43.951517 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f55d62-86e9-4283-aa97-f9b6c585cfcc admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:44.012871 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-1967260b-9bcf-4235-bdc0-d70520f5bc14 None None] MFA Rules not processed for user `ebc99962f1494b4ab39ccedced417d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:44.015490 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-1967260b-9bcf-4235-bdc0-d70520f5bc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:44.076153 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b9f55d62-86e9-4283-aa97-f9b6c585cfcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c13e41c0299477682bd838fde9e1f14'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:44.077457 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b9f55d62-86e9-4283-aa97-f9b6c585cfcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c13e41c0299477682bd838fde9e1f14'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:44.080274 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b9f55d62-86e9-4283-aa97-f9b6c585cfcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c13e41c0299477682bd838fde9e1f14'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:44.111773 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b9f55d62-86e9-4283-aa97-f9b6c585cfcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c13e41c0299477682bd838fde9e1f14'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:44.130643 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b9f55d62-86e9-4283-aa97-f9b6c585cfcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c13e41c0299477682bd838fde9e1f14'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:44.155046 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1005/2010] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:43 2021] DELETE /identity/v3/users/9c13e41c0299477682bd838fde9e1f14 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:44.156807 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b5915-4e99-4bb8-9e9c-70a7f104d692 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:44.157536 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b5915-4e99-4bb8-9e9c-70a7f104d692 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:44.157961 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b5915-4e99-4bb8-9e9c-70a7f104d692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:44.179412 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-1e1b5915-4e99-4bb8-9e9c-70a7f104d692 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:44.181811 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-1e1b5915-4e99-4bb8-9e9c-70a7f104d692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:44.260200 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1006/2011] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:43 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:11:44.262734 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967260b-9bcf-4235-bdc0-d70520f5bc14 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:44.264873 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-1967260b-9bcf-4235-bdc0-d70520f5bc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:44.267250 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1006/2012] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:44.279542 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b5915-4e99-4bb8-9e9c-70a7f104d692 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:44.281523 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-1e1b5915-4e99-4bb8-9e9c-70a7f104d692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:44.362435 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b5915-4e99-4bb8-9e9c-70a7f104d692 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:44.369166 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef3dca-2460-4240-b7b2-01056145a188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:44.370037 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef3dca-2460-4240-b7b2-01056145a188 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:44.370397 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef3dca-2460-4240-b7b2-01056145a188 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:44.371137 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef3dca-2460-4240-b7b2-01056145a188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:44.381741 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef3dca-2460-4240-b7b2-01056145a188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:44.383857 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef3dca-2460-4240-b7b2-01056145a188 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:44.390317 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967260b-9bcf-4235-bdc0-d70520f5bc14 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:44.406829 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1007/2013] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:44.456367 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52cb9e-5eee-4f49-830f-e82370d8ec4b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9072bd35fdf046669c196133f485d334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:44.456830 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52cb9e-5eee-4f49-830f-e82370d8ec4b service glance] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:44.457108 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52cb9e-5eee-4f49-830f-e82370d8ec4b service glance] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:44.457589 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52cb9e-5eee-4f49-830f-e82370d8ec4b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:44.460150 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-4a52cb9e-5eee-4f49-830f-e82370d8ec4b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:44.540732 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52cb9e-5eee-4f49-830f-e82370d8ec4b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:44.542270 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52cb9e-5eee-4f49-830f-e82370d8ec4b service glance] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:44.557286 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1007/2014] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:44 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:44.762232 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef3dca-2460-4240-b7b2-01056145a188 service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:44.772133 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-61ef3dca-2460-4240-b7b2-01056145a188 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:44.787078 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef3dca-2460-4240-b7b2-01056145a188 service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:44.808690 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d6bc7-58e3-4947-9ea1-fa80603da623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:44.810505 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d6bc7-58e3-4947-9ea1-fa80603da623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:44.810802 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d6bc7-58e3-4947-9ea1-fa80603da623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:44.811105 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d6bc7-58e3-4947-9ea1-fa80603da623 admin admin] PATH_INFO: `/v3/projects/73aab94df1de47578973edb76979fd77` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:44.815714 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d6bc7-58e3-4947-9ea1-fa80603da623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73aab94df1de47578973edb76979fd77)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:44.818245 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d6bc7-58e3-4947-9ea1-fa80603da623 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:44.844956 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7f46d-3644-48e1-81cc-5f1faaadecd5 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:44.845330 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7f46d-3644-48e1-81cc-5f1faaadecd5 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:44.845773 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7f46d-3644-48e1-81cc-5f1faaadecd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:44.870758 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-a6d7f46d-3644-48e1-81cc-5f1faaadecd5 None None] MFA Rules not processed for user `b2f47cbf62d44a6ba7e6a6f0f2305630`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:44.873986 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-a6d7f46d-3644-48e1-81cc-5f1faaadecd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:44.894166 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-464d6bc7-58e3-4947-9ea1-fa80603da623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73aab94df1de47578973edb76979fd77', 'request_id': 'req-464d6bc7-58e3-4947-9ea1-fa80603da623'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:44.906284 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-464d6bc7-58e3-4947-9ea1-fa80603da623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73aab94df1de47578973edb76979fd77', 'request_id': 'req-464d6bc7-58e3-4947-9ea1-fa80603da623'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:44.914105 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-464d6bc7-58e3-4947-9ea1-fa80603da623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73aab94df1de47578973edb76979fd77', 'request_id': 'req-464d6bc7-58e3-4947-9ea1-fa80603da623'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:44.934834 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-464d6bc7-58e3-4947-9ea1-fa80603da623 admin admin] The token cache is being invalidate because project 73aab94df1de47578973edb76979fd77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:44.935227 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-464d6bc7-58e3-4947-9ea1-fa80603da623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:44.935957 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-464d6bc7-58e3-4947-9ea1-fa80603da623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:44.939447 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1008/2015] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:44 2021] DELETE /identity/v3/projects/73aab94df1de47578973edb76979fd77 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:44.942594 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55c5fb-5ec0-4703-9ca6-068662f9e649 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:44.942990 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55c5fb-5ec0-4703-9ca6-068662f9e649 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:44.943363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55c5fb-5ec0-4703-9ca6-068662f9e649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:44.953895 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1008/2016] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Dec 15 16:11:44 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:44.955551 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7f46d-3644-48e1-81cc-5f1faaadecd5 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:44.957476 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-a6d7f46d-3644-48e1-81cc-5f1faaadecd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:44.965412 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-0a55c5fb-5ec0-4703-9ca6-068662f9e649 None None] MFA Rules not processed for user `df09b0b78f6646ed8c520c5c46b3eb58`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:44.966779 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-0a55c5fb-5ec0-4703-9ca6-068662f9e649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:45.032990 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1009/2017] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:44 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:11:45.033983 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55c5fb-5ec0-4703-9ca6-068662f9e649 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:45.035382 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-0a55c5fb-5ec0-4703-9ca6-068662f9e649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:45.045967 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7f46d-3644-48e1-81cc-5f1faaadecd5 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:45.059069 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e06b03-70d9-4bc4-b3cd-96fd1a85d8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:45.060342 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e06b03-70d9-4bc4-b3cd-96fd1a85d8dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:45.060945 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e06b03-70d9-4bc4-b3cd-96fd1a85d8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:45.061416 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e06b03-70d9-4bc4-b3cd-96fd1a85d8dc admin admin] PATH_INFO: `/v3/users/04efde36b3cf420ebb26036462527426` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:45.063717 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e06b03-70d9-4bc4-b3cd-96fd1a85d8dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=04efde36b3cf420ebb26036462527426)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:45.066656 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e06b03-70d9-4bc4-b3cd-96fd1a85d8dc admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:45.174802 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55c5fb-5ec0-4703-9ca6-068662f9e649 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:45.192339 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ee431-db06-4a42-bd4c-f2655ddcf10f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e3f652f76424e27a1d4329212d9b66d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:45.193308 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ee431-db06-4a42-bd4c-f2655ddcf10f service swift] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:45.193802 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ee431-db06-4a42-bd4c-f2655ddcf10f service swift] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:45.194280 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ee431-db06-4a42-bd4c-f2655ddcf10f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:45.203755 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ee431-db06-4a42-bd4c-f2655ddcf10f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:45.203929 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-c0e06b03-70d9-4bc4-b3cd-96fd1a85d8dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04efde36b3cf420ebb26036462527426'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:45.204702 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-c0e06b03-70d9-4bc4-b3cd-96fd1a85d8dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04efde36b3cf420ebb26036462527426'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:45.206018 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ee431-db06-4a42-bd4c-f2655ddcf10f service swift] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:45.213511 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-c0e06b03-70d9-4bc4-b3cd-96fd1a85d8dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04efde36b3cf420ebb26036462527426'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:45.214729 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-c0e06b03-70d9-4bc4-b3cd-96fd1a85d8dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04efde36b3cf420ebb26036462527426'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:45.221760 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1010/2018] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Dec 15 16:11:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:11:45.229528 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-c0e06b03-70d9-4bc4-b3cd-96fd1a85d8dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04efde36b3cf420ebb26036462527426'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:45.256247 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1009/2019] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:44 2021] DELETE /identity/v3/users/04efde36b3cf420ebb26036462527426 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:45.701500 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ee431-db06-4a42-bd4c-f2655ddcf10f service swift] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:45.727036 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ee431-db06-4a42-bd4c-f2655ddcf10f service swift] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:45.858608 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa333672-6041-482b-9ea5-107124d419e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:45.859457 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa333672-6041-482b-9ea5-107124d419e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:45.860375 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa333672-6041-482b-9ea5-107124d419e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:45.860973 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa333672-6041-482b-9ea5-107124d419e9 admin admin] PATH_INFO: `/v3/projects/d99c9f518c3f4847aeaf02ceceb0f905` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:45.862655 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa333672-6041-482b-9ea5-107124d419e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d99c9f518c3f4847aeaf02ceceb0f905)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:45.865492 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa333672-6041-482b-9ea5-107124d419e9 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:46.036253 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-aa333672-6041-482b-9ea5-107124d419e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd99c9f518c3f4847aeaf02ceceb0f905', 'request_id': 'req-aa333672-6041-482b-9ea5-107124d419e9'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:46.058686 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-aa333672-6041-482b-9ea5-107124d419e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd99c9f518c3f4847aeaf02ceceb0f905', 'request_id': 'req-aa333672-6041-482b-9ea5-107124d419e9'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:46.073176 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-aa333672-6041-482b-9ea5-107124d419e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd99c9f518c3f4847aeaf02ceceb0f905', 'request_id': 'req-aa333672-6041-482b-9ea5-107124d419e9'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:46.101215 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-aa333672-6041-482b-9ea5-107124d419e9 admin admin] The token cache is being invalidate because project d99c9f518c3f4847aeaf02ceceb0f905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:46.101856 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-aa333672-6041-482b-9ea5-107124d419e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:46.103606 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-aa333672-6041-482b-9ea5-107124d419e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:46.135122 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1011/2020] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:45 2021] DELETE /identity/v3/projects/d99c9f518c3f4847aeaf02ceceb0f905 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:46.143641 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3a368-b05d-4ca3-9afc-effd8beb5efd None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:46.144624 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3a368-b05d-4ca3-9afc-effd8beb5efd None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:46.145264 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3a368-b05d-4ca3-9afc-effd8beb5efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:46.175239 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-66d3a368-b05d-4ca3-9afc-effd8beb5efd None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:46.176542 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-66d3a368-b05d-4ca3-9afc-effd8beb5efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:46.271444 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1010/2021] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:46.272605 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fa88b-fd8d-4222-ac79-146fb572b5c0 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:46.272913 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fa88b-fd8d-4222-ac79-146fb572b5c0 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:46.273577 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fa88b-fd8d-4222-ac79-146fb572b5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:46.328903 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-026fa88b-fd8d-4222-ac79-146fb572b5c0 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:46.330818 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-026fa88b-fd8d-4222-ac79-146fb572b5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:46.341929 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1012/2022] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:11:46.346364 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3a368-b05d-4ca3-9afc-effd8beb5efd None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:46.368042 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3a368-b05d-4ca3-9afc-effd8beb5efd None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:46.375812 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466351ec-d99e-4950-ac65-a44bb82edeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:46.376828 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466351ec-d99e-4950-ac65-a44bb82edeaa admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:46.377317 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466351ec-d99e-4950-ac65-a44bb82edeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:46.378143 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466351ec-d99e-4950-ac65-a44bb82edeaa admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:46.379113 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466351ec-d99e-4950-ac65-a44bb82edeaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:46.379644 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466351ec-d99e-4950-ac65-a44bb82edeaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:46.381651 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466351ec-d99e-4950-ac65-a44bb82edeaa admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:46.400307 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1011/2023] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:11:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:46.418552 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fa88b-fd8d-4222-ac79-146fb572b5c0 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:46.436429 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fa88b-fd8d-4222-ac79-146fb572b5c0 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:46.452029 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6516c4-52f4-41da-a463-e780a6523f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:46.452717 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6516c4-52f4-41da-a463-e780a6523f37 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:46.453022 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6516c4-52f4-41da-a463-e780a6523f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:46.453296 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6516c4-52f4-41da-a463-e780a6523f37 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:46.454040 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6516c4-52f4-41da-a463-e780a6523f37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:46.455954 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6516c4-52f4-41da-a463-e780a6523f37 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:46.516122 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1013/2024] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:46 2021] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:11:46.525720 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466351ec-d99e-4950-ac65-a44bb82edeaa admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:46.538601 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466351ec-d99e-4950-ac65-a44bb82edeaa admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:46.667563 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e36b9b-3644-4e3d-8f5d-f3829d0741d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:46.670122 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e36b9b-3644-4e3d-8f5d-f3829d0741d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:46.671792 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e36b9b-3644-4e3d-8f5d-f3829d0741d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:46.677914 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e36b9b-3644-4e3d-8f5d-f3829d0741d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:46.679130 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e36b9b-3644-4e3d-8f5d-f3829d0741d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:46.683414 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e36b9b-3644-4e3d-8f5d-f3829d0741d5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:46.741218 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1012/2025] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:46 2021] POST /identity/v3/users => generated 291 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:46.748680 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6516c4-52f4-41da-a463-e780a6523f37 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:46.766113 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6516c4-52f4-41da-a463-e780a6523f37 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:46.780944 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3a2fb-a00a-4964-9315-8ab20feff102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:46.783134 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3a2fb-a00a-4964-9315-8ab20feff102 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:46.783973 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3a2fb-a00a-4964-9315-8ab20feff102 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:46.784579 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3a2fb-a00a-4964-9315-8ab20feff102 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:46.785978 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3a2fb-a00a-4964-9315-8ab20feff102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:46.788164 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3a2fb-a00a-4964-9315-8ab20feff102 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:46.803955 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1014/2026] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:46 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:46.807176 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e36b9b-3644-4e3d-8f5d-f3829d0741d5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:46.851689 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e36b9b-3644-4e3d-8f5d-f3829d0741d5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:46.883608 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe7c55-a4bb-49a4-8555-318e39c7ec54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:46.885206 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe7c55-a4bb-49a4-8555-318e39c7ec54 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:46.885729 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe7c55-a4bb-49a4-8555-318e39c7ec54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:46.886211 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe7c55-a4bb-49a4-8555-318e39c7ec54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:46.887162 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe7c55-a4bb-49a4-8555-318e39c7ec54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:46.888782 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe7c55-a4bb-49a4-8555-318e39c7ec54 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:46.902893 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3a2fb-a00a-4964-9315-8ab20feff102 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:46.905088 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-35f3a2fb-a00a-4964-9315-8ab20feff102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:46.936661 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3a2fb-a00a-4964-9315-8ab20feff102 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:46.937433 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1013/2027] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:46 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:46.938289 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe7c55-a4bb-49a4-8555-318e39c7ec54 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:46.961876 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae967e6-cab0-4653-bdb5-b8495a77afa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:46.962760 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae967e6-cab0-4653-bdb5-b8495a77afa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:46.963036 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae967e6-cab0-4653-bdb5-b8495a77afa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:46.963311 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae967e6-cab0-4653-bdb5-b8495a77afa5 admin admin] PATH_INFO: `/v3/users/5f2c14e3b42240d7ad1403b4b54107a9` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:46.969301 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae967e6-cab0-4653-bdb5-b8495a77afa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f2c14e3b42240d7ad1403b4b54107a9)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:46.970532 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe7c55-a4bb-49a4-8555-318e39c7ec54 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:46.971494 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae967e6-cab0-4653-bdb5-b8495a77afa5 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:46.987162 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2cd8a-4652-4eb9-8430-e8238e758071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:46.988560 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2cd8a-4652-4eb9-8430-e8238e758071 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:46.989065 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2cd8a-4652-4eb9-8430-e8238e758071 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:46.989605 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2cd8a-4652-4eb9-8430-e8238e758071 admin admin] PATH_INFO: `/v3/projects/81143c66983141118ab0773b79c93045/users/494d3fbc25334d93b87c99ba63eec807/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:47.025603 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2cd8a-4652-4eb9-8430-e8238e758071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81143c66983141118ab0773b79c93045, user_id=494d3fbc25334d93b87c99ba63eec807, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:47.030482 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2cd8a-4652-4eb9-8430-e8238e758071 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:47.089289 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-1ae967e6-cab0-4653-bdb5-b8495a77afa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f2c14e3b42240d7ad1403b4b54107a9'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:47.100457 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1014/2028] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:46 2021] PUT /identity/v3/projects/81143c66983141118ab0773b79c93045/users/494d3fbc25334d93b87c99ba63eec807/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:47.100864 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-1ae967e6-cab0-4653-bdb5-b8495a77afa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f2c14e3b42240d7ad1403b4b54107a9'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:47.100864 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-1ae967e6-cab0-4653-bdb5-b8495a77afa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f2c14e3b42240d7ad1403b4b54107a9'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:47.101911 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb4afd-6d78-4731-8648-42aa2f31d895 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:47.103031 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb4afd-6d78-4731-8648-42aa2f31d895 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:47.103031 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb4afd-6d78-4731-8648-42aa2f31d895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:47.136101 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-1ae967e6-cab0-4653-bdb5-b8495a77afa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f2c14e3b42240d7ad1403b4b54107a9'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:47.152329 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-d9fb4afd-6d78-4731-8648-42aa2f31d895 None None] MFA Rules not processed for user `494d3fbc25334d93b87c99ba63eec807`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:47.155079 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-1ae967e6-cab0-4653-bdb5-b8495a77afa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f2c14e3b42240d7ad1403b4b54107a9'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:47.157726 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-d9fb4afd-6d78-4731-8648-42aa2f31d895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:47.176770 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1015/2029] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:46 2021] DELETE /identity/v3/users/5f2c14e3b42240d7ad1403b4b54107a9 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:11:47.186058 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7e9e5-0a0a-499c-aa37-fd86af49df0a None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:47.186541 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7e9e5-0a0a-499c-aa37-fd86af49df0a None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:47.188798 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7e9e5-0a0a-499c-aa37-fd86af49df0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:47.227111 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-63b7e9e5-0a0a-499c-aa37-fd86af49df0a None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:47.228678 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-63b7e9e5-0a0a-499c-aa37-fd86af49df0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:47.315265 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1016/2030] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:47.327454 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7e9e5-0a0a-499c-aa37-fd86af49df0a None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:47.329213 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-63b7e9e5-0a0a-499c-aa37-fd86af49df0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:47.339105 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1015/2031] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:47 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:47.343506 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb4afd-6d78-4731-8648-42aa2f31d895 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:47.345266 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-d9fb4afd-6d78-4731-8648-42aa2f31d895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:47.462996 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7e9e5-0a0a-499c-aa37-fd86af49df0a None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:47.475379 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f50709-5838-479f-8bb9-51b45e3d83fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:47.476933 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f50709-5838-479f-8bb9-51b45e3d83fc service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:47.477381 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f50709-5838-479f-8bb9-51b45e3d83fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:47.477845 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f50709-5838-479f-8bb9-51b45e3d83fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:47.510312 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb4afd-6d78-4731-8648-42aa2f31d895 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:47.517266 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f50709-5838-479f-8bb9-51b45e3d83fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:47.518739 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f50709-5838-479f-8bb9-51b45e3d83fc service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:47.549242 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68171542-ff76-4406-8c3b-ee4217677be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:47.549963 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68171542-ff76-4406-8c3b-ee4217677be2 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:47.550250 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68171542-ff76-4406-8c3b-ee4217677be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:47.550528 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68171542-ff76-4406-8c3b-ee4217677be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:47.551258 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68171542-ff76-4406-8c3b-ee4217677be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:47.553176 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68171542-ff76-4406-8c3b-ee4217677be2 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:47.566057 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1017/2032] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:11:47.611086 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1016/2033] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:47 2021] POST /identity/v3/projects => generated 381 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:11:47.613032 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f50709-5838-479f-8bb9-51b45e3d83fc service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:47.628478 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f50709-5838-479f-8bb9-51b45e3d83fc service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:47.724639 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed571aee-cfb9-4d2d-8fdf-e5215eca16ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:47.726839 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed571aee-cfb9-4d2d-8fdf-e5215eca16ed admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:47.727349 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed571aee-cfb9-4d2d-8fdf-e5215eca16ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:47.727852 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed571aee-cfb9-4d2d-8fdf-e5215eca16ed admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:47.728886 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed571aee-cfb9-4d2d-8fdf-e5215eca16ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:47.731400 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed571aee-cfb9-4d2d-8fdf-e5215eca16ed admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:47.774299 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1018/2034] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:47 2021] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:11:47.776143 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68171542-ff76-4406-8c3b-ee4217677be2 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:47.801782 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68171542-ff76-4406-8c3b-ee4217677be2 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:47.813602 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d175e58-b5e5-40ff-b64a-b95d61144c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:47.814675 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d175e58-b5e5-40ff-b64a-b95d61144c5f admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:47.817500 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d175e58-b5e5-40ff-b64a-b95d61144c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:47.818060 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d175e58-b5e5-40ff-b64a-b95d61144c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:47.819045 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d175e58-b5e5-40ff-b64a-b95d61144c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:47.821659 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d175e58-b5e5-40ff-b64a-b95d61144c5f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:47.846539 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1017/2035] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:47 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:47.847751 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed571aee-cfb9-4d2d-8fdf-e5215eca16ed admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:47.865235 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed571aee-cfb9-4d2d-8fdf-e5215eca16ed admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:47.878566 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea852d7-da09-4dd5-8559-0f13bd0684cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:47.879540 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea852d7-da09-4dd5-8559-0f13bd0684cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:47.879834 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea852d7-da09-4dd5-8559-0f13bd0684cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:47.880430 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea852d7-da09-4dd5-8559-0f13bd0684cb admin admin] PATH_INFO: `/v3/projects/8e9a21bbc975438b9770abe1dd9cf20a/users/07d6aee337d34790b24a43366bad64fd/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:47.928651 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea852d7-da09-4dd5-8559-0f13bd0684cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e9a21bbc975438b9770abe1dd9cf20a, user_id=07d6aee337d34790b24a43366bad64fd, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:47.938952 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea852d7-da09-4dd5-8559-0f13bd0684cb admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:48.017986 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1019/2036] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:47 2021] PUT /identity/v3/projects/8e9a21bbc975438b9770abe1dd9cf20a/users/07d6aee337d34790b24a43366bad64fd/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:48.022368 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d175e58-b5e5-40ff-b64a-b95d61144c5f admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:48.062165 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d175e58-b5e5-40ff-b64a-b95d61144c5f admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:48.214380 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390c518-98e8-438f-9959-31495f11e2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:48.215058 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390c518-98e8-438f-9959-31495f11e2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:48.215335 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390c518-98e8-438f-9959-31495f11e2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:48.215615 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390c518-98e8-438f-9959-31495f11e2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:48.216374 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390c518-98e8-438f-9959-31495f11e2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:48.225410 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390c518-98e8-438f-9959-31495f11e2b6 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:48.287727 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1018/2037] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:48 2021] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:48.293067 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea852d7-da09-4dd5-8559-0f13bd0684cb admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:48.314703 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea852d7-da09-4dd5-8559-0f13bd0684cb admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:48.321742 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390c518-98e8-438f-9959-31495f11e2b6 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:48.324550 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-a390c518-98e8-438f-9959-31495f11e2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:48.334925 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b83f5-473d-4366-a3e6-de12b5d88999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:48.342570 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b83f5-473d-4366-a3e6-de12b5d88999 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:48.343031 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b83f5-473d-4366-a3e6-de12b5d88999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:48.344447 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b83f5-473d-4366-a3e6-de12b5d88999 admin admin] PATH_INFO: `/v3/projects/8e9a21bbc975438b9770abe1dd9cf20a/users/07d6aee337d34790b24a43366bad64fd/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:48.353241 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b83f5-473d-4366-a3e6-de12b5d88999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e9a21bbc975438b9770abe1dd9cf20a, user_id=07d6aee337d34790b24a43366bad64fd, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:48.375402 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390c518-98e8-438f-9959-31495f11e2b6 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:48.377726 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b83f5-473d-4366-a3e6-de12b5d88999 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:48.382212 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f8ad9-4ac6-46f1-9403-1ed9c0b3dd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:48.384456 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f8ad9-4ac6-46f1-9403-1ed9c0b3dd13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:48.384902 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f8ad9-4ac6-46f1-9403-1ed9c0b3dd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:48.385666 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f8ad9-4ac6-46f1-9403-1ed9c0b3dd13 admin admin] PATH_INFO: `/v3/projects/b1791c1c3a224d9ca7bdc9d5941b2d84` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:48.388349 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f8ad9-4ac6-46f1-9403-1ed9c0b3dd13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1791c1c3a224d9ca7bdc9d5941b2d84)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:48.395813 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f8ad9-4ac6-46f1-9403-1ed9c0b3dd13 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:48.422105 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1020/2038] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:48 2021] PUT /identity/v3/projects/8e9a21bbc975438b9770abe1dd9cf20a/users/07d6aee337d34790b24a43366bad64fd/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:48.433803 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d8818-9615-479b-a0a1-4e978ad5a974 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:48.434310 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d8818-9615-479b-a0a1-4e978ad5a974 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:48.443959 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d8818-9615-479b-a0a1-4e978ad5a974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:48.495201 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-829d8818-9615-479b-a0a1-4e978ad5a974 None None] MFA Rules not processed for user `07d6aee337d34790b24a43366bad64fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:48.497878 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-829d8818-9615-479b-a0a1-4e978ad5a974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:48.552031 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-746f8ad9-4ac6-46f1-9403-1ed9c0b3dd13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1791c1c3a224d9ca7bdc9d5941b2d84', 'request_id': 'req-746f8ad9-4ac6-46f1-9403-1ed9c0b3dd13'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:48.588562 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-746f8ad9-4ac6-46f1-9403-1ed9c0b3dd13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1791c1c3a224d9ca7bdc9d5941b2d84', 'request_id': 'req-746f8ad9-4ac6-46f1-9403-1ed9c0b3dd13'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:48.609926 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-746f8ad9-4ac6-46f1-9403-1ed9c0b3dd13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1791c1c3a224d9ca7bdc9d5941b2d84', 'request_id': 'req-746f8ad9-4ac6-46f1-9403-1ed9c0b3dd13'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:48.641592 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-746f8ad9-4ac6-46f1-9403-1ed9c0b3dd13 admin admin] The token cache is being invalidate because project b1791c1c3a224d9ca7bdc9d5941b2d84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:48.641880 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-746f8ad9-4ac6-46f1-9403-1ed9c0b3dd13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:48.650226 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-746f8ad9-4ac6-46f1-9403-1ed9c0b3dd13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:48.652711 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1019/2039] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:48 2021] DELETE /identity/v3/projects/b1791c1c3a224d9ca7bdc9d5941b2d84 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:48.656386 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f8ad9-4ac6-46f1-9403-1ed9c0b3dd13 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:48.658891 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-746f8ad9-4ac6-46f1-9403-1ed9c0b3dd13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:48.663557 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1021/2040] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:48 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:48.670899 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d8818-9615-479b-a0a1-4e978ad5a974 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:48.672791 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-829d8818-9615-479b-a0a1-4e978ad5a974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:48.817069 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d8818-9615-479b-a0a1-4e978ad5a974 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:48.828129 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffd101-51b8-4498-82b7-bcac0e87b738 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:48.828803 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffd101-51b8-4498-82b7-bcac0e87b738 service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:48.829074 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffd101-51b8-4498-82b7-bcac0e87b738 service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:48.829523 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffd101-51b8-4498-82b7-bcac0e87b738 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:48.837836 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-a6ffd101-51b8-4498-82b7-bcac0e87b738 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:48.848340 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f8ad9-4ac6-46f1-9403-1ed9c0b3dd13 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:48.861000 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6ba66-f1e3-47f1-8a7d-fa29cb2577f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:48.862228 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6ba66-f1e3-47f1-8a7d-fa29cb2577f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:48.864329 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6ba66-f1e3-47f1-8a7d-fa29cb2577f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:48.864799 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6ba66-f1e3-47f1-8a7d-fa29cb2577f3 admin admin] PATH_INFO: `/v3/users/77d3313a81ac4f1fab9974ed925d8260` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:48.865103 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffd101-51b8-4498-82b7-bcac0e87b738 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:48.866641 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffd101-51b8-4498-82b7-bcac0e87b738 service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:48.871439 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6ba66-f1e3-47f1-8a7d-fa29cb2577f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77d3313a81ac4f1fab9974ed925d8260)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:48.874253 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6ba66-f1e3-47f1-8a7d-fa29cb2577f3 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:48.894292 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1022/2041] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:48 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:11:49.028884 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-e2f6ba66-f1e3-47f1-8a7d-fa29cb2577f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77d3313a81ac4f1fab9974ed925d8260'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:49.031397 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-e2f6ba66-f1e3-47f1-8a7d-fa29cb2577f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77d3313a81ac4f1fab9974ed925d8260'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:49.049373 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-e2f6ba66-f1e3-47f1-8a7d-fa29cb2577f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77d3313a81ac4f1fab9974ed925d8260'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:49.053871 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-e2f6ba66-f1e3-47f1-8a7d-fa29cb2577f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77d3313a81ac4f1fab9974ed925d8260'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:49.099955 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-e2f6ba66-f1e3-47f1-8a7d-fa29cb2577f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77d3313a81ac4f1fab9974ed925d8260'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:49.143112 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1020/2042] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:48 2021] DELETE /identity/v3/users/77d3313a81ac4f1fab9974ed925d8260 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:11:49.614175 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffd101-51b8-4498-82b7-bcac0e87b738 service cinder] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:49.630598 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffd101-51b8-4498-82b7-bcac0e87b738 service cinder] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:49.827899 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8c44a-9610-4dca-932e-4dfc71bff484 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07d6aee337d34790b24a43366bad64fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e9a21bbc975438b9770abe1dd9cf20a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:49.829781 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8c44a-9610-4dca-932e-4dfc71bff484 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:49.830250 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8c44a-9610-4dca-932e-4dfc71bff484 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:49.831325 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8c44a-9610-4dca-932e-4dfc71bff484 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:49.832316 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8c44a-9610-4dca-932e-4dfc71bff484 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:49.832820 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8c44a-9610-4dca-932e-4dfc71bff484 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:49.834685 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8c44a-9610-4dca-932e-4dfc71bff484 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:49.873473 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1023/2043] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:11:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:49.877510 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6ba66-f1e3-47f1-8a7d-fa29cb2577f3 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:49.879090 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-e2f6ba66-f1e3-47f1-8a7d-fa29cb2577f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:49.906617 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6ba66-f1e3-47f1-8a7d-fa29cb2577f3 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:49.924165 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571c627-dff8-44c3-aac5-d7d89fcab520 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07d6aee337d34790b24a43366bad64fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e9a21bbc975438b9770abe1dd9cf20a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:49.927178 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571c627-dff8-44c3-aac5-d7d89fcab520 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:49.930093 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571c627-dff8-44c3-aac5-d7d89fcab520 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:49.932817 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571c627-dff8-44c3-aac5-d7d89fcab520 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:49.936690 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571c627-dff8-44c3-aac5-d7d89fcab520 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:49.940617 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571c627-dff8-44c3-aac5-d7d89fcab520 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:50.033091 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8c44a-9610-4dca-932e-4dfc71bff484 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:50.041655 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1021/2044] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:49 2021] POST /identity/v3/projects => generated 354 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:50.071611 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8c44a-9610-4dca-932e-4dfc71bff484 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:50.169586 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571c627-dff8-44c3-aac5-d7d89fcab520 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:50.172939 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-b571c627-dff8-44c3-aac5-d7d89fcab520 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:50.393888 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce785e-9040-4a5a-be1c-98c779a7cf22 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07d6aee337d34790b24a43366bad64fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e9a21bbc975438b9770abe1dd9cf20a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:50.393888 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce785e-9040-4a5a-be1c-98c779a7cf22 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:50.399558 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce785e-9040-4a5a-be1c-98c779a7cf22 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:50.399969 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce785e-9040-4a5a-be1c-98c779a7cf22 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:50.402338 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce785e-9040-4a5a-be1c-98c779a7cf22 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:50.403055 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce785e-9040-4a5a-be1c-98c779a7cf22 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:50.407039 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce785e-9040-4a5a-be1c-98c779a7cf22 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:50.449078 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1024/2045] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:11:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:11:50.467325 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571c627-dff8-44c3-aac5-d7d89fcab520 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:50.479640 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151e80f-3ab2-4410-a110-2f5c2d130a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:50.480533 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151e80f-3ab2-4410-a110-2f5c2d130a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:50.480821 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151e80f-3ab2-4410-a110-2f5c2d130a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:50.481100 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151e80f-3ab2-4410-a110-2f5c2d130a81 admin admin] PATH_INFO: `/v3/projects/1eaff1221426439b8bc0dd0109fb44f9` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:50.482503 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151e80f-3ab2-4410-a110-2f5c2d130a81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eaff1221426439b8bc0dd0109fb44f9)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:50.484659 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151e80f-3ab2-4410-a110-2f5c2d130a81 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:50.554660 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce785e-9040-4a5a-be1c-98c779a7cf22 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:50.574078 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce785e-9040-4a5a-be1c-98c779a7cf22 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:50.594066 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2184e1-ce2c-4896-8387-067c0a793ab2 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07d6aee337d34790b24a43366bad64fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e9a21bbc975438b9770abe1dd9cf20a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:50.595489 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2184e1-ce2c-4896-8387-067c0a793ab2 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:50.596097 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2184e1-ce2c-4896-8387-067c0a793ab2 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:50.596621 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2184e1-ce2c-4896-8387-067c0a793ab2 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] PATH_INFO: `/v3/projects/121435b9a4fc46469b53f718551d4e66` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:50.599134 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-9151e80f-3ab2-4410-a110-2f5c2d130a81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eaff1221426439b8bc0dd0109fb44f9', 'request_id': 'req-9151e80f-3ab2-4410-a110-2f5c2d130a81'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:50.600457 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2184e1-ce2c-4896-8387-067c0a793ab2 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] RBAC: Authorizing `identity:delete_project(project_id=121435b9a4fc46469b53f718551d4e66)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:50.604051 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2184e1-ce2c-4896-8387-067c0a793ab2 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:50.615888 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-9151e80f-3ab2-4410-a110-2f5c2d130a81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eaff1221426439b8bc0dd0109fb44f9', 'request_id': 'req-9151e80f-3ab2-4410-a110-2f5c2d130a81'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:50.626524 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-9151e80f-3ab2-4410-a110-2f5c2d130a81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eaff1221426439b8bc0dd0109fb44f9', 'request_id': 'req-9151e80f-3ab2-4410-a110-2f5c2d130a81'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:50.644657 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-9151e80f-3ab2-4410-a110-2f5c2d130a81 admin admin] The token cache is being invalidate because project 1eaff1221426439b8bc0dd0109fb44f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:50.644965 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-9151e80f-3ab2-4410-a110-2f5c2d130a81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:50.645666 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-9151e80f-3ab2-4410-a110-2f5c2d130a81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:50.647505 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1022/2046] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:50 2021] DELETE /identity/v3/projects/1eaff1221426439b8bc0dd0109fb44f9 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:50.653420 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd6d7f-c27f-4d0b-9e56-245d1a7b07b5 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:50.656076 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd6d7f-c27f-4d0b-9e56-245d1a7b07b5 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:50.656358 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd6d7f-c27f-4d0b-9e56-245d1a7b07b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:50.700935 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-cfbd6d7f-c27f-4d0b-9e56-245d1a7b07b5 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:50.702703 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-cfbd6d7f-c27f-4d0b-9e56-245d1a7b07b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:50.716200 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4b2184e1-ce2c-4896-8387-067c0a793ab2 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '121435b9a4fc46469b53f718551d4e66', 'request_id': 'req-4b2184e1-ce2c-4896-8387-067c0a793ab2'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:50.735200 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4b2184e1-ce2c-4896-8387-067c0a793ab2 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '121435b9a4fc46469b53f718551d4e66', 'request_id': 'req-4b2184e1-ce2c-4896-8387-067c0a793ab2'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:50.745042 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4b2184e1-ce2c-4896-8387-067c0a793ab2 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '121435b9a4fc46469b53f718551d4e66', 'request_id': 'req-4b2184e1-ce2c-4896-8387-067c0a793ab2'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:50.792858 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1023/2047] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:50.800948 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4b2184e1-ce2c-4896-8387-067c0a793ab2 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] The token cache is being invalidate because project 121435b9a4fc46469b53f718551d4e66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:50.801315 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4b2184e1-ce2c-4896-8387-067c0a793ab2 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:50.801485 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8b5b2-27c7-4599-880e-15dcb3ac7d5a None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:50.801775 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8b5b2-27c7-4599-880e-15dcb3ac7d5a None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:50.802051 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8b5b2-27c7-4599-880e-15dcb3ac7d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:50.802784 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4b2184e1-ce2c-4896-8387-067c0a793ab2 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:50.805629 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1025/2048] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:50 2021] DELETE /identity/v3/projects/121435b9a4fc46469b53f718551d4e66 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:11:50.830635 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-39b8b5b2-27c7-4599-880e-15dcb3ac7d5a None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:50.833214 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-39b8b5b2-27c7-4599-880e-15dcb3ac7d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:50.846174 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1024/2049] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:11:50.848044 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2184e1-ce2c-4896-8387-067c0a793ab2 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:50.861407 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2184e1-ce2c-4896-8387-067c0a793ab2 tempest-VolumeQuotaClassesTest-1112719245 tempest-VolumeQuotaClassesTest-1112719245-project-admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:50.867068 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6a6f4-e872-440d-bdd0-d151ccea6926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:50.868159 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6a6f4-e872-440d-bdd0-d151ccea6926 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:50.868660 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6a6f4-e872-440d-bdd0-d151ccea6926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:50.869125 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6a6f4-e872-440d-bdd0-d151ccea6926 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:50.870115 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c6a6f4-e872-440d-bdd0-d151ccea6926 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:50.870632 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c6a6f4-e872-440d-bdd0-d151ccea6926 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:50.872622 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c6a6f4-e872-440d-bdd0-d151ccea6926 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:50.892960 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1026/2050] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:11:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:50.893844 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8b5b2-27c7-4599-880e-15dcb3ac7d5a None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:50.906942 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8b5b2-27c7-4599-880e-15dcb3ac7d5a None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:50.924557 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6075d3b-2e5d-4510-a319-8e6881b8cb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:50.925598 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6075d3b-2e5d-4510-a319-8e6881b8cb63 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:50.926396 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6075d3b-2e5d-4510-a319-8e6881b8cb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:50.926825 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6075d3b-2e5d-4510-a319-8e6881b8cb63 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:50.929334 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6075d3b-2e5d-4510-a319-8e6881b8cb63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:50.934221 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6075d3b-2e5d-4510-a319-8e6881b8cb63 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:51.036362 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1025/2051] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:50 2021] POST /identity/v3/projects => generated 363 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:51.040834 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6a6f4-e872-440d-bdd0-d151ccea6926 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:51.058726 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6a6f4-e872-440d-bdd0-d151ccea6926 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:51.219743 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8e991-a25e-4544-8882-d47de5e0b380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:51.220431 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8e991-a25e-4544-8882-d47de5e0b380 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:51.220715 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8e991-a25e-4544-8882-d47de5e0b380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:51.220990 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8e991-a25e-4544-8882-d47de5e0b380 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:51.221734 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8e991-a25e-4544-8882-d47de5e0b380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:51.227514 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8e991-a25e-4544-8882-d47de5e0b380 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:51.280747 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1027/2052] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:51 2021] POST /identity/v3/users => generated 282 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:51.282034 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6075d3b-2e5d-4510-a319-8e6881b8cb63 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:51.297602 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6075d3b-2e5d-4510-a319-8e6881b8cb63 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:51.310358 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8e991-a25e-4544-8882-d47de5e0b380 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:51.313961 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-44e8e991-a25e-4544-8882-d47de5e0b380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:51.317691 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabc330-f8c6-49d0-89f9-e35b6f6b2ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:51.319781 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabc330-f8c6-49d0-89f9-e35b6f6b2ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:51.321689 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabc330-f8c6-49d0-89f9-e35b6f6b2ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:51.323519 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabc330-f8c6-49d0-89f9-e35b6f6b2ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:51.325246 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabc330-f8c6-49d0-89f9-e35b6f6b2ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:51.328645 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabc330-f8c6-49d0-89f9-e35b6f6b2ca6 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:51.329798 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8e991-a25e-4544-8882-d47de5e0b380 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:51.341681 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5e2dc-b31b-4759-8772-f89c3b9c1921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:51.342736 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5e2dc-b31b-4759-8772-f89c3b9c1921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:51.342950 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5e2dc-b31b-4759-8772-f89c3b9c1921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:51.343237 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5e2dc-b31b-4759-8772-f89c3b9c1921 admin admin] PATH_INFO: `/v3/users/494d3fbc25334d93b87c99ba63eec807` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:51.344606 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5e2dc-b31b-4759-8772-f89c3b9c1921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=494d3fbc25334d93b87c99ba63eec807)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:51.347630 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5e2dc-b31b-4759-8772-f89c3b9c1921 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:51.362446 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1026/2053] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:51 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:51.363811 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabc330-f8c6-49d0-89f9-e35b6f6b2ca6 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:51.381203 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabc330-f8c6-49d0-89f9-e35b6f6b2ca6 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:51.387931 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42a7d6-a109-4a62-af64-77486443352e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:51.388993 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42a7d6-a109-4a62-af64-77486443352e admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:51.389552 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42a7d6-a109-4a62-af64-77486443352e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:51.390161 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42a7d6-a109-4a62-af64-77486443352e admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:51.392877 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42a7d6-a109-4a62-af64-77486443352e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:51.395372 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42a7d6-a109-4a62-af64-77486443352e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:51.410489 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1027/2054] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:51 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:51.416286 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42a7d6-a109-4a62-af64-77486443352e admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:51.433170 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42a7d6-a109-4a62-af64-77486443352e admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:51.438912 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be2446-218f-457e-8198-ce8dc2a1684f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:51.440214 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be2446-218f-457e-8198-ce8dc2a1684f admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:51.440883 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be2446-218f-457e-8198-ce8dc2a1684f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:51.441419 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be2446-218f-457e-8198-ce8dc2a1684f admin admin] PATH_INFO: `/v3/projects/054a45e4c26940028fc45fb27c827096/users/f20e74a1476a406fb953dd08578da474/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:51.473528 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be2446-218f-457e-8198-ce8dc2a1684f admin admin] RBAC: Authorizing `identity:create_grant(project_id=054a45e4c26940028fc45fb27c827096, user_id=f20e74a1476a406fb953dd08578da474, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:51.479446 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-cde5e2dc-b31b-4759-8772-f89c3b9c1921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '494d3fbc25334d93b87c99ba63eec807'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:51.480338 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-cde5e2dc-b31b-4759-8772-f89c3b9c1921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '494d3fbc25334d93b87c99ba63eec807'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:51.485295 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-cde5e2dc-b31b-4759-8772-f89c3b9c1921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '494d3fbc25334d93b87c99ba63eec807'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:51.486195 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be2446-218f-457e-8198-ce8dc2a1684f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:51.508186 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-cde5e2dc-b31b-4759-8772-f89c3b9c1921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '494d3fbc25334d93b87c99ba63eec807'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:51.524264 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1028/2055] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:51 2021] PUT /identity/v3/projects/054a45e4c26940028fc45fb27c827096/users/f20e74a1476a406fb953dd08578da474/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:51.525163 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-cde5e2dc-b31b-4759-8772-f89c3b9c1921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '494d3fbc25334d93b87c99ba63eec807'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:51.526503 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb428c9-9526-4782-8d00-22cd1e83fcff None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:51.527277 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb428c9-9526-4782-8d00-22cd1e83fcff None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:51.527781 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb428c9-9526-4782-8d00-22cd1e83fcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:51.559692 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1028/2056] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:51 2021] DELETE /identity/v3/users/494d3fbc25334d93b87c99ba63eec807 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:51.564880 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3d5c1-8661-49bd-b766-8271d46540ab None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:51.565175 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3d5c1-8661-49bd-b766-8271d46540ab None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:51.565489 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3d5c1-8661-49bd-b766-8271d46540ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:51.577931 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-7fb428c9-9526-4782-8d00-22cd1e83fcff None None] MFA Rules not processed for user `f20e74a1476a406fb953dd08578da474`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:51.582792 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-7fb428c9-9526-4782-8d00-22cd1e83fcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:51.627258 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-c5c3d5c1-8661-49bd-b766-8271d46540ab None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:51.629014 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c5c3d5c1-8661-49bd-b766-8271d46540ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:51.754184 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1029/2057] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:51.761487 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3d5c1-8661-49bd-b766-8271d46540ab None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:51.767107 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c5c3d5c1-8661-49bd-b766-8271d46540ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:51.821892 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1029/2058] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:51 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:51.823172 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb428c9-9526-4782-8d00-22cd1e83fcff None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:51.828865 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-7fb428c9-9526-4782-8d00-22cd1e83fcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:51.874279 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb428c9-9526-4782-8d00-22cd1e83fcff None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:51.899004 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612cb95-7d0e-4d5e-96ac-ac41833f9c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:51.900734 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612cb95-7d0e-4d5e-96ac-ac41833f9c7d admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:51.901909 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612cb95-7d0e-4d5e-96ac-ac41833f9c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:51.902429 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612cb95-7d0e-4d5e-96ac-ac41833f9c7d admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:51.903385 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612cb95-7d0e-4d5e-96ac-ac41833f9c7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:51.907441 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612cb95-7d0e-4d5e-96ac-ac41833f9c7d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:52.008238 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3d5c1-8661-49bd-b766-8271d46540ab None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:52.009902 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1030/2059] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:51 2021] POST /identity/v3/projects => generated 367 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:52.011400 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612cb95-7d0e-4d5e-96ac-ac41833f9c7d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:52.162021 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60004b5-714d-408c-afdc-5bb3d2f4d19d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:52.162767 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60004b5-714d-408c-afdc-5bb3d2f4d19d service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:52.163115 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60004b5-714d-408c-afdc-5bb3d2f4d19d service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:52.163461 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60004b5-714d-408c-afdc-5bb3d2f4d19d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:52.166901 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612cb95-7d0e-4d5e-96ac-ac41833f9c7d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:52.176377 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753200f4-42ce-4077-9e8b-c98813ddcf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:52.176739 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753200f4-42ce-4077-9e8b-c98813ddcf42 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:52.177288 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753200f4-42ce-4077-9e8b-c98813ddcf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:52.177288 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753200f4-42ce-4077-9e8b-c98813ddcf42 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:52.179160 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753200f4-42ce-4077-9e8b-c98813ddcf42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:52.181168 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753200f4-42ce-4077-9e8b-c98813ddcf42 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:52.215251 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60004b5-714d-408c-afdc-5bb3d2f4d19d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:52.216731 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60004b5-714d-408c-afdc-5bb3d2f4d19d service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:52.253473 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1030/2060] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:52.253777 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1031/2061] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:52 2021] POST /identity/v3/users => generated 290 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:52.267411 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60004b5-714d-408c-afdc-5bb3d2f4d19d service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:52.296598 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60004b5-714d-408c-afdc-5bb3d2f4d19d service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:52.311635 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05698661-5946-4167-971f-78635c54252f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:52.312411 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05698661-5946-4167-971f-78635c54252f admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:52.312791 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05698661-5946-4167-971f-78635c54252f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:52.313244 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05698661-5946-4167-971f-78635c54252f admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:52.314117 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05698661-5946-4167-971f-78635c54252f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:52.315929 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05698661-5946-4167-971f-78635c54252f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:52.345692 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753200f4-42ce-4077-9e8b-c98813ddcf42 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:52.346370 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1031/2062] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:52 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:52.370073 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753200f4-42ce-4077-9e8b-c98813ddcf42 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:52.387853 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfe5be-15cc-4dd7-b2a3-0487daa0f178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:52.389052 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfe5be-15cc-4dd7-b2a3-0487daa0f178 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:52.390022 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfe5be-15cc-4dd7-b2a3-0487daa0f178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:52.390022 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfe5be-15cc-4dd7-b2a3-0487daa0f178 admin admin] PATH_INFO: `/v3/projects/143e05c2fed349eaa7d5d883a9f35b35/users/0a76c4d591b440e69f3ad42b27431e7c/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:52.431020 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfe5be-15cc-4dd7-b2a3-0487daa0f178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=143e05c2fed349eaa7d5d883a9f35b35, user_id=0a76c4d591b440e69f3ad42b27431e7c, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:52.434048 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfe5be-15cc-4dd7-b2a3-0487daa0f178 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:52.466622 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1032/2063] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:52 2021] PUT /identity/v3/projects/143e05c2fed349eaa7d5d883a9f35b35/users/0a76c4d591b440e69f3ad42b27431e7c/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:52.470943 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05698661-5946-4167-971f-78635c54252f admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:52.486790 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05698661-5946-4167-971f-78635c54252f admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:52.576870 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790da14-144f-4fff-856c-6d0b79f662fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:52.579557 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790da14-144f-4fff-856c-6d0b79f662fa admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:52.579952 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790da14-144f-4fff-856c-6d0b79f662fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:52.587087 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790da14-144f-4fff-856c-6d0b79f662fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:52.589836 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790da14-144f-4fff-856c-6d0b79f662fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:52.593100 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790da14-144f-4fff-856c-6d0b79f662fa admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:52.613501 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1032/2064] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:52 2021] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:52.617689 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfe5be-15cc-4dd7-b2a3-0487daa0f178 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:52.632743 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfe5be-15cc-4dd7-b2a3-0487daa0f178 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:52.638689 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9fe5a-09d7-4436-82eb-b671d651b458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:52.639719 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9fe5a-09d7-4436-82eb-b671d651b458 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:52.640135 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9fe5a-09d7-4436-82eb-b671d651b458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:52.640831 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9fe5a-09d7-4436-82eb-b671d651b458 admin admin] PATH_INFO: `/v3/projects/143e05c2fed349eaa7d5d883a9f35b35/users/0a76c4d591b440e69f3ad42b27431e7c/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:52.650014 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e9fe5a-09d7-4436-82eb-b671d651b458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=143e05c2fed349eaa7d5d883a9f35b35, user_id=0a76c4d591b440e69f3ad42b27431e7c, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:52.653195 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e9fe5a-09d7-4436-82eb-b671d651b458 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:52.675344 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1033/2065] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:52 2021] PUT /identity/v3/projects/143e05c2fed349eaa7d5d883a9f35b35/users/0a76c4d591b440e69f3ad42b27431e7c/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:52.677718 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ce606-fbbe-48a5-ade2-293d5f35f266 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:52.684610 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ce606-fbbe-48a5-ade2-293d5f35f266 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:52.684995 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ce606-fbbe-48a5-ade2-293d5f35f266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:52.741035 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-bd6ce606-fbbe-48a5-ade2-293d5f35f266 None None] MFA Rules not processed for user `0a76c4d591b440e69f3ad42b27431e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:52.746947 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-bd6ce606-fbbe-48a5-ade2-293d5f35f266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:52.882800 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1033/2066] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:52 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:52.894284 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9fe5a-09d7-4436-82eb-b671d651b458 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:52.900288 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-17e9fe5a-09d7-4436-82eb-b671d651b458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:52.978077 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9fe5a-09d7-4436-82eb-b671d651b458 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:52.985649 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da741b-89da-4425-ab9b-65e4310f784d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:52.986748 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da741b-89da-4425-ab9b-65e4310f784d service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:52.987790 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da741b-89da-4425-ab9b-65e4310f784d service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:52.988236 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da741b-89da-4425-ab9b-65e4310f784d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:53.004350 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da741b-89da-4425-ab9b-65e4310f784d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:53.006169 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da741b-89da-4425-ab9b-65e4310f784d service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:53.019561 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1034/2067] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:52 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:53.081379 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ce606-fbbe-48a5-ade2-293d5f35f266 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:53.093022 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ce606-fbbe-48a5-ade2-293d5f35f266 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:53.097774 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631045e-abb3-40ab-8344-2f1928f79844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:53.098497 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631045e-abb3-40ab-8344-2f1928f79844 service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:53.098762 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631045e-abb3-40ab-8344-2f1928f79844 service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:53.099042 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631045e-abb3-40ab-8344-2f1928f79844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:53.234399 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631045e-abb3-40ab-8344-2f1928f79844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:53.236217 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631045e-abb3-40ab-8344-2f1928f79844 service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:53.276052 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1034/2068] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:53 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:53.286714 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da741b-89da-4425-ab9b-65e4310f784d service cinder] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:53.288683 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-f5da741b-89da-4425-ab9b-65e4310f784d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:53.470053 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da741b-89da-4425-ab9b-65e4310f784d service cinder] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:53.475509 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa42c8-ff71-47e9-8d80-1f8794c00e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:53.476805 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa42c8-ff71-47e9-8d80-1f8794c00e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:53.477595 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa42c8-ff71-47e9-8d80-1f8794c00e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:53.477893 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa42c8-ff71-47e9-8d80-1f8794c00e1d admin admin] PATH_INFO: `/v3/projects/81143c66983141118ab0773b79c93045` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:53.479244 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa42c8-ff71-47e9-8d80-1f8794c00e1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=81143c66983141118ab0773b79c93045)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:53.481194 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa42c8-ff71-47e9-8d80-1f8794c00e1d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:53.552749 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-dcaa42c8-ff71-47e9-8d80-1f8794c00e1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81143c66983141118ab0773b79c93045', 'request_id': 'req-dcaa42c8-ff71-47e9-8d80-1f8794c00e1d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:53.566536 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-dcaa42c8-ff71-47e9-8d80-1f8794c00e1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81143c66983141118ab0773b79c93045', 'request_id': 'req-dcaa42c8-ff71-47e9-8d80-1f8794c00e1d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:53.577194 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-dcaa42c8-ff71-47e9-8d80-1f8794c00e1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81143c66983141118ab0773b79c93045', 'request_id': 'req-dcaa42c8-ff71-47e9-8d80-1f8794c00e1d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:53.591662 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-dcaa42c8-ff71-47e9-8d80-1f8794c00e1d admin admin] The token cache is being invalidate because project 81143c66983141118ab0773b79c93045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:53.592371 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-dcaa42c8-ff71-47e9-8d80-1f8794c00e1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:53.593321 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-dcaa42c8-ff71-47e9-8d80-1f8794c00e1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:53.595858 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1035/2069] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:53 2021] DELETE /identity/v3/projects/81143c66983141118ab0773b79c93045 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:11:53.599665 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631045e-abb3-40ab-8344-2f1928f79844 service cinder] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:53.616482 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631045e-abb3-40ab-8344-2f1928f79844 service cinder] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:53.721878 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22828f8-aa08-4599-ba09-761b87bb0ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:53.722960 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22828f8-aa08-4599-ba09-761b87bb0ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:53.723253 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22828f8-aa08-4599-ba09-761b87bb0ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:53.723539 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22828f8-aa08-4599-ba09-761b87bb0ed9 admin admin] PATH_INFO: `/v3/users/07d6aee337d34790b24a43366bad64fd` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:53.724814 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22828f8-aa08-4599-ba09-761b87bb0ed9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07d6aee337d34790b24a43366bad64fd)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:53.727281 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22828f8-aa08-4599-ba09-761b87bb0ed9 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:53.814671 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-a22828f8-aa08-4599-ba09-761b87bb0ed9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07d6aee337d34790b24a43366bad64fd'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:53.815644 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-a22828f8-aa08-4599-ba09-761b87bb0ed9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07d6aee337d34790b24a43366bad64fd'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:53.816471 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-a22828f8-aa08-4599-ba09-761b87bb0ed9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07d6aee337d34790b24a43366bad64fd'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:53.831890 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-a22828f8-aa08-4599-ba09-761b87bb0ed9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07d6aee337d34790b24a43366bad64fd'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:53.846652 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-a22828f8-aa08-4599-ba09-761b87bb0ed9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07d6aee337d34790b24a43366bad64fd'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:53.885788 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1035/2070] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:53 2021] DELETE /identity/v3/users/07d6aee337d34790b24a43366bad64fd => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:54.420567 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa42c8-ff71-47e9-8d80-1f8794c00e1d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:54.422850 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-dcaa42c8-ff71-47e9-8d80-1f8794c00e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:54.450042 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa42c8-ff71-47e9-8d80-1f8794c00e1d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:54.564141 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54655f6b-8a4b-441d-b76f-63ed822654b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:54.565121 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54655f6b-8a4b-441d-b76f-63ed822654b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:54.565929 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54655f6b-8a4b-441d-b76f-63ed822654b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:54.566219 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54655f6b-8a4b-441d-b76f-63ed822654b1 admin admin] PATH_INFO: `/v3/projects/8e9a21bbc975438b9770abe1dd9cf20a` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:54.567867 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54655f6b-8a4b-441d-b76f-63ed822654b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e9a21bbc975438b9770abe1dd9cf20a)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:54.570395 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54655f6b-8a4b-441d-b76f-63ed822654b1 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:54.640940 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-54655f6b-8a4b-441d-b76f-63ed822654b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e9a21bbc975438b9770abe1dd9cf20a', 'request_id': 'req-54655f6b-8a4b-441d-b76f-63ed822654b1'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:54.653744 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-54655f6b-8a4b-441d-b76f-63ed822654b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e9a21bbc975438b9770abe1dd9cf20a', 'request_id': 'req-54655f6b-8a4b-441d-b76f-63ed822654b1'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:54.673195 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-54655f6b-8a4b-441d-b76f-63ed822654b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e9a21bbc975438b9770abe1dd9cf20a', 'request_id': 'req-54655f6b-8a4b-441d-b76f-63ed822654b1'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:54.685728 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-54655f6b-8a4b-441d-b76f-63ed822654b1 admin admin] The token cache is being invalidate because project 8e9a21bbc975438b9770abe1dd9cf20a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:54.686022 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-54655f6b-8a4b-441d-b76f-63ed822654b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:54.686741 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-54655f6b-8a4b-441d-b76f-63ed822654b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:54.688846 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1036/2071] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:54 2021] DELETE /identity/v3/projects/8e9a21bbc975438b9770abe1dd9cf20a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:54.694784 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0ebdb-a1ad-468b-a805-a05fa0f46152 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:54.695422 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0ebdb-a1ad-468b-a805-a05fa0f46152 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:54.695422 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0ebdb-a1ad-468b-a805-a05fa0f46152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:54.716287 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-d3a0ebdb-a1ad-468b-a805-a05fa0f46152 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:54.717784 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-d3a0ebdb-a1ad-468b-a805-a05fa0f46152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:54.788572 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1036/2072] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:54.796475 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b691494-6d98-4198-bfb4-3bfbe2abd76a None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:54.796763 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b691494-6d98-4198-bfb4-3bfbe2abd76a None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:54.797134 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b691494-6d98-4198-bfb4-3bfbe2abd76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:54.822794 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-2b691494-6d98-4198-bfb4-3bfbe2abd76a None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:54.824005 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-2b691494-6d98-4198-bfb4-3bfbe2abd76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:54.832853 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1037/2073] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:54.837447 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0ebdb-a1ad-468b-a805-a05fa0f46152 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:54.847169 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0ebdb-a1ad-468b-a805-a05fa0f46152 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:54.853432 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f3ec2-94d1-49f8-aae5-154af5c78eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:54.855300 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f3ec2-94d1-49f8-aae5-154af5c78eaf admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:54.855697 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f3ec2-94d1-49f8-aae5-154af5c78eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:54.856148 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f3ec2-94d1-49f8-aae5-154af5c78eaf admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:54.856990 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f3ec2-94d1-49f8-aae5-154af5c78eaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:54.857413 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f3ec2-94d1-49f8-aae5-154af5c78eaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:54.859162 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f3ec2-94d1-49f8-aae5-154af5c78eaf admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:54.872502 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1037/2074] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:11:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:54.878495 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b691494-6d98-4198-bfb4-3bfbe2abd76a None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:54.889315 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b691494-6d98-4198-bfb4-3bfbe2abd76a None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:54.896857 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b266b8-3f1f-408d-8a60-fcbbdf5b304b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:54.896857 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b266b8-3f1f-408d-8a60-fcbbdf5b304b admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:54.896857 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b266b8-3f1f-408d-8a60-fcbbdf5b304b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:54.896857 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b266b8-3f1f-408d-8a60-fcbbdf5b304b admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:54.897269 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b266b8-3f1f-408d-8a60-fcbbdf5b304b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:54.899024 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b266b8-3f1f-408d-8a60-fcbbdf5b304b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:54.938809 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1038/2075] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:54 2021] POST /identity/v3/projects => generated 387 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:54.942677 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f3ec2-94d1-49f8-aae5-154af5c78eaf admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:54.956715 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f3ec2-94d1-49f8-aae5-154af5c78eaf admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:55.062750 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13b23b-2e94-468e-9d3c-14293a722894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:55.063433 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13b23b-2e94-468e-9d3c-14293a722894 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:55.063716 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13b23b-2e94-468e-9d3c-14293a722894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:55.064079 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13b23b-2e94-468e-9d3c-14293a722894 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:55.064793 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13b23b-2e94-468e-9d3c-14293a722894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:55.076075 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13b23b-2e94-468e-9d3c-14293a722894 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:55.110835 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1038/2076] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:54 2021] POST /identity/v3/users => generated 294 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:55.114852 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b266b8-3f1f-408d-8a60-fcbbdf5b304b admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:55.128518 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b266b8-3f1f-408d-8a60-fcbbdf5b304b admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:55.136643 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47410e8-8c17-4e18-a745-937f04b4d058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:55.137312 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47410e8-8c17-4e18-a745-937f04b4d058 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:55.137624 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47410e8-8c17-4e18-a745-937f04b4d058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:55.137903 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47410e8-8c17-4e18-a745-937f04b4d058 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:55.138643 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47410e8-8c17-4e18-a745-937f04b4d058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:55.140252 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47410e8-8c17-4e18-a745-937f04b4d058 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:55.161286 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1039/2077] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:55 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:55.162545 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13b23b-2e94-468e-9d3c-14293a722894 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:55.177423 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13b23b-2e94-468e-9d3c-14293a722894 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:55.190361 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13fdb5-5632-4b1c-9e59-abff19d28d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:55.191411 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13fdb5-5632-4b1c-9e59-abff19d28d83 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:55.191411 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13fdb5-5632-4b1c-9e59-abff19d28d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:55.191598 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13fdb5-5632-4b1c-9e59-abff19d28d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:55.192562 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13fdb5-5632-4b1c-9e59-abff19d28d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:55.195270 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13fdb5-5632-4b1c-9e59-abff19d28d83 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:55.220269 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1039/2078] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:55 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:55.225087 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47410e8-8c17-4e18-a745-937f04b4d058 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:55.240439 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47410e8-8c17-4e18-a745-937f04b4d058 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:55.260301 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde4fce-82b8-4dc2-a63a-52b27da41d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:55.261590 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde4fce-82b8-4dc2-a63a-52b27da41d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:55.264406 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde4fce-82b8-4dc2-a63a-52b27da41d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:55.266572 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde4fce-82b8-4dc2-a63a-52b27da41d83 admin admin] PATH_INFO: `/v3/projects/f2cccc4efefd4d668831019a221d4997/users/2aa3d741cd12449e82566763adf74338/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:55.280635 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13fdb5-5632-4b1c-9e59-abff19d28d83 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:55.282966 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-6c13fdb5-5632-4b1c-9e59-abff19d28d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:55.302482 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde4fce-82b8-4dc2-a63a-52b27da41d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2cccc4efefd4d668831019a221d4997, user_id=2aa3d741cd12449e82566763adf74338, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:55.305565 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde4fce-82b8-4dc2-a63a-52b27da41d83 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:55.323488 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13fdb5-5632-4b1c-9e59-abff19d28d83 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:55.335897 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1040/2079] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:55 2021] PUT /identity/v3/projects/f2cccc4efefd4d668831019a221d4997/users/2aa3d741cd12449e82566763adf74338/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:55.337528 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89f143-1bc3-4a8c-b478-3957fde93c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:55.339078 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89f143-1bc3-4a8c-b478-3957fde93c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:55.346922 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1ce50-cd39-4391-ba24-e400aaba1ad1 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:55.347217 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1ce50-cd39-4391-ba24-e400aaba1ad1 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:55.347497 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1ce50-cd39-4391-ba24-e400aaba1ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:55.354860 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89f143-1bc3-4a8c-b478-3957fde93c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:55.355544 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89f143-1bc3-4a8c-b478-3957fde93c13 admin admin] PATH_INFO: `/v3/users/4753209e143d4633a4e40f09bd4b5da7` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:55.358148 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e89f143-1bc3-4a8c-b478-3957fde93c13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4753209e143d4633a4e40f09bd4b5da7)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:55.361864 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e89f143-1bc3-4a8c-b478-3957fde93c13 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:55.412591 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-d9a1ce50-cd39-4391-ba24-e400aaba1ad1 None None] MFA Rules not processed for user `2aa3d741cd12449e82566763adf74338`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:55.417052 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-d9a1ce50-cd39-4391-ba24-e400aaba1ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:55.447110 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-5e89f143-1bc3-4a8c-b478-3957fde93c13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4753209e143d4633a4e40f09bd4b5da7'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:55.447809 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-5e89f143-1bc3-4a8c-b478-3957fde93c13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4753209e143d4633a4e40f09bd4b5da7'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:55.456077 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-5e89f143-1bc3-4a8c-b478-3957fde93c13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4753209e143d4633a4e40f09bd4b5da7'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:55.465466 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-5e89f143-1bc3-4a8c-b478-3957fde93c13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4753209e143d4633a4e40f09bd4b5da7'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:55.488411 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-5e89f143-1bc3-4a8c-b478-3957fde93c13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4753209e143d4633a4e40f09bd4b5da7'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:55.517724 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1040/2080] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:55 2021] DELETE /identity/v3/users/4753209e143d4633a4e40f09bd4b5da7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:55.524153 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c967e48-43aa-41e5-b38d-544d7d1732d3 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:55.525749 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c967e48-43aa-41e5-b38d-544d7d1732d3 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:55.526262 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c967e48-43aa-41e5-b38d-544d7d1732d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:55.548383 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-5c967e48-43aa-41e5-b38d-544d7d1732d3 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:55.550106 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-5c967e48-43aa-41e5-b38d-544d7d1732d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:55.636066 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1041/2081] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:55 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:55.640207 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1ce50-cd39-4391-ba24-e400aaba1ad1 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:55.643790 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-d9a1ce50-cd39-4391-ba24-e400aaba1ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:55.663057 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1041/2082] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:55.700181 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c967e48-43aa-41e5-b38d-544d7d1732d3 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:55.702840 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-5c967e48-43aa-41e5-b38d-544d7d1732d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:55.776891 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1ce50-cd39-4391-ba24-e400aaba1ad1 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:55.787600 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c66215-fedc-47c3-902d-99728bc04ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:55.788291 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c66215-fedc-47c3-902d-99728bc04ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:55.788706 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c66215-fedc-47c3-902d-99728bc04ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:55.789424 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c66215-fedc-47c3-902d-99728bc04ed7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:55.790167 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c66215-fedc-47c3-902d-99728bc04ed7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:55.795422 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c66215-fedc-47c3-902d-99728bc04ed7 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:55.847131 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c967e48-43aa-41e5-b38d-544d7d1732d3 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:55.855326 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04803a16-be3e-4db6-a706-9eb2c412eb81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:55.855986 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04803a16-be3e-4db6-a706-9eb2c412eb81 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:55.856266 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04803a16-be3e-4db6-a706-9eb2c412eb81 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:55.856543 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04803a16-be3e-4db6-a706-9eb2c412eb81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:55.860978 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1042/2083] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:55 2021] POST /identity/v3/projects => generated 387 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:11:55.865880 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c66215-fedc-47c3-902d-99728bc04ed7 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:55.880089 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04803a16-be3e-4db6-a706-9eb2c412eb81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:55.884129 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04803a16-be3e-4db6-a706-9eb2c412eb81 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:55.918536 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1042/2084] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:11:55.993998 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c66215-fedc-47c3-902d-99728bc04ed7 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:56.017166 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fe44d-8d89-4c85-ba0f-b06ee0a64738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:56.017994 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fe44d-8d89-4c85-ba0f-b06ee0a64738 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:56.018283 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fe44d-8d89-4c85-ba0f-b06ee0a64738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:56.018561 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fe44d-8d89-4c85-ba0f-b06ee0a64738 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:56.022113 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fe44d-8d89-4c85-ba0f-b06ee0a64738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:56.027909 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fe44d-8d89-4c85-ba0f-b06ee0a64738 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:56.121351 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1043/2085] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:55 2021] POST /identity/v3/users => generated 294 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:56.125527 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04803a16-be3e-4db6-a706-9eb2c412eb81 service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:56.144217 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04803a16-be3e-4db6-a706-9eb2c412eb81 service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:56.169816 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f15346-20a3-4776-ab87-93340141fe69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:56.175322 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f15346-20a3-4776-ab87-93340141fe69 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:56.175944 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f15346-20a3-4776-ab87-93340141fe69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:56.176861 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f15346-20a3-4776-ab87-93340141fe69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:56.179092 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f15346-20a3-4776-ab87-93340141fe69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:56.185204 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f15346-20a3-4776-ab87-93340141fe69 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:56.214523 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1043/2086] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:56 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:11:56.217318 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fe44d-8d89-4c85-ba0f-b06ee0a64738 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:56.230757 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fe44d-8d89-4c85-ba0f-b06ee0a64738 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:56.243803 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2783a9-f16b-4ec4-94fc-5f78b0ab9e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:56.245800 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2783a9-f16b-4ec4-94fc-5f78b0ab9e48 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:56.246250 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2783a9-f16b-4ec4-94fc-5f78b0ab9e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:56.246700 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2783a9-f16b-4ec4-94fc-5f78b0ab9e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:56.247602 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2783a9-f16b-4ec4-94fc-5f78b0ab9e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:56.252934 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2783a9-f16b-4ec4-94fc-5f78b0ab9e48 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:56.266241 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1044/2087] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:56 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:56.270383 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f15346-20a3-4776-ab87-93340141fe69 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:56.284414 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f15346-20a3-4776-ab87-93340141fe69 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:56.310262 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c0e84-4a2b-421f-8a7e-8e726a3d2e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:56.311427 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c0e84-4a2b-421f-8a7e-8e726a3d2e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:56.311730 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c0e84-4a2b-421f-8a7e-8e726a3d2e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:56.312002 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c0e84-4a2b-421f-8a7e-8e726a3d2e91 admin admin] PATH_INFO: `/v3/projects/0024cbd69e614b2188e110a84e28b372/users/6e07c2c7b1854fc4bf4c99a814164e2e/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:56.339563 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c0e84-4a2b-421f-8a7e-8e726a3d2e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0024cbd69e614b2188e110a84e28b372, user_id=6e07c2c7b1854fc4bf4c99a814164e2e, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:56.342730 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c0e84-4a2b-421f-8a7e-8e726a3d2e91 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:56.369441 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1044/2088] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:56 2021] PUT /identity/v3/projects/0024cbd69e614b2188e110a84e28b372/users/6e07c2c7b1854fc4bf4c99a814164e2e/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:56.378085 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618a17b-b6cf-47f0-ae9a-ed8c8f306dda None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:56.378622 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618a17b-b6cf-47f0-ae9a-ed8c8f306dda None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:56.379052 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618a17b-b6cf-47f0-ae9a-ed8c8f306dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:56.425678 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-c618a17b-b6cf-47f0-ae9a-ed8c8f306dda None None] MFA Rules not processed for user `6e07c2c7b1854fc4bf4c99a814164e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:56.428448 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-c618a17b-b6cf-47f0-ae9a-ed8c8f306dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:56.604183 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c0e84-4a2b-421f-8a7e-8e726a3d2e91 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:56.607060 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-719c0e84-4a2b-421f-8a7e-8e726a3d2e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:56.625304 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1045/2089] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:56 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:56.629619 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618a17b-b6cf-47f0-ae9a-ed8c8f306dda None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:56.746727 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618a17b-b6cf-47f0-ae9a-ed8c8f306dda None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:56.750290 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c0e84-4a2b-421f-8a7e-8e726a3d2e91 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:56.761483 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9f0ef-a08c-4d20-8ac2-70ce9e013a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:56.762218 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9f0ef-a08c-4d20-8ac2-70ce9e013a44 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:56.762693 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9f0ef-a08c-4d20-8ac2-70ce9e013a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:56.763030 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9f0ef-a08c-4d20-8ac2-70ce9e013a44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:56.763712 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9f0ef-a08c-4d20-8ac2-70ce9e013a44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:56.766011 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9f0ef-a08c-4d20-8ac2-70ce9e013a44 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:56.776380 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1785e-ca43-4fdc-80a0-d30f0a304595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:56.779656 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1785e-ca43-4fdc-80a0-d30f0a304595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:56.780097 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1785e-ca43-4fdc-80a0-d30f0a304595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:56.780557 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1785e-ca43-4fdc-80a0-d30f0a304595 admin admin] PATH_INFO: `/v3/projects/27b15d4316704cdcad0ad543faef625e` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:56.786473 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1785e-ca43-4fdc-80a0-d30f0a304595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27b15d4316704cdcad0ad543faef625e)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:56.792338 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1785e-ca43-4fdc-80a0-d30f0a304595 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:56.834610 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1046/2090] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:56 2021] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:56.841314 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9f0ef-a08c-4d20-8ac2-70ce9e013a44 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:56.959033 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-47f1785e-ca43-4fdc-80a0-d30f0a304595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27b15d4316704cdcad0ad543faef625e', 'request_id': 'req-47f1785e-ca43-4fdc-80a0-d30f0a304595'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:56.982962 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-47f1785e-ca43-4fdc-80a0-d30f0a304595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27b15d4316704cdcad0ad543faef625e', 'request_id': 'req-47f1785e-ca43-4fdc-80a0-d30f0a304595'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:56.989964 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-47f1785e-ca43-4fdc-80a0-d30f0a304595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27b15d4316704cdcad0ad543faef625e', 'request_id': 'req-47f1785e-ca43-4fdc-80a0-d30f0a304595'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:57.015356 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-47f1785e-ca43-4fdc-80a0-d30f0a304595 admin admin] The token cache is being invalidate because project 27b15d4316704cdcad0ad543faef625e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:57.017358 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-47f1785e-ca43-4fdc-80a0-d30f0a304595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:57.019499 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-47f1785e-ca43-4fdc-80a0-d30f0a304595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:57.026225 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1045/2091] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:56 2021] DELETE /identity/v3/projects/27b15d4316704cdcad0ad543faef625e => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:11:57.031967 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5519fd-61d5-4493-867a-e68c13cccaea None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:57.032803 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5519fd-61d5-4493-867a-e68c13cccaea None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:57.033291 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5519fd-61d5-4493-867a-e68c13cccaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:57.044963 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9f0ef-a08c-4d20-8ac2-70ce9e013a44 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:57.086652 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-4e5519fd-61d5-4493-867a-e68c13cccaea None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:57.088028 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-4e5519fd-61d5-4493-867a-e68c13cccaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:57.172010 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2e055-07ab-4806-9c8c-6f4ec3fc6c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:57.172706 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2e055-07ab-4806-9c8c-6f4ec3fc6c06 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:57.172992 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2e055-07ab-4806-9c8c-6f4ec3fc6c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:57.173271 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2e055-07ab-4806-9c8c-6f4ec3fc6c06 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:57.174014 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2e055-07ab-4806-9c8c-6f4ec3fc6c06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:57.180893 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2e055-07ab-4806-9c8c-6f4ec3fc6c06 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:57.228584 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1046/2092] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:57.231247 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26eb75f-aa45-4a4e-8873-2e4fed21ebd1 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:57.231548 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26eb75f-aa45-4a4e-8873-2e4fed21ebd1 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:57.231836 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26eb75f-aa45-4a4e-8873-2e4fed21ebd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:57.243760 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1047/2093] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:56 2021] POST /identity/v3/users => generated 299 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:57.249743 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2e055-07ab-4806-9c8c-6f4ec3fc6c06 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:57.257913 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-6ee2e055-07ab-4806-9c8c-6f4ec3fc6c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:57.261368 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-c26eb75f-aa45-4a4e-8873-2e4fed21ebd1 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:57.262834 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c26eb75f-aa45-4a4e-8873-2e4fed21ebd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:57.278779 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2e055-07ab-4806-9c8c-6f4ec3fc6c06 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:57.294059 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1047/2094] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:11:57.299125 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26eb75f-aa45-4a4e-8873-2e4fed21ebd1 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:57.306800 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a9cd7-bbca-4af0-8a5f-d269f6f2c84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:57.309013 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a9cd7-bbca-4af0-8a5f-d269f6f2c84c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:57.309413 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a9cd7-bbca-4af0-8a5f-d269f6f2c84c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:57.309771 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a9cd7-bbca-4af0-8a5f-d269f6f2c84c admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:57.310654 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a9cd7-bbca-4af0-8a5f-d269f6f2c84c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:57.314851 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a9cd7-bbca-4af0-8a5f-d269f6f2c84c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:57.376372 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26eb75f-aa45-4a4e-8873-2e4fed21ebd1 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:57.376702 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1048/2095] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:57 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:57.382013 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a9cd7-bbca-4af0-8a5f-d269f6f2c84c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:57.407868 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f60c8-0e70-428b-a74a-057f712a7d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:57.409267 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f60c8-0e70-428b-a74a-057f712a7d1a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:57.414645 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f60c8-0e70-428b-a74a-057f712a7d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:57.415414 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f60c8-0e70-428b-a74a-057f712a7d1a admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:57.418317 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f60c8-0e70-428b-a74a-057f712a7d1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:11:57.420818 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f60c8-0e70-428b-a74a-057f712a7d1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:57.426671 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f60c8-0e70-428b-a74a-057f712a7d1a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:57.431981 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a9cd7-bbca-4af0-8a5f-d269f6f2c84c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:57.452512 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd543774-44a8-4af3-b528-8203105338eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:57.455071 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd543774-44a8-4af3-b528-8203105338eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:57.456508 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd543774-44a8-4af3-b528-8203105338eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:57.457015 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd543774-44a8-4af3-b528-8203105338eb admin admin] PATH_INFO: `/v3/projects/800b51e67dc044668706a390c7cb898a/users/58f2bf08c0044ceaa5943ae200f0607a/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:57.464615 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1048/2096] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:11:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:11:57.479674 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f60c8-0e70-428b-a74a-057f712a7d1a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:57.492947 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f60c8-0e70-428b-a74a-057f712a7d1a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:57.499906 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd543774-44a8-4af3-b528-8203105338eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=800b51e67dc044668706a390c7cb898a, user_id=58f2bf08c0044ceaa5943ae200f0607a, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:57.504517 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd543774-44a8-4af3-b528-8203105338eb admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:57.512846 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4aaef-1a51-4614-aadc-3c41cdc7b1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:57.513666 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4aaef-1a51-4614-aadc-3c41cdc7b1b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:57.514026 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4aaef-1a51-4614-aadc-3c41cdc7b1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:57.514377 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4aaef-1a51-4614-aadc-3c41cdc7b1b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:57.515189 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4aaef-1a51-4614-aadc-3c41cdc7b1b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:57.518310 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4aaef-1a51-4614-aadc-3c41cdc7b1b2 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:57.555090 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1049/2097] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:57 2021] PUT /identity/v3/projects/800b51e67dc044668706a390c7cb898a/users/58f2bf08c0044ceaa5943ae200f0607a/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:57.555090 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd543774-44a8-4af3-b528-8203105338eb admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:57.626048 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1049/2098] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:11:57 2021] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:57.630029 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4aaef-1a51-4614-aadc-3c41cdc7b1b2 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:57.736207 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd543774-44a8-4af3-b528-8203105338eb admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:57.738332 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4aaef-1a51-4614-aadc-3c41cdc7b1b2 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:57.743984 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7847a86-568e-4cb9-8257-2b410e77c70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:57.746752 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7847a86-568e-4cb9-8257-2b410e77c70b admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:57.747255 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7847a86-568e-4cb9-8257-2b410e77c70b admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:57.747418 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7847a86-568e-4cb9-8257-2b410e77c70b admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:57.748131 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7847a86-568e-4cb9-8257-2b410e77c70b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:57.750257 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ff018-af61-4c6c-9abb-411e868a1d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:57.750761 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7847a86-568e-4cb9-8257-2b410e77c70b admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:57.751136 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ff018-af61-4c6c-9abb-411e868a1d5b admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:57.751220 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ff018-af61-4c6c-9abb-411e868a1d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:57.751638 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ff018-af61-4c6c-9abb-411e868a1d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:57.752612 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ff018-af61-4c6c-9abb-411e868a1d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:57.754408 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ff018-af61-4c6c-9abb-411e868a1d5b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:57.769890 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1050/2099] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:57 2021] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:57.770833 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ff018-af61-4c6c-9abb-411e868a1d5b admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:57.774503 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-628ff018-af61-4c6c-9abb-411e868a1d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:57.792372 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ff018-af61-4c6c-9abb-411e868a1d5b admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:57.800674 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538894b-12d5-4c3c-ada7-7566b5f747a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:57.801748 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538894b-12d5-4c3c-ada7-7566b5f747a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:57.802108 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538894b-12d5-4c3c-ada7-7566b5f747a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:57.802492 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538894b-12d5-4c3c-ada7-7566b5f747a2 admin admin] PATH_INFO: `/v3/users/f20e74a1476a406fb953dd08578da474` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:57.804791 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538894b-12d5-4c3c-ada7-7566b5f747a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f20e74a1476a406fb953dd08578da474)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:57.807248 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538894b-12d5-4c3c-ada7-7566b5f747a2 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:57.807746 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1050/2100] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:11:57 2021] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:11:57.808729 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7847a86-568e-4cb9-8257-2b410e77c70b admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:57.827812 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7847a86-568e-4cb9-8257-2b410e77c70b admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:57.852966 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326400e4-f469-4ba4-9183-7f609f60a812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:57.858632 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326400e4-f469-4ba4-9183-7f609f60a812 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:57.861585 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326400e4-f469-4ba4-9183-7f609f60a812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:57.861885 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326400e4-f469-4ba4-9183-7f609f60a812 admin admin] PATH_INFO: `/v3/projects/800b51e67dc044668706a390c7cb898a/users/58f2bf08c0044ceaa5943ae200f0607a/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:57.872083 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326400e4-f469-4ba4-9183-7f609f60a812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=800b51e67dc044668706a390c7cb898a, user_id=58f2bf08c0044ceaa5943ae200f0607a, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:57.877495 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326400e4-f469-4ba4-9183-7f609f60a812 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:57.906098 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1051/2101] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:57 2021] PUT /identity/v3/projects/800b51e67dc044668706a390c7cb898a/users/58f2bf08c0044ceaa5943ae200f0607a/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:57.917294 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326400e4-f469-4ba4-9183-7f609f60a812 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:57.949489 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5538894b-12d5-4c3c-ada7-7566b5f747a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f20e74a1476a406fb953dd08578da474'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:57.950756 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5538894b-12d5-4c3c-ada7-7566b5f747a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f20e74a1476a406fb953dd08578da474'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:57.982972 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5538894b-12d5-4c3c-ada7-7566b5f747a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f20e74a1476a406fb953dd08578da474'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:57.987450 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5538894b-12d5-4c3c-ada7-7566b5f747a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f20e74a1476a406fb953dd08578da474'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:58.007316 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5538894b-12d5-4c3c-ada7-7566b5f747a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f20e74a1476a406fb953dd08578da474'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:58.058994 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1051/2102] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:57 2021] DELETE /identity/v3/users/f20e74a1476a406fb953dd08578da474 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:58.060721 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b3a11-cbf3-41c6-8b18-ffe712e52ca1 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:58.061266 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b3a11-cbf3-41c6-8b18-ffe712e52ca1 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:58.061770 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b3a11-cbf3-41c6-8b18-ffe712e52ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:58.096560 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-971b3a11-cbf3-41c6-8b18-ffe712e52ca1 None None] MFA Rules not processed for user `58f2bf08c0044ceaa5943ae200f0607a`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:58.097928 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-971b3a11-cbf3-41c6-8b18-ffe712e52ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:58.183157 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326400e4-f469-4ba4-9183-7f609f60a812 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:58.260328 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1052/2103] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:58 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:58.260328 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475963a-6533-4ca7-b8af-a1e9a219aa82 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:58.260328 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475963a-6533-4ca7-b8af-a1e9a219aa82 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:58.260328 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475963a-6533-4ca7-b8af-a1e9a219aa82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:58.289451 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-2475963a-6533-4ca7-b8af-a1e9a219aa82 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:58.290704 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-2475963a-6533-4ca7-b8af-a1e9a219aa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:58.354536 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d623da-0930-497a-97f8-d1ca1409af57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:58.355197 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d623da-0930-497a-97f8-d1ca1409af57 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:58.355486 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d623da-0930-497a-97f8-d1ca1409af57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:58.355765 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d623da-0930-497a-97f8-d1ca1409af57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:58.356524 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d623da-0930-497a-97f8-d1ca1409af57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:58.358447 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d623da-0930-497a-97f8-d1ca1409af57 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:58.374058 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1052/2104] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:57 2021] GET /identity/v3/roles => generated 1420 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:58.374925 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d623da-0930-497a-97f8-d1ca1409af57 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:58.384474 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c1d623da-0930-497a-97f8-d1ca1409af57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:58.415016 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1053/2105] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:58.416095 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475963a-6533-4ca7-b8af-a1e9a219aa82 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:58.417693 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-2475963a-6533-4ca7-b8af-a1e9a219aa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:58.431251 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475963a-6533-4ca7-b8af-a1e9a219aa82 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:58.438071 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33875e3e-98ab-4f3d-817b-0f1a5dd29a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:58.438883 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33875e3e-98ab-4f3d-817b-0f1a5dd29a6d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:58.439269 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33875e3e-98ab-4f3d-817b-0f1a5dd29a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:58.439645 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33875e3e-98ab-4f3d-817b-0f1a5dd29a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:58.440492 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33875e3e-98ab-4f3d-817b-0f1a5dd29a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:58.442288 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33875e3e-98ab-4f3d-817b-0f1a5dd29a6d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:58.455980 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1054/2106] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:11:58 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:11:58.457040 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33875e3e-98ab-4f3d-817b-0f1a5dd29a6d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:58.459104 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-33875e3e-98ab-4f3d-817b-0f1a5dd29a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:58.550360 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33875e3e-98ab-4f3d-817b-0f1a5dd29a6d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:58.556395 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f0232-665f-4026-a960-b2b02299d1af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:58.557075 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d623da-0930-497a-97f8-d1ca1409af57 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:58.557282 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f0232-665f-4026-a960-b2b02299d1af service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:58.557692 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f0232-665f-4026-a960-b2b02299d1af service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:58.558065 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f0232-665f-4026-a960-b2b02299d1af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:58.566528 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d982c8-81c4-41b0-868a-6a54b1122084 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:58.567454 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d982c8-81c4-41b0-868a-6a54b1122084 service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:58.568244 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d982c8-81c4-41b0-868a-6a54b1122084 service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:58.568577 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d982c8-81c4-41b0-868a-6a54b1122084 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:58.571641 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f0232-665f-4026-a960-b2b02299d1af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:58.575776 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f0232-665f-4026-a960-b2b02299d1af service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:58.580547 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d982c8-81c4-41b0-868a-6a54b1122084 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:58.582038 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d982c8-81c4-41b0-868a-6a54b1122084 service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:58.591826 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1055/2107] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:58.593519 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f0232-665f-4026-a960-b2b02299d1af service neutron] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:58.605776 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1053/2108] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:58 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:58.626608 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f0232-665f-4026-a960-b2b02299d1af service neutron] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:58.640783 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854d2eb-1047-48bb-aa9c-ed4421d0bfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:58.644446 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854d2eb-1047-48bb-aa9c-ed4421d0bfc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:58.645096 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854d2eb-1047-48bb-aa9c-ed4421d0bfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:58.646859 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854d2eb-1047-48bb-aa9c-ed4421d0bfc3 admin admin] PATH_INFO: `/v3/projects/fc22adb06b1e405ea619c273ffb94020/users/aaa0c20019c84107b8324cd915ff78db/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:58.714594 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854d2eb-1047-48bb-aa9c-ed4421d0bfc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc22adb06b1e405ea619c273ffb94020, user_id=aaa0c20019c84107b8324cd915ff78db, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:58.717282 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854d2eb-1047-48bb-aa9c-ed4421d0bfc3 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:58.752076 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1056/2109] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:11:58 2021] PUT /identity/v3/projects/fc22adb06b1e405ea619c273ffb94020/users/aaa0c20019c84107b8324cd915ff78db/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:58.753281 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1aecc-cf99-43ac-8ab5-2f7e48901c7c None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:58.753719 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1aecc-cf99-43ac-8ab5-2f7e48901c7c None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:58.753856 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1aecc-cf99-43ac-8ab5-2f7e48901c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:58.801111 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-36e1aecc-cf99-43ac-8ab5-2f7e48901c7c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:11:58.802714 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-36e1aecc-cf99-43ac-8ab5-2f7e48901c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:58.951597 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1054/2110] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:11:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:11:58.980867 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854d2eb-1047-48bb-aa9c-ed4421d0bfc3 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:58.986243 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-b854d2eb-1047-48bb-aa9c-ed4421d0bfc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:59.100263 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854d2eb-1047-48bb-aa9c-ed4421d0bfc3 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:59.105778 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14fc7b-f18d-4d7c-9d97-9fedab0ecf7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:59.108712 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14fc7b-f18d-4d7c-9d97-9fedab0ecf7a service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:59.109004 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14fc7b-f18d-4d7c-9d97-9fedab0ecf7a service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:59.109303 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14fc7b-f18d-4d7c-9d97-9fedab0ecf7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:59.125976 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1aecc-cf99-43ac-8ab5-2f7e48901c7c None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:59.128007 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-36e1aecc-cf99-43ac-8ab5-2f7e48901c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:59.141637 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14fc7b-f18d-4d7c-9d97-9fedab0ecf7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:59.143166 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14fc7b-f18d-4d7c-9d97-9fedab0ecf7a service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:59.162384 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1aecc-cf99-43ac-8ab5-2f7e48901c7c None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:59.173635 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1057/2111] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:11:59.187135 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028431d-c678-4f31-aae1-0ab8326ec7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:59.188380 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028431d-c678-4f31-aae1-0ab8326ec7d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:59.188882 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028431d-c678-4f31-aae1-0ab8326ec7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:59.189313 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028431d-c678-4f31-aae1-0ab8326ec7d5 admin admin] PATH_INFO: `/v3/projects/054a45e4c26940028fc45fb27c827096` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:59.192430 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028431d-c678-4f31-aae1-0ab8326ec7d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=054a45e4c26940028fc45fb27c827096)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:59.196369 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028431d-c678-4f31-aae1-0ab8326ec7d5 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:59.255676 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-f028431d-c678-4f31-aae1-0ab8326ec7d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '054a45e4c26940028fc45fb27c827096', 'request_id': 'req-f028431d-c678-4f31-aae1-0ab8326ec7d5'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:59.268658 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-f028431d-c678-4f31-aae1-0ab8326ec7d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '054a45e4c26940028fc45fb27c827096', 'request_id': 'req-f028431d-c678-4f31-aae1-0ab8326ec7d5'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:59.276933 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-f028431d-c678-4f31-aae1-0ab8326ec7d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '054a45e4c26940028fc45fb27c827096', 'request_id': 'req-f028431d-c678-4f31-aae1-0ab8326ec7d5'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:59.305614 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-f028431d-c678-4f31-aae1-0ab8326ec7d5 admin admin] The token cache is being invalidate because project 054a45e4c26940028fc45fb27c827096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:11:59.306212 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-f028431d-c678-4f31-aae1-0ab8326ec7d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:59.307155 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-f028431d-c678-4f31-aae1-0ab8326ec7d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:59.312436 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1055/2112] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:11:59 2021] DELETE /identity/v3/projects/054a45e4c26940028fc45fb27c827096 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:11:59.313237 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14fc7b-f18d-4d7c-9d97-9fedab0ecf7a service neutron] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:59.324138 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14fc7b-f18d-4d7c-9d97-9fedab0ecf7a service neutron] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:59.406584 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fed2ae-5986-4b0e-9497-35c92ff92533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:59.408467 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fed2ae-5986-4b0e-9497-35c92ff92533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:59.408687 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fed2ae-5986-4b0e-9497-35c92ff92533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:59.409716 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fed2ae-5986-4b0e-9497-35c92ff92533 admin admin] PATH_INFO: `/v3/users/0a76c4d591b440e69f3ad42b27431e7c` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:59.411039 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fed2ae-5986-4b0e-9497-35c92ff92533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a76c4d591b440e69f3ad42b27431e7c)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:59.414185 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fed2ae-5986-4b0e-9497-35c92ff92533 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:59.470511 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028431d-c678-4f31-aae1-0ab8326ec7d5 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:11:59.472347 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f028431d-c678-4f31-aae1-0ab8326ec7d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:59.518169 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-98fed2ae-5986-4b0e-9497-35c92ff92533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a76c4d591b440e69f3ad42b27431e7c'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:59.518929 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-98fed2ae-5986-4b0e-9497-35c92ff92533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a76c4d591b440e69f3ad42b27431e7c'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:59.527538 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-98fed2ae-5986-4b0e-9497-35c92ff92533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a76c4d591b440e69f3ad42b27431e7c'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:59.528243 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-98fed2ae-5986-4b0e-9497-35c92ff92533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a76c4d591b440e69f3ad42b27431e7c'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:59.544230 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-98fed2ae-5986-4b0e-9497-35c92ff92533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a76c4d591b440e69f3ad42b27431e7c'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:11:59.572745 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1058/2113] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:11:59 2021] DELETE /identity/v3/users/0a76c4d591b440e69f3ad42b27431e7c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:11:59.602323 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028431d-c678-4f31-aae1-0ab8326ec7d5 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:11:59.739773 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf3fe1-8784-4f09-a16d-c8ab58f498b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:11:59.740454 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf3fe1-8784-4f09-a16d-c8ab58f498b6 service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:11:59.740738 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf3fe1-8784-4f09-a16d-c8ab58f498b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:11:59.741013 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf3fe1-8784-4f09-a16d-c8ab58f498b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:11:59.748669 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-2adf3fe1-8784-4f09-a16d-c8ab58f498b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:11:59.886376 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf3fe1-8784-4f09-a16d-c8ab58f498b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:11:59.887931 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf3fe1-8784-4f09-a16d-c8ab58f498b6 service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:11:59.911292 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1056/2114] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:11:59 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:12:00.408840 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fed2ae-5986-4b0e-9497-35c92ff92533 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:00.412884 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-98fed2ae-5986-4b0e-9497-35c92ff92533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:00.598968 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fed2ae-5986-4b0e-9497-35c92ff92533 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:00.607884 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e494286-0173-47b6-bed9-29b43e4ede52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:00.609136 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e494286-0173-47b6-bed9-29b43e4ede52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:00.609650 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e494286-0173-47b6-bed9-29b43e4ede52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:00.610158 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e494286-0173-47b6-bed9-29b43e4ede52 admin admin] PATH_INFO: `/v3/projects/143e05c2fed349eaa7d5d883a9f35b35` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:00.612827 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e494286-0173-47b6-bed9-29b43e4ede52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=143e05c2fed349eaa7d5d883a9f35b35)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:00.615486 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e494286-0173-47b6-bed9-29b43e4ede52 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:00.703195 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-2e494286-0173-47b6-bed9-29b43e4ede52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '143e05c2fed349eaa7d5d883a9f35b35', 'request_id': 'req-2e494286-0173-47b6-bed9-29b43e4ede52'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:00.714615 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-2e494286-0173-47b6-bed9-29b43e4ede52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '143e05c2fed349eaa7d5d883a9f35b35', 'request_id': 'req-2e494286-0173-47b6-bed9-29b43e4ede52'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:00.721550 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-2e494286-0173-47b6-bed9-29b43e4ede52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '143e05c2fed349eaa7d5d883a9f35b35', 'request_id': 'req-2e494286-0173-47b6-bed9-29b43e4ede52'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:00.735798 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-2e494286-0173-47b6-bed9-29b43e4ede52 admin admin] The token cache is being invalidate because project 143e05c2fed349eaa7d5d883a9f35b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:12:00.736154 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-2e494286-0173-47b6-bed9-29b43e4ede52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:00.736891 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-2e494286-0173-47b6-bed9-29b43e4ede52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:00.738949 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1059/2115] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:12:00 2021] DELETE /identity/v3/projects/143e05c2fed349eaa7d5d883a9f35b35 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:00.745318 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9250a19-8426-45e0-9a66-15c232e3e665 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:00.745645 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9250a19-8426-45e0-9a66-15c232e3e665 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:00.745928 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9250a19-8426-45e0-9a66-15c232e3e665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:00.770739 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-c9250a19-8426-45e0-9a66-15c232e3e665 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:00.772253 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c9250a19-8426-45e0-9a66-15c232e3e665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:00.881347 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1057/2116] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:00.890899 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc32e17-5753-4549-861f-2735b2933db4 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:00.892023 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc32e17-5753-4549-861f-2735b2933db4 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:00.895051 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc32e17-5753-4549-861f-2735b2933db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:00.941641 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-8cc32e17-5753-4549-861f-2735b2933db4 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:00.943429 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-8cc32e17-5753-4549-861f-2735b2933db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:00.967733 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1060/2117] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:00.971747 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9250a19-8426-45e0-9a66-15c232e3e665 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:00.985502 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9250a19-8426-45e0-9a66-15c232e3e665 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:00.999084 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329362e-5d2d-43f0-82b9-b4f152654129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:00.999798 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329362e-5d2d-43f0-82b9-b4f152654129 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:01.000073 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329362e-5d2d-43f0-82b9-b4f152654129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:01.000363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329362e-5d2d-43f0-82b9-b4f152654129 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:01.001188 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9329362e-5d2d-43f0-82b9-b4f152654129 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:12:01.001586 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9329362e-5d2d-43f0-82b9-b4f152654129 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:01.003424 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9329362e-5d2d-43f0-82b9-b4f152654129 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:01.029332 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1058/2118] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:12:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:12:01.033614 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc32e17-5753-4549-861f-2735b2933db4 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:01.044860 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc32e17-5753-4549-861f-2735b2933db4 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:01.065435 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65f47d-766c-4495-a678-869096e0a43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:01.066840 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65f47d-766c-4495-a678-869096e0a43c admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:01.067246 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65f47d-766c-4495-a678-869096e0a43c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:01.070495 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65f47d-766c-4495-a678-869096e0a43c admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:01.071967 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65f47d-766c-4495-a678-869096e0a43c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:01.082373 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65f47d-766c-4495-a678-869096e0a43c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:01.114184 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329362e-5d2d-43f0-82b9-b4f152654129 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:01.116210 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-9329362e-5d2d-43f0-82b9-b4f152654129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:01.147675 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329362e-5d2d-43f0-82b9-b4f152654129 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:01.155013 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1061/2119] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:12:01 2021] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:12:01.159393 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65f47d-766c-4495-a678-869096e0a43c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:01.162416 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c87a8-73fc-4693-a858-8c552849fa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:01.167640 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c87a8-73fc-4693-a858-8c552849fa82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:01.168132 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c87a8-73fc-4693-a858-8c552849fa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:01.169993 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c87a8-73fc-4693-a858-8c552849fa82 admin admin] PATH_INFO: `/v3/users/d1e314d7ae7a491ab057a93961c7c3b5` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:01.175789 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c87a8-73fc-4693-a858-8c552849fa82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1e314d7ae7a491ab057a93961c7c3b5)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:01.180082 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c87a8-73fc-4693-a858-8c552849fa82 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:01.287162 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65f47d-766c-4495-a678-869096e0a43c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:01.307286 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9c82c-ea7b-4cae-b767-fe082f575654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:01.309355 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9c82c-ea7b-4cae-b767-fe082f575654 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:01.309683 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9c82c-ea7b-4cae-b767-fe082f575654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:01.309968 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9c82c-ea7b-4cae-b767-fe082f575654 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:01.310296 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-0d4c87a8-73fc-4693-a858-8c552849fa82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1e314d7ae7a491ab057a93961c7c3b5'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:01.313081 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9c82c-ea7b-4cae-b767-fe082f575654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:01.313593 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-0d4c87a8-73fc-4693-a858-8c552849fa82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1e314d7ae7a491ab057a93961c7c3b5'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:01.316375 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9c82c-ea7b-4cae-b767-fe082f575654 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:01.316871 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-0d4c87a8-73fc-4693-a858-8c552849fa82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1e314d7ae7a491ab057a93961c7c3b5'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:01.341359 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-0d4c87a8-73fc-4693-a858-8c552849fa82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1e314d7ae7a491ab057a93961c7c3b5'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:01.358116 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-0d4c87a8-73fc-4693-a858-8c552849fa82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1e314d7ae7a491ab057a93961c7c3b5'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:01.368461 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1062/2120] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:12:01 2021] POST /identity/v3/users => generated 294 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:12:01.372751 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9c82c-ea7b-4cae-b767-fe082f575654 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:01.375236 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-acd9c82c-ea7b-4cae-b767-fe082f575654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:01.386099 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1059/2121] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:12:01 2021] DELETE /identity/v3/users/d1e314d7ae7a491ab057a93961c7c3b5 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:01.414321 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9c82c-ea7b-4cae-b767-fe082f575654 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:01.517135 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0a107-9786-4459-9176-d04452775396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:01.518705 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0a107-9786-4459-9176-d04452775396 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:01.520154 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0a107-9786-4459-9176-d04452775396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:01.520868 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0a107-9786-4459-9176-d04452775396 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:01.523263 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0a107-9786-4459-9176-d04452775396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:01.525113 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0a107-9786-4459-9176-d04452775396 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:01.543022 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1063/2122] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:01 2021] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:12:01.547963 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c87a8-73fc-4693-a858-8c552849fa82 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:01.565457 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c87a8-73fc-4693-a858-8c552849fa82 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:01.575507 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6ca93-d584-4301-baa2-ba3af941012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:01.576230 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6ca93-d584-4301-baa2-ba3af941012c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:01.576685 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6ca93-d584-4301-baa2-ba3af941012c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:01.576963 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6ca93-d584-4301-baa2-ba3af941012c admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:01.577788 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6ca93-d584-4301-baa2-ba3af941012c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:01.579406 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6ca93-d584-4301-baa2-ba3af941012c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:01.610049 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0a107-9786-4459-9176-d04452775396 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:01.619151 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1060/2123] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:01 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:01.624651 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0a107-9786-4459-9176-d04452775396 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:01.633540 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00916740-2a4b-413f-ac1a-327b2ee247b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:01.634854 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00916740-2a4b-413f-ac1a-327b2ee247b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:01.635209 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00916740-2a4b-413f-ac1a-327b2ee247b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:01.635554 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00916740-2a4b-413f-ac1a-327b2ee247b5 admin admin] PATH_INFO: `/v3/projects/e307aa6df4c74f658a336e3cefa818db/users/92d35d26b84a4c42907a16ec30d8c613/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:01.659339 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00916740-2a4b-413f-ac1a-327b2ee247b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e307aa6df4c74f658a336e3cefa818db, user_id=92d35d26b84a4c42907a16ec30d8c613, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:01.662568 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00916740-2a4b-413f-ac1a-327b2ee247b5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:01.699294 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1064/2124] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:12:01 2021] PUT /identity/v3/projects/e307aa6df4c74f658a336e3cefa818db/users/92d35d26b84a4c42907a16ec30d8c613/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:01.713843 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1f503-dd58-4cd2-812b-c8d27e31f0eb None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:01.715889 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1f503-dd58-4cd2-812b-c8d27e31f0eb None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:01.718819 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1f503-dd58-4cd2-812b-c8d27e31f0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:01.727748 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00916740-2a4b-413f-ac1a-327b2ee247b5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:01.729529 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-00916740-2a4b-413f-ac1a-327b2ee247b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:01.792595 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-adc1f503-dd58-4cd2-812b-c8d27e31f0eb None None] MFA Rules not processed for user `92d35d26b84a4c42907a16ec30d8c613`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:01.796395 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-adc1f503-dd58-4cd2-812b-c8d27e31f0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:01.922122 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00916740-2a4b-413f-ac1a-327b2ee247b5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:01.938644 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd855ee-e4b3-4f87-a5e0-801c8c0d9d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:01.939762 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd855ee-e4b3-4f87-a5e0-801c8c0d9d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:01.940160 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd855ee-e4b3-4f87-a5e0-801c8c0d9d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:01.940606 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd855ee-e4b3-4f87-a5e0-801c8c0d9d3f admin admin] PATH_INFO: `/v3/projects/d876e8f6e278448196f8e8989149241c` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:01.942938 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd855ee-e4b3-4f87-a5e0-801c8c0d9d3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d876e8f6e278448196f8e8989149241c)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:01.946745 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd855ee-e4b3-4f87-a5e0-801c8c0d9d3f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:02.004982 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1061/2125] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:01 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:02.009835 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1f503-dd58-4cd2-812b-c8d27e31f0eb None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:02.033160 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1f503-dd58-4cd2-812b-c8d27e31f0eb None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:02.060437 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa8ada-45c9-425c-bffe-ec2784a17036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:02.061126 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa8ada-45c9-425c-bffe-ec2784a17036 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:02.061549 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa8ada-45c9-425c-bffe-ec2784a17036 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:02.061808 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa8ada-45c9-425c-bffe-ec2784a17036 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:02.062608 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa8ada-45c9-425c-bffe-ec2784a17036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:02.070159 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa8ada-45c9-425c-bffe-ec2784a17036 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:02.124678 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-edd855ee-e4b3-4f87-a5e0-801c8c0d9d3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd876e8f6e278448196f8e8989149241c', 'request_id': 'req-edd855ee-e4b3-4f87-a5e0-801c8c0d9d3f'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:02.147104 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-edd855ee-e4b3-4f87-a5e0-801c8c0d9d3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd876e8f6e278448196f8e8989149241c', 'request_id': 'req-edd855ee-e4b3-4f87-a5e0-801c8c0d9d3f'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:02.160985 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-edd855ee-e4b3-4f87-a5e0-801c8c0d9d3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd876e8f6e278448196f8e8989149241c', 'request_id': 'req-edd855ee-e4b3-4f87-a5e0-801c8c0d9d3f'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:02.181235 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1062/2126] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:12:02 2021] POST /identity/v3/projects => generated 387 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:12:02.183495 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa8ada-45c9-425c-bffe-ec2784a17036 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:02.209290 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-edd855ee-e4b3-4f87-a5e0-801c8c0d9d3f admin admin] The token cache is being invalidate because project d876e8f6e278448196f8e8989149241c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:12:02.211947 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-edd855ee-e4b3-4f87-a5e0-801c8c0d9d3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:02.213409 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-edd855ee-e4b3-4f87-a5e0-801c8c0d9d3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:02.220767 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1065/2127] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:12:01 2021] DELETE /identity/v3/projects/d876e8f6e278448196f8e8989149241c => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:12:02.227275 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7d704-3d94-4025-b7fe-78c6df007c86 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:02.227569 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7d704-3d94-4025-b7fe-78c6df007c86 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:02.227885 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7d704-3d94-4025-b7fe-78c6df007c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:02.303918 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-b5f7d704-3d94-4025-b7fe-78c6df007c86 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:02.306548 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-b5f7d704-3d94-4025-b7fe-78c6df007c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:02.381115 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa8ada-45c9-425c-bffe-ec2784a17036 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:02.394734 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bae5c-0ddb-4202-8824-ce588fdb4857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:02.402005 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bae5c-0ddb-4202-8824-ce588fdb4857 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:02.402394 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bae5c-0ddb-4202-8824-ce588fdb4857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:02.402691 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bae5c-0ddb-4202-8824-ce588fdb4857 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:02.404168 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bae5c-0ddb-4202-8824-ce588fdb4857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:02.405819 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bae5c-0ddb-4202-8824-ce588fdb4857 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:02.432848 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1066/2128] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:02.445776 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308d6af-f173-4eae-a977-b2e6f3c07a99 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:02.446485 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308d6af-f173-4eae-a977-b2e6f3c07a99 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:02.447024 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308d6af-f173-4eae-a977-b2e6f3c07a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:02.447599 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1063/2129] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:12:02 2021] POST /identity/v3/users => generated 300 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:12:02.448782 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bae5c-0ddb-4202-8824-ce588fdb4857 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:02.451008 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-6c9bae5c-0ddb-4202-8824-ce588fdb4857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:02.479258 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-9308d6af-f173-4eae-a977-b2e6f3c07a99 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:02.481491 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-9308d6af-f173-4eae-a977-b2e6f3c07a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:02.493949 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bae5c-0ddb-4202-8824-ce588fdb4857 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:02.497221 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1067/2130] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:12:02.502030 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315dbbd-bfe3-4ba0-a5af-c9c6cf301302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:02.503014 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315dbbd-bfe3-4ba0-a5af-c9c6cf301302 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:02.503393 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315dbbd-bfe3-4ba0-a5af-c9c6cf301302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:02.503905 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315dbbd-bfe3-4ba0-a5af-c9c6cf301302 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:02.505044 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c315dbbd-bfe3-4ba0-a5af-c9c6cf301302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:02.506500 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c315dbbd-bfe3-4ba0-a5af-c9c6cf301302 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:02.510871 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308d6af-f173-4eae-a977-b2e6f3c07a99 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:02.520802 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308d6af-f173-4eae-a977-b2e6f3c07a99 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:02.534909 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdda7f-50f0-41e5-a166-95a6603552e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:02.534909 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdda7f-50f0-41e5-a166-95a6603552e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:02.534909 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdda7f-50f0-41e5-a166-95a6603552e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:02.534909 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdda7f-50f0-41e5-a166-95a6603552e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:02.536210 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cdda7f-50f0-41e5-a166-95a6603552e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:12:02.536210 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cdda7f-50f0-41e5-a166-95a6603552e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:02.548128 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cdda7f-50f0-41e5-a166-95a6603552e5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:02.548635 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1064/2131] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:02 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:02.553743 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315dbbd-bfe3-4ba0-a5af-c9c6cf301302 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:02.569135 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315dbbd-bfe3-4ba0-a5af-c9c6cf301302 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:02.575637 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489572b9-f571-4183-a813-ba8f87a01f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:02.576557 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489572b9-f571-4183-a813-ba8f87a01f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:02.576839 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489572b9-f571-4183-a813-ba8f87a01f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:02.577115 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489572b9-f571-4183-a813-ba8f87a01f0b admin admin] PATH_INFO: `/v3/projects/38736652d8d14381b95b0262cfab448c/users/9662220b69c24beda5e31f57359e7e02/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:02.582473 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1068/2132] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:12:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:12:02.583986 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdda7f-50f0-41e5-a166-95a6603552e5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:02.601071 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdda7f-50f0-41e5-a166-95a6603552e5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:02.613229 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489572b9-f571-4183-a813-ba8f87a01f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=38736652d8d14381b95b0262cfab448c, user_id=9662220b69c24beda5e31f57359e7e02, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:02.618823 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d471a-6204-42f3-aca2-9251386b8d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:02.619599 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d471a-6204-42f3-aca2-9251386b8d8d admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:02.619884 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d471a-6204-42f3-aca2-9251386b8d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:02.620163 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d471a-6204-42f3-aca2-9251386b8d8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:02.620878 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d471a-6204-42f3-aca2-9251386b8d8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:02.623093 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489572b9-f571-4183-a813-ba8f87a01f0b admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:02.627728 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d471a-6204-42f3-aca2-9251386b8d8d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:02.658917 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1065/2133] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:12:02 2021] PUT /identity/v3/projects/38736652d8d14381b95b0262cfab448c/users/9662220b69c24beda5e31f57359e7e02/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:02.659961 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489572b9-f571-4183-a813-ba8f87a01f0b admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:02.696965 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1069/2134] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:12:02 2021] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:12:02.698217 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d471a-6204-42f3-aca2-9251386b8d8d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:02.798133 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d471a-6204-42f3-aca2-9251386b8d8d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:02.810234 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489572b9-f571-4183-a813-ba8f87a01f0b admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:02.810403 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a246e-d5c4-4421-ba1d-7f2f51815fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:02.812985 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a246e-d5c4-4421-ba1d-7f2f51815fdb admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:02.813334 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a246e-d5c4-4421-ba1d-7f2f51815fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:02.814208 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a246e-d5c4-4421-ba1d-7f2f51815fdb admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:02.815100 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a246e-d5c4-4421-ba1d-7f2f51815fdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:02.818842 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a246e-d5c4-4421-ba1d-7f2f51815fdb admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:02.819616 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc20eaa-ec7a-4510-9cd5-e29737f82d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:02.820484 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc20eaa-ec7a-4510-9cd5-e29737f82d3b admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:02.820967 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc20eaa-ec7a-4510-9cd5-e29737f82d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:02.821413 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc20eaa-ec7a-4510-9cd5-e29737f82d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:02.822402 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc20eaa-ec7a-4510-9cd5-e29737f82d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:02.824399 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc20eaa-ec7a-4510-9cd5-e29737f82d3b admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:02.837290 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1066/2135] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:02 2021] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:02.842361 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc20eaa-ec7a-4510-9cd5-e29737f82d3b admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:02.859356 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc20eaa-ec7a-4510-9cd5-e29737f82d3b admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:02.862106 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1070/2136] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:12:02 2021] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:12:02.864648 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad39bb3-cdde-42a6-8653-8891f489c48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:02.865737 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad39bb3-cdde-42a6-8653-8891f489c48d admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:02.866230 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad39bb3-cdde-42a6-8653-8891f489c48d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:02.867998 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad39bb3-cdde-42a6-8653-8891f489c48d admin admin] PATH_INFO: `/v3/projects/38736652d8d14381b95b0262cfab448c/users/9662220b69c24beda5e31f57359e7e02/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:02.868992 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a246e-d5c4-4421-ba1d-7f2f51815fdb admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:02.871332 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad39bb3-cdde-42a6-8653-8891f489c48d admin admin] RBAC: Authorizing `identity:create_grant(project_id=38736652d8d14381b95b0262cfab448c, user_id=9662220b69c24beda5e31f57359e7e02, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:02.874587 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad39bb3-cdde-42a6-8653-8891f489c48d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:02.887689 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a246e-d5c4-4421-ba1d-7f2f51815fdb admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:02.888905 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1067/2137] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:12:02 2021] PUT /identity/v3/projects/38736652d8d14381b95b0262cfab448c/users/9662220b69c24beda5e31f57359e7e02/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:02.900691 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a08ba-33f1-4ac3-808c-01f72417e492 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:02.901321 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a08ba-33f1-4ac3-808c-01f72417e492 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:02.901845 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a08ba-33f1-4ac3-808c-01f72417e492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:02.949529 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-056a08ba-33f1-4ac3-808c-01f72417e492 None None] MFA Rules not processed for user `9662220b69c24beda5e31f57359e7e02`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:02.951042 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-056a08ba-33f1-4ac3-808c-01f72417e492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:03.050151 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a7529-ea4e-44c7-8c76-1e894435fefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:03.052427 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a7529-ea4e-44c7-8c76-1e894435fefc admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:03.054415 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a7529-ea4e-44c7-8c76-1e894435fefc admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:03.054938 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a7529-ea4e-44c7-8c76-1e894435fefc admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:03.057545 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a7529-ea4e-44c7-8c76-1e894435fefc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:03.070696 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a7529-ea4e-44c7-8c76-1e894435fefc admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:03.077159 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1068/2138] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:02 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:03.120726 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1071/2139] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:02 2021] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:03.124590 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a08ba-33f1-4ac3-808c-01f72417e492 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:03.137700 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a7529-ea4e-44c7-8c76-1e894435fefc admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:03.140346 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-628a7529-ea4e-44c7-8c76-1e894435fefc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:03.158953 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a08ba-33f1-4ac3-808c-01f72417e492 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:03.186748 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167f71a-435e-4321-b568-9dc6b5e80d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:03.187449 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167f71a-435e-4321-b568-9dc6b5e80d3a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:03.187849 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167f71a-435e-4321-b568-9dc6b5e80d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:03.188026 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167f71a-435e-4321-b568-9dc6b5e80d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:03.188778 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167f71a-435e-4321-b568-9dc6b5e80d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:03.202035 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167f71a-435e-4321-b568-9dc6b5e80d3a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:03.286547 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1069/2140] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:03 2021] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:03.287075 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167f71a-435e-4321-b568-9dc6b5e80d3a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:03.357400 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167f71a-435e-4321-b568-9dc6b5e80d3a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:03.392057 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a7529-ea4e-44c7-8c76-1e894435fefc admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:03.394188 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeced959-ad05-48aa-9861-caad2f5ba64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:03.395331 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeced959-ad05-48aa-9861-caad2f5ba64b admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:03.395626 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeced959-ad05-48aa-9861-caad2f5ba64b admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:03.395908 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeced959-ad05-48aa-9861-caad2f5ba64b admin admin] PATH_INFO: `/v3/projects/710c6a0383874f9b946e8376a79787b6/users/ff251ac504444235af8055f7a9c8e0a5/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:03.398198 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b758d-7660-46d0-9d86-64b7c4a113c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:03.400052 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b758d-7660-46d0-9d86-64b7c4a113c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:03.400592 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b758d-7660-46d0-9d86-64b7c4a113c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:03.401089 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b758d-7660-46d0-9d86-64b7c4a113c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:03.450260 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b758d-7660-46d0-9d86-64b7c4a113c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:03.450260 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b758d-7660-46d0-9d86-64b7c4a113c7 service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:03.489315 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1072/2141] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:12:03 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:12:03.515529 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeced959-ad05-48aa-9861-caad2f5ba64b admin admin] RBAC: Authorizing `identity:create_grant(project_id=710c6a0383874f9b946e8376a79787b6, user_id=ff251ac504444235af8055f7a9c8e0a5, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:03.518738 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeced959-ad05-48aa-9861-caad2f5ba64b admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:03.548632 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1070/2142] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:12:03 2021] PUT /identity/v3/projects/710c6a0383874f9b946e8376a79787b6/users/ff251ac504444235af8055f7a9c8e0a5/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:03.549864 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5a416-d71f-4a6d-971f-ee182c8211b9 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:03.550165 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5a416-d71f-4a6d-971f-ee182c8211b9 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:03.550441 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5a416-d71f-4a6d-971f-ee182c8211b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:03.575522 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-69f5a416-d71f-4a6d-971f-ee182c8211b9 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:03.577132 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-69f5a416-d71f-4a6d-971f-ee182c8211b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:03.676953 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeced959-ad05-48aa-9861-caad2f5ba64b admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:03.677109 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1073/2143] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:12:03.686842 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-eeced959-ad05-48aa-9861-caad2f5ba64b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:03.948203 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeced959-ad05-48aa-9861-caad2f5ba64b admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:03.958967 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe07c0-2807-4562-a06e-080bdfc6b6e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:03.959678 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe07c0-2807-4562-a06e-080bdfc6b6e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:03.959905 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe07c0-2807-4562-a06e-080bdfc6b6e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:03.960694 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe07c0-2807-4562-a06e-080bdfc6b6e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:03.979277 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe07c0-2807-4562-a06e-080bdfc6b6e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:03.983071 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe07c0-2807-4562-a06e-080bdfc6b6e6 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:04.018318 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1071/2144] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:12:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:12:04.987182 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5a416-d71f-4a6d-971f-ee182c8211b9 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:05.011982 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5a416-d71f-4a6d-971f-ee182c8211b9 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:05.024685 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fe017-5742-4836-8d31-5f8121c17d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:05.029319 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fe017-5742-4836-8d31-5f8121c17d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:05.033187 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fe017-5742-4836-8d31-5f8121c17d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:05.034235 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fe017-5742-4836-8d31-5f8121c17d4f admin admin] PATH_INFO: `/v3/users/92d35d26b84a4c42907a16ec30d8c613` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:05.075637 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fe017-5742-4836-8d31-5f8121c17d4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=92d35d26b84a4c42907a16ec30d8c613)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:05.083021 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fe017-5742-4836-8d31-5f8121c17d4f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:05.188071 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2009ff8-e570-41bd-81a0-1e24272e23a0 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:05.189057 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2009ff8-e570-41bd-81a0-1e24272e23a0 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:05.189566 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2009ff8-e570-41bd-81a0-1e24272e23a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:05.236145 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-f83fe017-5742-4836-8d31-5f8121c17d4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92d35d26b84a4c42907a16ec30d8c613'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:05.238293 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-f83fe017-5742-4836-8d31-5f8121c17d4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92d35d26b84a4c42907a16ec30d8c613'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:05.267800 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-e2009ff8-e570-41bd-81a0-1e24272e23a0 None None] MFA Rules not processed for user `df09b0b78f6646ed8c520c5c46b3eb58`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:05.270943 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-e2009ff8-e570-41bd-81a0-1e24272e23a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:05.274394 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-f83fe017-5742-4836-8d31-5f8121c17d4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92d35d26b84a4c42907a16ec30d8c613'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:05.275422 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-f83fe017-5742-4836-8d31-5f8121c17d4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92d35d26b84a4c42907a16ec30d8c613'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:05.292041 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-f83fe017-5742-4836-8d31-5f8121c17d4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92d35d26b84a4c42907a16ec30d8c613'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:05.322423 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1074/2145] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:12:04 2021] DELETE /identity/v3/users/92d35d26b84a4c42907a16ec30d8c613 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:05.326690 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fff0d3-2d12-4d88-8fde-034b8d6fd06e None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:05.326984 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fff0d3-2d12-4d88-8fde-034b8d6fd06e None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:05.327263 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fff0d3-2d12-4d88-8fde-034b8d6fd06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:05.383845 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-03fff0d3-2d12-4d88-8fde-034b8d6fd06e None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:05.389004 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1072/2146] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:05 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:05.391855 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-03fff0d3-2d12-4d88-8fde-034b8d6fd06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:05.457501 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2009ff8-e570-41bd-81a0-1e24272e23a0 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:05.458995 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-e2009ff8-e570-41bd-81a0-1e24272e23a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:05.547111 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1075/2147] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:05.562089 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fff0d3-2d12-4d88-8fde-034b8d6fd06e None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:05.564559 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-03fff0d3-2d12-4d88-8fde-034b8d6fd06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:05.638323 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2009ff8-e570-41bd-81a0-1e24272e23a0 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:05.721623 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fff0d3-2d12-4d88-8fde-034b8d6fd06e None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:05.736795 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5437d4-d645-423d-8aaf-57d108f9e169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:05.737573 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5437d4-d645-423d-8aaf-57d108f9e169 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:05.737730 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5437d4-d645-423d-8aaf-57d108f9e169 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:05.738017 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5437d4-d645-423d-8aaf-57d108f9e169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:05.759247 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5437d4-d645-423d-8aaf-57d108f9e169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:05.761027 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5437d4-d645-423d-8aaf-57d108f9e169 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:05.786800 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1076/2148] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:12:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:12:05.795315 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9752cf-114b-4727-b08b-8147c72f76be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:05.796136 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9752cf-114b-4727-b08b-8147c72f76be service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:05.796479 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9752cf-114b-4727-b08b-8147c72f76be service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:05.797182 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9752cf-114b-4727-b08b-8147c72f76be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:05.800158 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-9e9752cf-114b-4727-b08b-8147c72f76be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:05.943468 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9752cf-114b-4727-b08b-8147c72f76be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:05.948466 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9752cf-114b-4727-b08b-8147c72f76be service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:05.973746 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1073/2149] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:12:05 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:12:06.405294 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe26ad-25bd-4cd2-afe4-7e1ead771acd None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:06.407087 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe26ad-25bd-4cd2-afe4-7e1ead771acd None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:06.407799 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe26ad-25bd-4cd2-afe4-7e1ead771acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:06.448404 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-08fe26ad-25bd-4cd2-afe4-7e1ead771acd None None] MFA Rules not processed for user `0a15ca0a8cc74415815f5613f72b8105`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:06.450931 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-08fe26ad-25bd-4cd2-afe4-7e1ead771acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:06.615119 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1077/2150] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:06 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:06.811302 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9752cf-114b-4727-b08b-8147c72f76be service cinder] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:06.812756 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-9e9752cf-114b-4727-b08b-8147c72f76be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:06.831253 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9752cf-114b-4727-b08b-8147c72f76be service cinder] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:06.848961 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ec834-ffdf-404e-9144-d18711931ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:06.849940 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ec834-ffdf-404e-9144-d18711931ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:06.850229 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ec834-ffdf-404e-9144-d18711931ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:06.850507 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ec834-ffdf-404e-9144-d18711931ca5 admin admin] PATH_INFO: `/v3/projects/e307aa6df4c74f658a336e3cefa818db` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:06.875093 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ec834-ffdf-404e-9144-d18711931ca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e307aa6df4c74f658a336e3cefa818db)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:06.880673 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ec834-ffdf-404e-9144-d18711931ca5 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:07.024954 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-994ec834-ffdf-404e-9144-d18711931ca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e307aa6df4c74f658a336e3cefa818db', 'request_id': 'req-994ec834-ffdf-404e-9144-d18711931ca5'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:07.039427 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-994ec834-ffdf-404e-9144-d18711931ca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e307aa6df4c74f658a336e3cefa818db', 'request_id': 'req-994ec834-ffdf-404e-9144-d18711931ca5'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:07.053273 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-994ec834-ffdf-404e-9144-d18711931ca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e307aa6df4c74f658a336e3cefa818db', 'request_id': 'req-994ec834-ffdf-404e-9144-d18711931ca5'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:07.080926 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-994ec834-ffdf-404e-9144-d18711931ca5 admin admin] The token cache is being invalidate because project e307aa6df4c74f658a336e3cefa818db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:12:07.082977 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-994ec834-ffdf-404e-9144-d18711931ca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:07.085286 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-994ec834-ffdf-404e-9144-d18711931ca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:07.092015 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1074/2151] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:12:06 2021] DELETE /identity/v3/projects/e307aa6df4c74f658a336e3cefa818db => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:07.093417 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe26ad-25bd-4cd2-afe4-7e1ead771acd None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:07.108562 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe26ad-25bd-4cd2-afe4-7e1ead771acd None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:07.270886 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e310323-967c-4a3f-87f6-126d208b8c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:07.271776 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e310323-967c-4a3f-87f6-126d208b8c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:07.272050 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e310323-967c-4a3f-87f6-126d208b8c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:07.272325 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e310323-967c-4a3f-87f6-126d208b8c38 admin admin] PATH_INFO: `/v3/users/9662220b69c24beda5e31f57359e7e02` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:07.274331 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e310323-967c-4a3f-87f6-126d208b8c38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9662220b69c24beda5e31f57359e7e02)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:07.276298 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e310323-967c-4a3f-87f6-126d208b8c38 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:07.397653 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-7e310323-967c-4a3f-87f6-126d208b8c38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9662220b69c24beda5e31f57359e7e02'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:07.399045 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-7e310323-967c-4a3f-87f6-126d208b8c38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9662220b69c24beda5e31f57359e7e02'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:07.420196 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-7e310323-967c-4a3f-87f6-126d208b8c38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9662220b69c24beda5e31f57359e7e02'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:07.421711 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-7e310323-967c-4a3f-87f6-126d208b8c38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9662220b69c24beda5e31f57359e7e02'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:07.470197 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-7e310323-967c-4a3f-87f6-126d208b8c38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9662220b69c24beda5e31f57359e7e02'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:07.508772 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1078/2152] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:12:07 2021] DELETE /identity/v3/users/9662220b69c24beda5e31f57359e7e02 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:09.147147 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ec834-ffdf-404e-9144-d18711931ca5 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:09.149214 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-994ec834-ffdf-404e-9144-d18711931ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:09.179645 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ec834-ffdf-404e-9144-d18711931ca5 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:09.270293 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e310323-967c-4a3f-87f6-126d208b8c38 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:09.272117 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-7e310323-967c-4a3f-87f6-126d208b8c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:09.353743 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bdbbe8-9cfc-4d49-903c-1b0ca4d10e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:09.354874 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdbbe8-9cfc-4d49-903c-1b0ca4d10e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:09.355292 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdbbe8-9cfc-4d49-903c-1b0ca4d10e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:09.355641 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdbbe8-9cfc-4d49-903c-1b0ca4d10e55 admin admin] PATH_INFO: `/v3/projects/38736652d8d14381b95b0262cfab448c` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:09.359549 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bdbbe8-9cfc-4d49-903c-1b0ca4d10e55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38736652d8d14381b95b0262cfab448c)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:09.363758 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bdbbe8-9cfc-4d49-903c-1b0ca4d10e55 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:09.494849 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-96bdbbe8-9cfc-4d49-903c-1b0ca4d10e55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38736652d8d14381b95b0262cfab448c', 'request_id': 'req-96bdbbe8-9cfc-4d49-903c-1b0ca4d10e55'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:09.517618 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-96bdbbe8-9cfc-4d49-903c-1b0ca4d10e55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38736652d8d14381b95b0262cfab448c', 'request_id': 'req-96bdbbe8-9cfc-4d49-903c-1b0ca4d10e55'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:09.525530 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-96bdbbe8-9cfc-4d49-903c-1b0ca4d10e55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38736652d8d14381b95b0262cfab448c', 'request_id': 'req-96bdbbe8-9cfc-4d49-903c-1b0ca4d10e55'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:09.542478 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e310323-967c-4a3f-87f6-126d208b8c38 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:09.551870 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-96bdbbe8-9cfc-4d49-903c-1b0ca4d10e55 admin admin] The token cache is being invalidate because project 38736652d8d14381b95b0262cfab448c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:12:09.552172 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-96bdbbe8-9cfc-4d49-903c-1b0ca4d10e55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:09.554772 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-96bdbbe8-9cfc-4d49-903c-1b0ca4d10e55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:09.559515 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1075/2153] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:12:09 2021] DELETE /identity/v3/projects/38736652d8d14381b95b0262cfab448c => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:09.577639 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1c31a-2585-46a7-9771-a5af4605ec1c None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:09.577985 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1c31a-2585-46a7-9771-a5af4605ec1c None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:09.578215 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1c31a-2585-46a7-9771-a5af4605ec1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:09.624912 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-39f1c31a-2585-46a7-9771-a5af4605ec1c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:09.628988 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-39f1c31a-2585-46a7-9771-a5af4605ec1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:09.725571 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9779e1-30f5-4d5d-a0d9-3fcb577fc4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:09.727437 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9779e1-30f5-4d5d-a0d9-3fcb577fc4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:09.727889 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9779e1-30f5-4d5d-a0d9-3fcb577fc4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:09.728978 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9779e1-30f5-4d5d-a0d9-3fcb577fc4ec admin admin] PATH_INFO: `/v3/users/2aa3d741cd12449e82566763adf74338` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:09.731403 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9779e1-30f5-4d5d-a0d9-3fcb577fc4ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aa3d741cd12449e82566763adf74338)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:09.735425 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9779e1-30f5-4d5d-a0d9-3fcb577fc4ec admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:09.790106 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1076/2154] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:09.795552 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff610951-b91e-427c-8d3b-e2ef5158a792 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:09.796098 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff610951-b91e-427c-8d3b-e2ef5158a792 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:09.796391 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff610951-b91e-427c-8d3b-e2ef5158a792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:09.838497 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-ff610951-b91e-427c-8d3b-e2ef5158a792 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:09.840042 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-ff610951-b91e-427c-8d3b-e2ef5158a792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:09.852814 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-0d9779e1-30f5-4d5d-a0d9-3fcb577fc4ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aa3d741cd12449e82566763adf74338'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:09.853509 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-0d9779e1-30f5-4d5d-a0d9-3fcb577fc4ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aa3d741cd12449e82566763adf74338'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:09.853682 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1077/2155] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:09.854845 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff610951-b91e-427c-8d3b-e2ef5158a792 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:09.865869 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff610951-b91e-427c-8d3b-e2ef5158a792 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:09.874577 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d25fce-9270-4f58-8ee2-394d6822ccaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:09.875735 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d25fce-9270-4f58-8ee2-394d6822ccaf admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:09.876041 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d25fce-9270-4f58-8ee2-394d6822ccaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:09.876403 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d25fce-9270-4f58-8ee2-394d6822ccaf admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:09.877738 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d25fce-9270-4f58-8ee2-394d6822ccaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:12:09.878091 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d25fce-9270-4f58-8ee2-394d6822ccaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:09.879895 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-0d9779e1-30f5-4d5d-a0d9-3fcb577fc4ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aa3d741cd12449e82566763adf74338'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:09.880056 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d25fce-9270-4f58-8ee2-394d6822ccaf admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:09.881689 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-0d9779e1-30f5-4d5d-a0d9-3fcb577fc4ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aa3d741cd12449e82566763adf74338'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:09.896212 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1078/2156] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:12:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:12:09.904959 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d25fce-9270-4f58-8ee2-394d6822ccaf admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:09.910313 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f1d25fce-9270-4f58-8ee2-394d6822ccaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:09.912634 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-0d9779e1-30f5-4d5d-a0d9-3fcb577fc4ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aa3d741cd12449e82566763adf74338'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:09.937895 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d25fce-9270-4f58-8ee2-394d6822ccaf admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:09.950606 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35546f1c-4759-44e3-a58c-62ebdb19de46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:09.951030 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1079/2157] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:12:09 2021] DELETE /identity/v3/users/2aa3d741cd12449e82566763adf74338 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:09.954649 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35546f1c-4759-44e3-a58c-62ebdb19de46 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:09.954811 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35546f1c-4759-44e3-a58c-62ebdb19de46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:09.955093 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35546f1c-4759-44e3-a58c-62ebdb19de46 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:09.955829 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35546f1c-4759-44e3-a58c-62ebdb19de46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:09.957419 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21663089-5737-42b8-aa46-450b7b0e6194 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:09.958028 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21663089-5737-42b8-aa46-450b7b0e6194 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:09.958477 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21663089-5737-42b8-aa46-450b7b0e6194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:09.958602 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35546f1c-4759-44e3-a58c-62ebdb19de46 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:10.026831 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-21663089-5737-42b8-aa46-450b7b0e6194 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:10.030649 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1079/2158] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:12:09 2021] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:12:10.034645 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35546f1c-4759-44e3-a58c-62ebdb19de46 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:10.035101 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-21663089-5737-42b8-aa46-450b7b0e6194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:10.188554 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1080/2159] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:10.191808 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bf5d3-9bba-49a6-a6b9-0836a32d6742 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:10.192107 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bf5d3-9bba-49a6-a6b9-0836a32d6742 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:10.192390 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bf5d3-9bba-49a6-a6b9-0836a32d6742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:10.240268 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35546f1c-4759-44e3-a58c-62ebdb19de46 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:10.245797 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-ad4bf5d3-9bba-49a6-a6b9-0836a32d6742 None None] MFA Rules not processed for user `aaa0c20019c84107b8324cd915ff78db`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:10.247188 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-ad4bf5d3-9bba-49a6-a6b9-0836a32d6742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:10.253315 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300f4d0-fca1-4ce6-a6d1-06ba4535c044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:10.253793 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300f4d0-fca1-4ce6-a6d1-06ba4535c044 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:10.254077 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300f4d0-fca1-4ce6-a6d1-06ba4535c044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:10.254369 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300f4d0-fca1-4ce6-a6d1-06ba4535c044 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:10.255082 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300f4d0-fca1-4ce6-a6d1-06ba4535c044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:10.257848 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300f4d0-fca1-4ce6-a6d1-06ba4535c044 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:10.305026 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1080/2160] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:12:10 2021] POST /identity/v3/users => generated 292 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:12:10.305026 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300f4d0-fca1-4ce6-a6d1-06ba4535c044 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:10.306174 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-d300f4d0-fca1-4ce6-a6d1-06ba4535c044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:10.436260 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1081/2161] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:10 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:10.437271 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bf5d3-9bba-49a6-a6b9-0836a32d6742 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:10.482291 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bf5d3-9bba-49a6-a6b9-0836a32d6742 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:10.486021 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300f4d0-fca1-4ce6-a6d1-06ba4535c044 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:10.495705 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70929cf4-97b4-4fb9-b901-9c1402146c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:10.496397 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70929cf4-97b4-4fb9-b901-9c1402146c6b admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:10.496676 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70929cf4-97b4-4fb9-b901-9c1402146c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:10.497506 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70929cf4-97b4-4fb9-b901-9c1402146c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:10.499143 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70929cf4-97b4-4fb9-b901-9c1402146c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:10.499914 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82eb340-a178-4f40-a1ce-788e55a8c00a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:10.501091 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82eb340-a178-4f40-a1ce-788e55a8c00a service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:10.501917 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82eb340-a178-4f40-a1ce-788e55a8c00a service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:10.503675 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82eb340-a178-4f40-a1ce-788e55a8c00a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:10.506255 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70929cf4-97b4-4fb9-b901-9c1402146c6b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:10.530062 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82eb340-a178-4f40-a1ce-788e55a8c00a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:10.533937 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82eb340-a178-4f40-a1ce-788e55a8c00a service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:10.534399 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1082/2162] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:10 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:10.537721 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70929cf4-97b4-4fb9-b901-9c1402146c6b admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:10.542456 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-70929cf4-97b4-4fb9-b901-9c1402146c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:10.560969 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1081/2163] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:12:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:12:10.561813 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82eb340-a178-4f40-a1ce-788e55a8c00a service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:10.571186 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70929cf4-97b4-4fb9-b901-9c1402146c6b admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:10.583163 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82eb340-a178-4f40-a1ce-788e55a8c00a service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:10.586452 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe60b5-615d-4b03-8e66-c4a152ed58c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:10.587272 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe60b5-615d-4b03-8e66-c4a152ed58c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:10.587559 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe60b5-615d-4b03-8e66-c4a152ed58c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:10.587843 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe60b5-615d-4b03-8e66-c4a152ed58c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:10.588584 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe60b5-615d-4b03-8e66-c4a152ed58c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:10.592151 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe60b5-615d-4b03-8e66-c4a152ed58c8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:10.600525 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f535d-d2e9-402e-bb14-9b3227a47fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:10.601620 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f535d-d2e9-402e-bb14-9b3227a47fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:10.602074 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f535d-d2e9-402e-bb14-9b3227a47fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:10.602498 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f535d-d2e9-402e-bb14-9b3227a47fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:10.603498 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f535d-d2e9-402e-bb14-9b3227a47fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:10.607377 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f535d-d2e9-402e-bb14-9b3227a47fa9 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:10.627580 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1082/2164] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:10 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:10.632399 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f535d-d2e9-402e-bb14-9b3227a47fa9 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:10.646699 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f535d-d2e9-402e-bb14-9b3227a47fa9 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:10.651681 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1083/2165] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:12:10 2021] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:12:10.655740 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe60b5-615d-4b03-8e66-c4a152ed58c8 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:10.657866 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de2c37-c821-47cd-9457-72d172592d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:10.659234 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de2c37-c821-47cd-9457-72d172592d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:10.659592 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de2c37-c821-47cd-9457-72d172592d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:10.660021 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de2c37-c821-47cd-9457-72d172592d42 admin admin] PATH_INFO: `/v3/projects/5778f05efa2b4b29890c0899f6261a51/users/4098b8b3fb4440e88cfa011bb59e6072/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:10.712224 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de2c37-c821-47cd-9457-72d172592d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5778f05efa2b4b29890c0899f6261a51, user_id=4098b8b3fb4440e88cfa011bb59e6072, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:10.720130 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de2c37-c821-47cd-9457-72d172592d42 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:10.751292 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1083/2166] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:12:10 2021] PUT /identity/v3/projects/5778f05efa2b4b29890c0899f6261a51/users/4098b8b3fb4440e88cfa011bb59e6072/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:12:10.763630 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2e77d-20cf-43ec-bec2-d362cd6949e3 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:10.764692 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2e77d-20cf-43ec-bec2-d362cd6949e3 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:10.766469 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2e77d-20cf-43ec-bec2-d362cd6949e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:10.800017 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe60b5-615d-4b03-8e66-c4a152ed58c8 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:10.823674 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-1dd2e77d-20cf-43ec-bec2-d362cd6949e3 None None] MFA Rules not processed for user `4098b8b3fb4440e88cfa011bb59e6072`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:10.825038 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-1dd2e77d-20cf-43ec-bec2-d362cd6949e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:10.957002 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca5dc5-1b7a-4c30-82b3-ac7d023f6daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:10.958746 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca5dc5-1b7a-4c30-82b3-ac7d023f6daa admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:10.959271 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca5dc5-1b7a-4c30-82b3-ac7d023f6daa admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:10.959732 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca5dc5-1b7a-4c30-82b3-ac7d023f6daa admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:10.960905 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca5dc5-1b7a-4c30-82b3-ac7d023f6daa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:10.963268 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca5dc5-1b7a-4c30-82b3-ac7d023f6daa admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:10.969278 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1084/2167] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:10 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:10.973548 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2e77d-20cf-43ec-bec2-d362cd6949e3 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:10.989633 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2e77d-20cf-43ec-bec2-d362cd6949e3 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:10.997410 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfca2d7-9a9d-4735-bddc-16521f69a47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:10.998724 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfca2d7-9a9d-4735-bddc-16521f69a47a admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:10.999280 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfca2d7-9a9d-4735-bddc-16521f69a47a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:10.999638 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfca2d7-9a9d-4735-bddc-16521f69a47a admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:11.006500 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1084/2168] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:12:10 2021] POST /identity/v3/users => generated 292 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:12:11.009305 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfca2d7-9a9d-4735-bddc-16521f69a47a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:11.012112 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca5dc5-1b7a-4c30-82b3-ac7d023f6daa admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:11.016158 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfca2d7-9a9d-4735-bddc-16521f69a47a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:11.029134 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca5dc5-1b7a-4c30-82b3-ac7d023f6daa admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:11.050369 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4311b0b-7904-41bd-b516-526b53f03832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:11.057354 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4311b0b-7904-41bd-b516-526b53f03832 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:11.057740 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4311b0b-7904-41bd-b516-526b53f03832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:11.058222 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4311b0b-7904-41bd-b516-526b53f03832 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:11.059346 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4311b0b-7904-41bd-b516-526b53f03832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:11.061356 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4311b0b-7904-41bd-b516-526b53f03832 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:11.082201 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1085/2169] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:11 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:11.083555 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4311b0b-7904-41bd-b516-526b53f03832 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:11.100073 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1085/2170] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:12:10 2021] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:12:11.104835 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfca2d7-9a9d-4735-bddc-16521f69a47a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:11.108146 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4311b0b-7904-41bd-b516-526b53f03832 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:11.236755 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a223fcf-9d58-44b0-86cb-a9e2bbd0a75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:11.239900 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a223fcf-9d58-44b0-86cb-a9e2bbd0a75f admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:11.241014 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a223fcf-9d58-44b0-86cb-a9e2bbd0a75f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:11.241651 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a223fcf-9d58-44b0-86cb-a9e2bbd0a75f admin admin] PATH_INFO: `/v3/projects/5b784239c6a74157a0faa56ffc04020d/users/4bec6399356d48458f2ba1da75993f64/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:11.286859 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a223fcf-9d58-44b0-86cb-a9e2bbd0a75f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b784239c6a74157a0faa56ffc04020d, user_id=4bec6399356d48458f2ba1da75993f64, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:11.293059 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a223fcf-9d58-44b0-86cb-a9e2bbd0a75f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:11.304277 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfca2d7-9a9d-4735-bddc-16521f69a47a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:11.312027 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c5aa8-fe47-4f0d-847a-d44ba11adc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:11.312855 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c5aa8-fe47-4f0d-847a-d44ba11adc80 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:11.313210 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c5aa8-fe47-4f0d-847a-d44ba11adc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:11.317054 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c5aa8-fe47-4f0d-847a-d44ba11adc80 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:11.323164 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1086/2171] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:12:11 2021] PUT /identity/v3/projects/5b784239c6a74157a0faa56ffc04020d/users/4bec6399356d48458f2ba1da75993f64/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:11.327227 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a223fcf-9d58-44b0-86cb-a9e2bbd0a75f admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:11.327721 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c5aa8-fe47-4f0d-847a-d44ba11adc80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:11.332495 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c5aa8-fe47-4f0d-847a-d44ba11adc80 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:11.371419 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1086/2172] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:12:11 2021] POST /identity/v3/users => generated 298 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:12:11.375420 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c5aa8-fe47-4f0d-847a-d44ba11adc80 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:11.398863 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c5aa8-fe47-4f0d-847a-d44ba11adc80 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:11.472622 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a223fcf-9d58-44b0-86cb-a9e2bbd0a75f admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:11.491263 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b005ae-95af-4f5d-84dc-5d6601b98bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:11.492550 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b005ae-95af-4f5d-84dc-5d6601b98bcf admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:11.495288 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b005ae-95af-4f5d-84dc-5d6601b98bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:11.495852 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b005ae-95af-4f5d-84dc-5d6601b98bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:11.498764 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b005ae-95af-4f5d-84dc-5d6601b98bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:11.501292 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b005ae-95af-4f5d-84dc-5d6601b98bcf admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:11.544552 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1087/2173] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:11 2021] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:11.549338 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b005ae-95af-4f5d-84dc-5d6601b98bcf admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:11.558978 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-d6b005ae-95af-4f5d-84dc-5d6601b98bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:11.566232 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f09b10-2d3d-47f9-b9f9-2285412f0541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:11.567637 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f09b10-2d3d-47f9-b9f9-2285412f0541 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:11.568068 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f09b10-2d3d-47f9-b9f9-2285412f0541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:11.568451 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f09b10-2d3d-47f9-b9f9-2285412f0541 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:11.569340 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f09b10-2d3d-47f9-b9f9-2285412f0541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:11.572469 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f09b10-2d3d-47f9-b9f9-2285412f0541 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:11.584050 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1087/2174] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:11 2021] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:11.585045 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f09b10-2d3d-47f9-b9f9-2285412f0541 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:11.597235 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b005ae-95af-4f5d-84dc-5d6601b98bcf admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:11.600024 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f09b10-2d3d-47f9-b9f9-2285412f0541 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:11.606818 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f32059-abdc-4938-bc8d-327a37c0f971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:11.608226 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f32059-abdc-4938-bc8d-327a37c0f971 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:11.608618 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f32059-abdc-4938-bc8d-327a37c0f971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:11.608845 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4383c8-4f26-4e01-a63f-dd90dc563681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:11.609092 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f32059-abdc-4938-bc8d-327a37c0f971 admin admin] PATH_INFO: `/v3/projects/5b784239c6a74157a0faa56ffc04020d/users/4bec6399356d48458f2ba1da75993f64/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:11.610079 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4383c8-4f26-4e01-a63f-dd90dc563681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:11.610546 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4383c8-4f26-4e01-a63f-dd90dc563681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:11.611004 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4383c8-4f26-4e01-a63f-dd90dc563681 admin admin] PATH_INFO: `/v3/projects/f2cccc4efefd4d668831019a221d4997` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:11.612448 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4383c8-4f26-4e01-a63f-dd90dc563681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2cccc4efefd4d668831019a221d4997)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:11.612621 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f32059-abdc-4938-bc8d-327a37c0f971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b784239c6a74157a0faa56ffc04020d, user_id=4bec6399356d48458f2ba1da75993f64, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:11.615388 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4383c8-4f26-4e01-a63f-dd90dc563681 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:11.615973 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f32059-abdc-4938-bc8d-327a37c0f971 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:11.635960 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1088/2175] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:12:11 2021] PUT /identity/v3/projects/5b784239c6a74157a0faa56ffc04020d/users/4bec6399356d48458f2ba1da75993f64/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:11.640573 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f32059-abdc-4938-bc8d-327a37c0f971 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:11.718811 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5b4383c8-4f26-4e01-a63f-dd90dc563681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2cccc4efefd4d668831019a221d4997', 'request_id': 'req-5b4383c8-4f26-4e01-a63f-dd90dc563681'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:11.732936 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5b4383c8-4f26-4e01-a63f-dd90dc563681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2cccc4efefd4d668831019a221d4997', 'request_id': 'req-5b4383c8-4f26-4e01-a63f-dd90dc563681'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:11.750828 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5b4383c8-4f26-4e01-a63f-dd90dc563681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2cccc4efefd4d668831019a221d4997', 'request_id': 'req-5b4383c8-4f26-4e01-a63f-dd90dc563681'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:11.770248 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5b4383c8-4f26-4e01-a63f-dd90dc563681 admin admin] The token cache is being invalidate because project f2cccc4efefd4d668831019a221d4997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:12:11.771131 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5b4383c8-4f26-4e01-a63f-dd90dc563681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:11.771980 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5b4383c8-4f26-4e01-a63f-dd90dc563681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:11.774162 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1088/2176] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:12:11 2021] DELETE /identity/v3/projects/f2cccc4efefd4d668831019a221d4997 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:11.784938 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4383c8-4f26-4e01-a63f-dd90dc563681 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:11.789322 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-5b4383c8-4f26-4e01-a63f-dd90dc563681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:11.824913 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f32059-abdc-4938-bc8d-327a37c0f971 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:11.970163 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a5469-b951-4a1e-a4dc-f89b0a740aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:11.971689 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a5469-b951-4a1e-a4dc-f89b0a740aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:11.973986 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a5469-b951-4a1e-a4dc-f89b0a740aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:11.974349 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a5469-b951-4a1e-a4dc-f89b0a740aa0 admin admin] PATH_INFO: `/v3/projects/4362e2ca76b643adb8cf0c24fdc3a70b/users/555aa2edb9c24598b0a06f571072122b/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:12.008238 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a5469-b951-4a1e-a4dc-f89b0a740aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4362e2ca76b643adb8cf0c24fdc3a70b, user_id=555aa2edb9c24598b0a06f571072122b, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:12.011180 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a5469-b951-4a1e-a4dc-f89b0a740aa0 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:12.048087 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4383c8-4f26-4e01-a63f-dd90dc563681 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:12.050314 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1089/2177] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:12:11 2021] PUT /identity/v3/projects/4362e2ca76b643adb8cf0c24fdc3a70b/users/555aa2edb9c24598b0a06f571072122b/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:12.065256 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a5469-b951-4a1e-a4dc-f89b0a740aa0 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:12.068225 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-994a5469-b951-4a1e-a4dc-f89b0a740aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:12.182984 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8011cf-63ed-47a1-a217-9e7952417d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:12.185206 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8011cf-63ed-47a1-a217-9e7952417d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:12.185748 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8011cf-63ed-47a1-a217-9e7952417d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:12.186688 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8011cf-63ed-47a1-a217-9e7952417d45 admin admin] PATH_INFO: `/v3/users/6e07c2c7b1854fc4bf4c99a814164e2e` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:12.188692 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a5469-b951-4a1e-a4dc-f89b0a740aa0 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:12.189420 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8011cf-63ed-47a1-a217-9e7952417d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e07c2c7b1854fc4bf4c99a814164e2e)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:12.194204 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8011cf-63ed-47a1-a217-9e7952417d45 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:12.200846 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b3d58-5a5b-429c-9f95-686f07b48e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:12.203516 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b3d58-5a5b-429c-9f95-686f07b48e87 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:12.203516 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b3d58-5a5b-429c-9f95-686f07b48e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:12.203754 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b3d58-5a5b-429c-9f95-686f07b48e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:12.204519 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b3d58-5a5b-429c-9f95-686f07b48e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:12.206192 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b3d58-5a5b-429c-9f95-686f07b48e87 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:12.238648 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1090/2178] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:12 2021] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:12.243405 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a74a14-a2e4-45b5-ae92-e253743cfabc None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:12.243789 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a74a14-a2e4-45b5-ae92-e253743cfabc None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:12.244089 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a74a14-a2e4-45b5-ae92-e253743cfabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:12.294823 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-38a74a14-a2e4-45b5-ae92-e253743cfabc None None] MFA Rules not processed for user `b2f47cbf62d44a6ba7e6a6f0f2305630`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:12.297242 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-cc8011cf-63ed-47a1-a217-9e7952417d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e07c2c7b1854fc4bf4c99a814164e2e'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:12.298346 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-38a74a14-a2e4-45b5-ae92-e253743cfabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:12.305938 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-cc8011cf-63ed-47a1-a217-9e7952417d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e07c2c7b1854fc4bf4c99a814164e2e'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:12.314151 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-cc8011cf-63ed-47a1-a217-9e7952417d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e07c2c7b1854fc4bf4c99a814164e2e'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:12.321864 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-cc8011cf-63ed-47a1-a217-9e7952417d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e07c2c7b1854fc4bf4c99a814164e2e'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:12.346615 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-cc8011cf-63ed-47a1-a217-9e7952417d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e07c2c7b1854fc4bf4c99a814164e2e'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:12.367066 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1089/2179] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:12:11 2021] DELETE /identity/v3/users/6e07c2c7b1854fc4bf4c99a814164e2e => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:12.368108 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8011cf-63ed-47a1-a217-9e7952417d45 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:12.378614 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-cc8011cf-63ed-47a1-a217-9e7952417d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:12.409340 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1091/2180] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Dec 15 16:12:12 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:12.424579 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a74a14-a2e4-45b5-ae92-e253743cfabc None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:12.426504 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-38a74a14-a2e4-45b5-ae92-e253743cfabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:12.520020 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8011cf-63ed-47a1-a217-9e7952417d45 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:12.534545 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019116e7-c902-41ad-949d-1184bf141793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:12.535456 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019116e7-c902-41ad-949d-1184bf141793 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:12.535738 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019116e7-c902-41ad-949d-1184bf141793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:12.536012 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019116e7-c902-41ad-949d-1184bf141793 admin admin] PATH_INFO: `/v3/projects/4362e2ca76b643adb8cf0c24fdc3a70b/users/555aa2edb9c24598b0a06f571072122b/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:12.546359 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019116e7-c902-41ad-949d-1184bf141793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4362e2ca76b643adb8cf0c24fdc3a70b, user_id=555aa2edb9c24598b0a06f571072122b, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:12.549070 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019116e7-c902-41ad-949d-1184bf141793 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:12.597733 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1090/2181] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:12:12 2021] PUT /identity/v3/projects/4362e2ca76b643adb8cf0c24fdc3a70b/users/555aa2edb9c24598b0a06f571072122b/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:12.599934 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ceaec-ee58-44a7-bd62-beb7a208f691 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:12.599934 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ceaec-ee58-44a7-bd62-beb7a208f691 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:12.600119 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ceaec-ee58-44a7-bd62-beb7a208f691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:12.627708 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a74a14-a2e4-45b5-ae92-e253743cfabc None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:12.686299 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-9b8ceaec-ee58-44a7-bd62-beb7a208f691 None None] MFA Rules not processed for user `555aa2edb9c24598b0a06f571072122b`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:12.688940 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-9b8ceaec-ee58-44a7-bd62-beb7a208f691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:12.767489 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96110979-1b68-40fe-849a-1d717f9b964d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e3f652f76424e27a1d4329212d9b66d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:12.768427 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96110979-1b68-40fe-849a-1d717f9b964d service swift] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:12.768863 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96110979-1b68-40fe-849a-1d717f9b964d service swift] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:12.769291 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96110979-1b68-40fe-849a-1d717f9b964d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:12.903884 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96110979-1b68-40fe-849a-1d717f9b964d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:12.905548 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96110979-1b68-40fe-849a-1d717f9b964d service swift] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:12.932646 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1092/2182] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Dec 15 16:12:12 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 16:12:12.989283 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1091/2183] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:12 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:12:12.989527 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96110979-1b68-40fe-849a-1d717f9b964d service swift] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:12.991198 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-96110979-1b68-40fe-849a-1d717f9b964d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:13.175426 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96110979-1b68-40fe-849a-1d717f9b964d service swift] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:13.190456 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff373f4-dbe9-4958-b11d-c7a275cadfa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:13.191486 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff373f4-dbe9-4958-b11d-c7a275cadfa0 service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:13.192809 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff373f4-dbe9-4958-b11d-c7a275cadfa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:13.193335 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff373f4-dbe9-4958-b11d-c7a275cadfa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:13.201592 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-2ff373f4-dbe9-4958-b11d-c7a275cadfa0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:13.400158 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff373f4-dbe9-4958-b11d-c7a275cadfa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:13.402015 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff373f4-dbe9-4958-b11d-c7a275cadfa0 service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:13.425860 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1093/2184] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:12:12 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:12:15.522957 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ceaec-ee58-44a7-bd62-beb7a208f691 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:15.525101 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-9b8ceaec-ee58-44a7-bd62-beb7a208f691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:15.648536 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ceaec-ee58-44a7-bd62-beb7a208f691 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:15.656919 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5dfaa4-12ec-4973-9faa-b3e8d79f55b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:15.656919 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dfaa4-12ec-4973-9faa-b3e8d79f55b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:15.656919 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dfaa4-12ec-4973-9faa-b3e8d79f55b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:15.656919 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dfaa4-12ec-4973-9faa-b3e8d79f55b7 admin admin] PATH_INFO: `/v3/projects/0024cbd69e614b2188e110a84e28b372` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:15.657626 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5dfaa4-12ec-4973-9faa-b3e8d79f55b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0024cbd69e614b2188e110a84e28b372)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:15.659182 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5dfaa4-12ec-4973-9faa-b3e8d79f55b7 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:15.731280 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4c5dfaa4-12ec-4973-9faa-b3e8d79f55b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0024cbd69e614b2188e110a84e28b372', 'request_id': 'req-4c5dfaa4-12ec-4973-9faa-b3e8d79f55b7'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:15.747934 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4c5dfaa4-12ec-4973-9faa-b3e8d79f55b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0024cbd69e614b2188e110a84e28b372', 'request_id': 'req-4c5dfaa4-12ec-4973-9faa-b3e8d79f55b7'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:15.789875 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4c5dfaa4-12ec-4973-9faa-b3e8d79f55b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0024cbd69e614b2188e110a84e28b372', 'request_id': 'req-4c5dfaa4-12ec-4973-9faa-b3e8d79f55b7'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:15.818161 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4c5dfaa4-12ec-4973-9faa-b3e8d79f55b7 admin admin] The token cache is being invalidate because project 0024cbd69e614b2188e110a84e28b372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:12:15.818537 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4c5dfaa4-12ec-4973-9faa-b3e8d79f55b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:15.820046 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4c5dfaa4-12ec-4973-9faa-b3e8d79f55b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:15.827595 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1092/2185] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:12:15 2021] DELETE /identity/v3/projects/0024cbd69e614b2188e110a84e28b372 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:15.829030 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff373f4-dbe9-4958-b11d-c7a275cadfa0 service cinder] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:15.864661 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff373f4-dbe9-4958-b11d-c7a275cadfa0 service cinder] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:16.088840 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca67abd-735d-4753-8461-c8f020f042c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:16.091009 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca67abd-735d-4753-8461-c8f020f042c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:16.098312 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca67abd-735d-4753-8461-c8f020f042c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:16.099119 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca67abd-735d-4753-8461-c8f020f042c1 admin admin] PATH_INFO: `/v3/users/58f2bf08c0044ceaa5943ae200f0607a` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:16.103081 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca67abd-735d-4753-8461-c8f020f042c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58f2bf08c0044ceaa5943ae200f0607a)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:16.127096 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca67abd-735d-4753-8461-c8f020f042c1 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:16.289963 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-8ca67abd-735d-4753-8461-c8f020f042c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58f2bf08c0044ceaa5943ae200f0607a'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:16.290768 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-8ca67abd-735d-4753-8461-c8f020f042c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58f2bf08c0044ceaa5943ae200f0607a'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:16.291387 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-8ca67abd-735d-4753-8461-c8f020f042c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58f2bf08c0044ceaa5943ae200f0607a'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:16.363973 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-8ca67abd-735d-4753-8461-c8f020f042c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58f2bf08c0044ceaa5943ae200f0607a'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:16.395220 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-8ca67abd-735d-4753-8461-c8f020f042c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58f2bf08c0044ceaa5943ae200f0607a'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:16.478563 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1094/2186] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:12:15 2021] DELETE /identity/v3/users/58f2bf08c0044ceaa5943ae200f0607a => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:19.158581 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5dfaa4-12ec-4973-9faa-b3e8d79f55b7 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:19.160821 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-4c5dfaa4-12ec-4973-9faa-b3e8d79f55b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:19.193610 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5dfaa4-12ec-4973-9faa-b3e8d79f55b7 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:19.371087 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5351e2-f34b-433d-ba44-c9a6ecd9fb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:19.373713 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5351e2-f34b-433d-ba44-c9a6ecd9fb2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:19.374011 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5351e2-f34b-433d-ba44-c9a6ecd9fb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:19.376138 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5351e2-f34b-433d-ba44-c9a6ecd9fb2e admin admin] PATH_INFO: `/v3/projects/800b51e67dc044668706a390c7cb898a` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:19.381639 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5351e2-f34b-433d-ba44-c9a6ecd9fb2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=800b51e67dc044668706a390c7cb898a)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:19.385237 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5351e2-f34b-433d-ba44-c9a6ecd9fb2e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:19.485675 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-fb5351e2-f34b-433d-ba44-c9a6ecd9fb2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '800b51e67dc044668706a390c7cb898a', 'request_id': 'req-fb5351e2-f34b-433d-ba44-c9a6ecd9fb2e'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:19.494596 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-fb5351e2-f34b-433d-ba44-c9a6ecd9fb2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '800b51e67dc044668706a390c7cb898a', 'request_id': 'req-fb5351e2-f34b-433d-ba44-c9a6ecd9fb2e'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:19.522087 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-fb5351e2-f34b-433d-ba44-c9a6ecd9fb2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '800b51e67dc044668706a390c7cb898a', 'request_id': 'req-fb5351e2-f34b-433d-ba44-c9a6ecd9fb2e'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:19.540633 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-fb5351e2-f34b-433d-ba44-c9a6ecd9fb2e admin admin] The token cache is being invalidate because project 800b51e67dc044668706a390c7cb898a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:12:19.540993 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-fb5351e2-f34b-433d-ba44-c9a6ecd9fb2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:19.541747 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-fb5351e2-f34b-433d-ba44-c9a6ecd9fb2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:19.545428 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1093/2187] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:12:19 2021] DELETE /identity/v3/projects/800b51e67dc044668706a390c7cb898a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:19.551378 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54742142-c062-4729-bdfd-0a74d88e8f96 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:19.551922 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54742142-c062-4729-bdfd-0a74d88e8f96 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:19.551922 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54742142-c062-4729-bdfd-0a74d88e8f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:19.591197 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-54742142-c062-4729-bdfd-0a74d88e8f96 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:19.593068 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-54742142-c062-4729-bdfd-0a74d88e8f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:19.735688 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1095/2188] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:19.744985 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98271f96-a398-4187-a8bb-56b253c571d1 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:19.745937 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98271f96-a398-4187-a8bb-56b253c571d1 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:19.747337 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98271f96-a398-4187-a8bb-56b253c571d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:19.798480 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-98271f96-a398-4187-a8bb-56b253c571d1 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:19.800068 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-98271f96-a398-4187-a8bb-56b253c571d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:19.822086 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1094/2189] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:19.826836 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54742142-c062-4729-bdfd-0a74d88e8f96 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:19.842248 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54742142-c062-4729-bdfd-0a74d88e8f96 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:19.864151 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a1860-6d23-4fd5-b054-d236c0150515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:19.867386 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a1860-6d23-4fd5-b054-d236c0150515 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:19.867685 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a1860-6d23-4fd5-b054-d236c0150515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:19.867969 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a1860-6d23-4fd5-b054-d236c0150515 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:19.880216 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a1860-6d23-4fd5-b054-d236c0150515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:12:19.880556 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a1860-6d23-4fd5-b054-d236c0150515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:19.882954 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a1860-6d23-4fd5-b054-d236c0150515 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:19.908565 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1096/2190] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:12:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:12:19.912957 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98271f96-a398-4187-a8bb-56b253c571d1 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:19.927457 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98271f96-a398-4187-a8bb-56b253c571d1 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:19.937120 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8b743-4302-4d46-a48c-fc776fcc8f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:19.937933 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8b743-4302-4d46-a48c-fc776fcc8f44 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:19.938332 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8b743-4302-4d46-a48c-fc776fcc8f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:19.938632 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8b743-4302-4d46-a48c-fc776fcc8f44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:19.953073 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8b743-4302-4d46-a48c-fc776fcc8f44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:19.955080 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8b743-4302-4d46-a48c-fc776fcc8f44 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:20.027998 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1095/2191] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:12:19 2021] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:12:20.032591 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a1860-6d23-4fd5-b054-d236c0150515 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:20.072205 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a1860-6d23-4fd5-b054-d236c0150515 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:20.172152 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8b743-4302-4d46-a48c-fc776fcc8f44 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:20.174019 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-92c8b743-4302-4d46-a48c-fc776fcc8f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:20.286908 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b5109-dc3c-4b31-855e-cab97befdfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:20.289109 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b5109-dc3c-4b31-855e-cab97befdfa1 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:20.289572 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b5109-dc3c-4b31-855e-cab97befdfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:20.289995 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b5109-dc3c-4b31-855e-cab97befdfa1 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:20.291114 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b5109-dc3c-4b31-855e-cab97befdfa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:20.298592 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b5109-dc3c-4b31-855e-cab97befdfa1 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:20.360897 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1097/2192] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:12:20 2021] POST /identity/v3/users => generated 290 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:12:20.364616 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b5109-dc3c-4b31-855e-cab97befdfa1 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:20.388769 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b5109-dc3c-4b31-855e-cab97befdfa1 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:20.407510 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8b743-4302-4d46-a48c-fc776fcc8f44 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:20.409674 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b975c17-386b-4e50-bb02-7303a901951f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:20.416769 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b975c17-386b-4e50-bb02-7303a901951f admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:20.419534 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b975c17-386b-4e50-bb02-7303a901951f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:20.419830 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b975c17-386b-4e50-bb02-7303a901951f admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:20.420638 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b975c17-386b-4e50-bb02-7303a901951f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:20.425332 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b975c17-386b-4e50-bb02-7303a901951f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:20.428166 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448b0fb-48a9-4131-8c5c-3aaa2f1e8b62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:20.428941 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448b0fb-48a9-4131-8c5c-3aaa2f1e8b62 service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:20.429230 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448b0fb-48a9-4131-8c5c-3aaa2f1e8b62 service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:20.429568 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448b0fb-48a9-4131-8c5c-3aaa2f1e8b62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:20.437995 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-8448b0fb-48a9-4131-8c5c-3aaa2f1e8b62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:20.462036 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1098/2193] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:20 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:20.463901 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b975c17-386b-4e50-bb02-7303a901951f admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:20.504799 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b975c17-386b-4e50-bb02-7303a901951f admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:20.521970 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29607fc3-2ea3-4451-bd7f-03bc600a8e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:20.529945 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29607fc3-2ea3-4451-bd7f-03bc600a8e4e admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:20.530244 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29607fc3-2ea3-4451-bd7f-03bc600a8e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:20.530534 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29607fc3-2ea3-4451-bd7f-03bc600a8e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:20.531332 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29607fc3-2ea3-4451-bd7f-03bc600a8e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:20.540548 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29607fc3-2ea3-4451-bd7f-03bc600a8e4e admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:20.561376 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1099/2194] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:20 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:20.565258 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29607fc3-2ea3-4451-bd7f-03bc600a8e4e admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:20.588117 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29607fc3-2ea3-4451-bd7f-03bc600a8e4e admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:20.603105 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e93d9c-dfdd-4909-9ee2-d0aa120dd9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:20.604156 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e93d9c-dfdd-4909-9ee2-d0aa120dd9df admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:20.604805 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e93d9c-dfdd-4909-9ee2-d0aa120dd9df admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:20.605166 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e93d9c-dfdd-4909-9ee2-d0aa120dd9df admin admin] PATH_INFO: `/v3/projects/d35e6dbe26894896870d19cf03eacd3f/users/91d7e28a0f374b078047c315767291ec/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:20.634132 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448b0fb-48a9-4131-8c5c-3aaa2f1e8b62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:20.635658 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448b0fb-48a9-4131-8c5c-3aaa2f1e8b62 service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:20.650374 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e93d9c-dfdd-4909-9ee2-d0aa120dd9df admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35e6dbe26894896870d19cf03eacd3f, user_id=91d7e28a0f374b078047c315767291ec, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:20.659682 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1096/2195] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:12:20 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:12:20.659897 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e93d9c-dfdd-4909-9ee2-d0aa120dd9df admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:20.706729 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1100/2196] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:12:20 2021] PUT /identity/v3/projects/d35e6dbe26894896870d19cf03eacd3f/users/91d7e28a0f374b078047c315767291ec/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:20.722922 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4851891-374a-4ba8-bce0-403f5941a35c None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:20.723197 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4851891-374a-4ba8-bce0-403f5941a35c None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:20.723486 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4851891-374a-4ba8-bce0-403f5941a35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:20.781452 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-d4851891-374a-4ba8-bce0-403f5941a35c None None] MFA Rules not processed for user `91d7e28a0f374b078047c315767291ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:20.783070 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-d4851891-374a-4ba8-bce0-403f5941a35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:20.799152 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c66911-fa75-48ad-84af-2dde83864f91 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:20.799942 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c66911-fa75-48ad-84af-2dde83864f91 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:20.800229 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c66911-fa75-48ad-84af-2dde83864f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:20.880050 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-34c66911-fa75-48ad-84af-2dde83864f91 None None] MFA Rules not processed for user `ff251ac504444235af8055f7a9c8e0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:20.885940 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-34c66911-fa75-48ad-84af-2dde83864f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:20.954853 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1097/2197] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:20 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:20.955760 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4851891-374a-4ba8-bce0-403f5941a35c None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:21.183015 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1101/2198] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:20 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:12:21.234158 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4851891-374a-4ba8-bce0-403f5941a35c None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:21.247002 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a16c3-47d0-4983-af0b-dbe327f62e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:21.256621 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a16c3-47d0-4983-af0b-dbe327f62e3d admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:21.257435 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a16c3-47d0-4983-af0b-dbe327f62e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:21.257973 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a16c3-47d0-4983-af0b-dbe327f62e3d admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:21.261361 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a16c3-47d0-4983-af0b-dbe327f62e3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:21.266705 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a16c3-47d0-4983-af0b-dbe327f62e3d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:21.341784 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1098/2199] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:12:20 2021] POST /identity/v3/projects => generated 379 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:12:21.348114 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c66911-fa75-48ad-84af-2dde83864f91 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:21.374637 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c66911-fa75-48ad-84af-2dde83864f91 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:21.489924 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a16c3-47d0-4983-af0b-dbe327f62e3d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:21.492677 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-e78a16c3-47d0-4983-af0b-dbe327f62e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:21.568720 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c0f5d-881c-4d94-ba3d-94caa22ecc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:21.570557 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c0f5d-881c-4d94-ba3d-94caa22ecc5b admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:21.570917 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c0f5d-881c-4d94-ba3d-94caa22ecc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:21.571319 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c0f5d-881c-4d94-ba3d-94caa22ecc5b admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:21.572660 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c0f5d-881c-4d94-ba3d-94caa22ecc5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:21.577796 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c0f5d-881c-4d94-ba3d-94caa22ecc5b admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:21.632646 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1102/2200] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:12:21 2021] POST /identity/v3/users => generated 290 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:12:21.636963 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c0f5d-881c-4d94-ba3d-94caa22ecc5b admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:21.665409 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c0f5d-881c-4d94-ba3d-94caa22ecc5b admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:21.676447 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd991025-b758-4289-adf9-a9e48b734bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:21.677121 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd991025-b758-4289-adf9-a9e48b734bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:21.679853 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a16c3-47d0-4983-af0b-dbe327f62e3d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:21.680612 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd991025-b758-4289-adf9-a9e48b734bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:21.680925 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd991025-b758-4289-adf9-a9e48b734bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:21.681784 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd991025-b758-4289-adf9-a9e48b734bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:21.684119 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd991025-b758-4289-adf9-a9e48b734bc9 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:21.701755 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2f98d-152f-4a8a-afad-11fa769736ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:21.704925 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2f98d-152f-4a8a-afad-11fa769736ba service nova] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:21.705239 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2f98d-152f-4a8a-afad-11fa769736ba service nova] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:21.709725 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2f98d-152f-4a8a-afad-11fa769736ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:21.723463 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1103/2201] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:21 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:21.728635 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd991025-b758-4289-adf9-a9e48b734bc9 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:21.757278 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd991025-b758-4289-adf9-a9e48b734bc9 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:21.770072 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb977ad7-8c99-4c60-8b64-82e81776af6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:21.770753 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb977ad7-8c99-4c60-8b64-82e81776af6c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:21.770960 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb977ad7-8c99-4c60-8b64-82e81776af6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:21.771328 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb977ad7-8c99-4c60-8b64-82e81776af6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:21.772078 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb977ad7-8c99-4c60-8b64-82e81776af6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:21.779131 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb977ad7-8c99-4c60-8b64-82e81776af6c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:21.805446 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1104/2202] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:21 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:21.806902 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb977ad7-8c99-4c60-8b64-82e81776af6c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:21.829242 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb977ad7-8c99-4c60-8b64-82e81776af6c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:21.842653 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f39a2-1096-43db-b297-8323067d10e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:21.843614 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2f98d-152f-4a8a-afad-11fa769736ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:21.843770 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f39a2-1096-43db-b297-8323067d10e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:21.843999 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f39a2-1096-43db-b297-8323067d10e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:21.844351 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f39a2-1096-43db-b297-8323067d10e7 admin admin] PATH_INFO: `/v3/projects/c0d248c26b704ea29f71c761bc27bb30/users/9f8fc1305d574b5b8954e4089526f34f/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:21.846089 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2f98d-152f-4a8a-afad-11fa769736ba service nova] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:21.873055 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1099/2203] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:12:21 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:12:21.900356 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f39a2-1096-43db-b297-8323067d10e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d248c26b704ea29f71c761bc27bb30, user_id=9f8fc1305d574b5b8954e4089526f34f, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:21.903493 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f39a2-1096-43db-b297-8323067d10e7 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:21.934875 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1105/2204] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:12:21 2021] PUT /identity/v3/projects/c0d248c26b704ea29f71c761bc27bb30/users/9f8fc1305d574b5b8954e4089526f34f/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:21.947846 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea0225-145e-4e63-b200-fe57039a03ed None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:21.948622 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea0225-145e-4e63-b200-fe57039a03ed None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:21.949150 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea0225-145e-4e63-b200-fe57039a03ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:22.006541 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-8fea0225-145e-4e63-b200-fe57039a03ed None None] MFA Rules not processed for user `9f8fc1305d574b5b8954e4089526f34f`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:22.009908 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-8fea0225-145e-4e63-b200-fe57039a03ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:22.153883 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1100/2205] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:21 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:22.158583 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f39a2-1096-43db-b297-8323067d10e7 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:22.351136 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f39a2-1096-43db-b297-8323067d10e7 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:22.370399 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38962c-7376-42d6-ba63-2515c8fba301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:22.371157 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38962c-7376-42d6-ba63-2515c8fba301 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:22.371514 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38962c-7376-42d6-ba63-2515c8fba301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:22.371796 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38962c-7376-42d6-ba63-2515c8fba301 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:22.372625 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38962c-7376-42d6-ba63-2515c8fba301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:22.374776 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38962c-7376-42d6-ba63-2515c8fba301 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:22.432625 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1106/2206] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:12:22 2021] POST /identity/v3/projects => generated 379 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:12:22.436444 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea0225-145e-4e63-b200-fe57039a03ed None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:22.470355 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea0225-145e-4e63-b200-fe57039a03ed None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:22.674085 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109a430-c484-45cb-81a7-76e23a9af6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:22.676496 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109a430-c484-45cb-81a7-76e23a9af6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:22.682512 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109a430-c484-45cb-81a7-76e23a9af6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:22.682936 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109a430-c484-45cb-81a7-76e23a9af6b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:22.688908 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109a430-c484-45cb-81a7-76e23a9af6b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:22.699520 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109a430-c484-45cb-81a7-76e23a9af6b3 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:22.763216 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1101/2207] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:12:22 2021] POST /identity/v3/users => generated 296 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:12:22.765369 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38962c-7376-42d6-ba63-2515c8fba301 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:22.834282 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38962c-7376-42d6-ba63-2515c8fba301 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:22.853337 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdaeee-84e4-4b61-9d58-6ee1c83e63d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:22.854344 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdaeee-84e4-4b61-9d58-6ee1c83e63d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:22.854635 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdaeee-84e4-4b61-9d58-6ee1c83e63d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:22.854914 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdaeee-84e4-4b61-9d58-6ee1c83e63d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:22.855956 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdaeee-84e4-4b61-9d58-6ee1c83e63d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:22.857620 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdaeee-84e4-4b61-9d58-6ee1c83e63d8 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:22.894027 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1107/2208] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:22 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:22.898554 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109a430-c484-45cb-81a7-76e23a9af6b3 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:22.916465 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109a430-c484-45cb-81a7-76e23a9af6b3 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:22.934979 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195eb4f0-3555-4fad-b91a-791a36d76fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:22.935879 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195eb4f0-3555-4fad-b91a-791a36d76fec admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:22.936159 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195eb4f0-3555-4fad-b91a-791a36d76fec admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:22.936432 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195eb4f0-3555-4fad-b91a-791a36d76fec admin admin] PATH_INFO: `/v3/projects/41d126db1a8845b4987d4b1d5084d094/users/87caa00890c846cbad0c2501aa3539a6/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:22.998543 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195eb4f0-3555-4fad-b91a-791a36d76fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=41d126db1a8845b4987d4b1d5084d094, user_id=87caa00890c846cbad0c2501aa3539a6, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:23.001242 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195eb4f0-3555-4fad-b91a-791a36d76fec admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:23.033658 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1102/2209] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:12:22 2021] PUT /identity/v3/projects/41d126db1a8845b4987d4b1d5084d094/users/87caa00890c846cbad0c2501aa3539a6/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:23.042951 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdaeee-84e4-4b61-9d58-6ee1c83e63d8 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:23.071500 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdaeee-84e4-4b61-9d58-6ee1c83e63d8 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:23.324097 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6473d-4ee5-4821-832c-43c0b32276cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:23.324688 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6473d-4ee5-4821-832c-43c0b32276cf admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:23.325260 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6473d-4ee5-4821-832c-43c0b32276cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:23.325730 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6473d-4ee5-4821-832c-43c0b32276cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:23.336638 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6473d-4ee5-4821-832c-43c0b32276cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:23.357891 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6473d-4ee5-4821-832c-43c0b32276cf admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:23.402530 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1108/2210] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:23 2021] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:23.403117 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195eb4f0-3555-4fad-b91a-791a36d76fec admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:23.418478 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195eb4f0-3555-4fad-b91a-791a36d76fec admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:23.432005 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08193d89-1077-4575-a712-ad5054a73310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:23.432986 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08193d89-1077-4575-a712-ad5054a73310 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:23.433271 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08193d89-1077-4575-a712-ad5054a73310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:23.433615 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08193d89-1077-4575-a712-ad5054a73310 admin admin] PATH_INFO: `/v3/projects/41d126db1a8845b4987d4b1d5084d094/users/87caa00890c846cbad0c2501aa3539a6/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:23.439816 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08193d89-1077-4575-a712-ad5054a73310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41d126db1a8845b4987d4b1d5084d094, user_id=87caa00890c846cbad0c2501aa3539a6, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:23.457738 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08193d89-1077-4575-a712-ad5054a73310 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:23.528791 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1103/2211] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:12:23 2021] PUT /identity/v3/projects/41d126db1a8845b4987d4b1d5084d094/users/87caa00890c846cbad0c2501aa3539a6/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:23.543907 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64834f8-bd4b-4ea8-bc12-c06f1ba1a7da None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:23.544307 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64834f8-bd4b-4ea8-bc12-c06f1ba1a7da None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:23.544493 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64834f8-bd4b-4ea8-bc12-c06f1ba1a7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:23.634738 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-b64834f8-bd4b-4ea8-bc12-c06f1ba1a7da None None] MFA Rules not processed for user `87caa00890c846cbad0c2501aa3539a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:23.635985 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-b64834f8-bd4b-4ea8-bc12-c06f1ba1a7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:23.813116 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1109/2212] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:23 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:23.825351 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08193d89-1077-4575-a712-ad5054a73310 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:23.829416 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-08193d89-1077-4575-a712-ad5054a73310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:24.009196 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08193d89-1077-4575-a712-ad5054a73310 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:24.071945 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0fe36-7c33-4609-bef5-e8e980954a47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:24.073287 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0fe36-7c33-4609-bef5-e8e980954a47 service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:24.074236 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0fe36-7c33-4609-bef5-e8e980954a47 service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:24.074236 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0fe36-7c33-4609-bef5-e8e980954a47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:24.087152 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0fe36-7c33-4609-bef5-e8e980954a47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:24.088834 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0fe36-7c33-4609-bef5-e8e980954a47 service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:24.102830 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1104/2213] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:12:23 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:12:24.170265 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64834f8-bd4b-4ea8-bc12-c06f1ba1a7da None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:24.197133 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64834f8-bd4b-4ea8-bc12-c06f1ba1a7da None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:24.205612 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f26485-3362-4e16-9804-a7c0b2241d72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:24.206287 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f26485-3362-4e16-9804-a7c0b2241d72 service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:24.215332 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f26485-3362-4e16-9804-a7c0b2241d72 service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:24.215732 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f26485-3362-4e16-9804-a7c0b2241d72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:24.421774 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f26485-3362-4e16-9804-a7c0b2241d72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:24.430590 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f26485-3362-4e16-9804-a7c0b2241d72 service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:24.480029 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1110/2214] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:12:24 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:12:24.756552 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1955a11-be2f-43ed-8186-d3f42aa1d4ad None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:24.757127 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1955a11-be2f-43ed-8186-d3f42aa1d4ad None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:24.757429 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1955a11-be2f-43ed-8186-d3f42aa1d4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:24.853093 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-c1955a11-be2f-43ed-8186-d3f42aa1d4ad None None] MFA Rules not processed for user `4bec6399356d48458f2ba1da75993f64`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:24.854414 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-c1955a11-be2f-43ed-8186-d3f42aa1d4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:25.133040 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1105/2215] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:24 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:25.325860 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f26485-3362-4e16-9804-a7c0b2241d72 service cinder] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:25.569943 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f26485-3362-4e16-9804-a7c0b2241d72 service cinder] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:25.603009 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b986b6f-ca95-4ce4-93bf-1f9cdb962f75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:25.605034 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b986b6f-ca95-4ce4-93bf-1f9cdb962f75 service nova] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:25.606245 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b986b6f-ca95-4ce4-93bf-1f9cdb962f75 service nova] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:25.606702 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b986b6f-ca95-4ce4-93bf-1f9cdb962f75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:25.611365 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-2b986b6f-ca95-4ce4-93bf-1f9cdb962f75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:25.737878 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b986b6f-ca95-4ce4-93bf-1f9cdb962f75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:25.739422 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b986b6f-ca95-4ce4-93bf-1f9cdb962f75 service nova] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:25.758064 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1111/2216] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:12:25 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:12:27.026010 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1955a11-be2f-43ed-8186-d3f42aa1d4ad None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:27.027563 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-c1955a11-be2f-43ed-8186-d3f42aa1d4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:27.162815 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976be21-cde4-4352-8372-6e51ff9bf2e7 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:27.163497 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976be21-cde4-4352-8372-6e51ff9bf2e7 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:27.163750 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976be21-cde4-4352-8372-6e51ff9bf2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:27.187208 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1955a11-be2f-43ed-8186-d3f42aa1d4ad None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:27.192992 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008fc1f-e0c8-4948-a8d2-c755faf972ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:27.194178 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008fc1f-e0c8-4948-a8d2-c755faf972ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:27.195240 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008fc1f-e0c8-4948-a8d2-c755faf972ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:27.195717 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008fc1f-e0c8-4948-a8d2-c755faf972ea admin admin] PATH_INFO: `/v3/users/4098b8b3fb4440e88cfa011bb59e6072` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:27.197642 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008fc1f-e0c8-4948-a8d2-c755faf972ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=4098b8b3fb4440e88cfa011bb59e6072)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:27.200546 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008fc1f-e0c8-4948-a8d2-c755faf972ea admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:27.209073 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-b976be21-cde4-4352-8372-6e51ff9bf2e7 None None] MFA Rules not processed for user `ff251ac504444235af8055f7a9c8e0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:27.211705 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-b976be21-cde4-4352-8372-6e51ff9bf2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:27.412187 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4008fc1f-e0c8-4948-a8d2-c755faf972ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4098b8b3fb4440e88cfa011bb59e6072'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:27.413890 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4008fc1f-e0c8-4948-a8d2-c755faf972ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4098b8b3fb4440e88cfa011bb59e6072'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:27.449017 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4008fc1f-e0c8-4948-a8d2-c755faf972ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4098b8b3fb4440e88cfa011bb59e6072'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:27.450449 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4008fc1f-e0c8-4948-a8d2-c755faf972ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4098b8b3fb4440e88cfa011bb59e6072'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:27.459251 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1112/2217] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:27 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:27.501347 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4008fc1f-e0c8-4948-a8d2-c755faf972ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4098b8b3fb4440e88cfa011bb59e6072'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:27.533420 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1106/2218] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:12:27 2021] DELETE /identity/v3/users/4098b8b3fb4440e88cfa011bb59e6072 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:27.540050 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec1317-3bf5-427e-ad46-9f134ac5e9ca None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:27.541211 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec1317-3bf5-427e-ad46-9f134ac5e9ca None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:27.541805 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec1317-3bf5-427e-ad46-9f134ac5e9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:27.594551 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-98ec1317-3bf5-427e-ad46-9f134ac5e9ca None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:27.596771 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-98ec1317-3bf5-427e-ad46-9f134ac5e9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:27.733220 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1113/2219] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:27.745583 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008fc1f-e0c8-4948-a8d2-c755faf972ea admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:27.747027 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-4008fc1f-e0c8-4948-a8d2-c755faf972ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:27.888584 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008fc1f-e0c8-4948-a8d2-c755faf972ea admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:27.892896 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50356c-54a7-4bfd-9c05-d3c7d6244937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:27.893740 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50356c-54a7-4bfd-9c05-d3c7d6244937 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:27.894097 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50356c-54a7-4bfd-9c05-d3c7d6244937 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:27.894439 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50356c-54a7-4bfd-9c05-d3c7d6244937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:27.905264 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50356c-54a7-4bfd-9c05-d3c7d6244937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:27.906873 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50356c-54a7-4bfd-9c05-d3c7d6244937 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:27.918618 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1107/2220] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:12:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:12:28.519031 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec1317-3bf5-427e-ad46-9f134ac5e9ca None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:28.520706 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-98ec1317-3bf5-427e-ad46-9f134ac5e9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:28.551004 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec1317-3bf5-427e-ad46-9f134ac5e9ca None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:28.570529 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384d2d5-97d1-42ff-840d-018ed6bcceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:28.571530 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384d2d5-97d1-42ff-840d-018ed6bcceb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:28.572060 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384d2d5-97d1-42ff-840d-018ed6bcceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:28.572562 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384d2d5-97d1-42ff-840d-018ed6bcceb0 admin admin] PATH_INFO: `/v3/projects/5778f05efa2b4b29890c0899f6261a51` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:28.577007 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384d2d5-97d1-42ff-840d-018ed6bcceb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5778f05efa2b4b29890c0899f6261a51)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:28.597252 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384d2d5-97d1-42ff-840d-018ed6bcceb0 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:28.612629 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fc5d3-4721-4e8b-850f-b759ed4dad78 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:28.613224 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fc5d3-4721-4e8b-850f-b759ed4dad78 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:28.613224 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fc5d3-4721-4e8b-850f-b759ed4dad78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:28.644618 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-2a8fc5d3-4721-4e8b-850f-b759ed4dad78 None None] MFA Rules not processed for user `aaa0c20019c84107b8324cd915ff78db`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:28.646252 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-2a8fc5d3-4721-4e8b-850f-b759ed4dad78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:28.756575 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-c384d2d5-97d1-42ff-840d-018ed6bcceb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5778f05efa2b4b29890c0899f6261a51', 'request_id': 'req-c384d2d5-97d1-42ff-840d-018ed6bcceb0'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:28.775950 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1108/2221] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:28 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:28.777600 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fc5d3-4721-4e8b-850f-b759ed4dad78 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:28.779891 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-c384d2d5-97d1-42ff-840d-018ed6bcceb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5778f05efa2b4b29890c0899f6261a51', 'request_id': 'req-c384d2d5-97d1-42ff-840d-018ed6bcceb0'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:28.790709 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-2a8fc5d3-4721-4e8b-850f-b759ed4dad78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:28.791486 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-c384d2d5-97d1-42ff-840d-018ed6bcceb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5778f05efa2b4b29890c0899f6261a51', 'request_id': 'req-c384d2d5-97d1-42ff-840d-018ed6bcceb0'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:28.820767 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fc5d3-4721-4e8b-850f-b759ed4dad78 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:28.820911 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-c384d2d5-97d1-42ff-840d-018ed6bcceb0 admin admin] The token cache is being invalidate because project 5778f05efa2b4b29890c0899f6261a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:12:28.821111 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-c384d2d5-97d1-42ff-840d-018ed6bcceb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:28.822654 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-c384d2d5-97d1-42ff-840d-018ed6bcceb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:28.824653 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1114/2222] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:12:28 2021] DELETE /identity/v3/projects/5778f05efa2b4b29890c0899f6261a51 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:28.828680 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384d2d5-97d1-42ff-840d-018ed6bcceb0 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:28.836463 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c384d2d5-97d1-42ff-840d-018ed6bcceb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:28.944441 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75920e15-1316-4279-ad71-d292e00deb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:28.945998 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75920e15-1316-4279-ad71-d292e00deb0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:28.946645 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75920e15-1316-4279-ad71-d292e00deb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:28.947141 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75920e15-1316-4279-ad71-d292e00deb0d admin admin] PATH_INFO: `/v3/users/91d7e28a0f374b078047c315767291ec` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:28.948835 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75920e15-1316-4279-ad71-d292e00deb0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=91d7e28a0f374b078047c315767291ec)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:28.951592 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75920e15-1316-4279-ad71-d292e00deb0d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:28.988972 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384d2d5-97d1-42ff-840d-018ed6bcceb0 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:29.018171 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2b4ca-6229-47a2-bcf4-f25db014e4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:29.019320 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2b4ca-6229-47a2-bcf4-f25db014e4f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:29.019752 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2b4ca-6229-47a2-bcf4-f25db014e4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:29.020187 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2b4ca-6229-47a2-bcf4-f25db014e4f3 admin admin] PATH_INFO: `/v3/users/555aa2edb9c24598b0a06f571072122b` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:29.028118 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-75920e15-1316-4279-ad71-d292e00deb0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91d7e28a0f374b078047c315767291ec'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:29.029430 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-75920e15-1316-4279-ad71-d292e00deb0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91d7e28a0f374b078047c315767291ec'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:29.031077 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d2b4ca-6229-47a2-bcf4-f25db014e4f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=555aa2edb9c24598b0a06f571072122b)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:29.033453 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d2b4ca-6229-47a2-bcf4-f25db014e4f3 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:29.039438 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-75920e15-1316-4279-ad71-d292e00deb0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91d7e28a0f374b078047c315767291ec'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:29.040522 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-75920e15-1316-4279-ad71-d292e00deb0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91d7e28a0f374b078047c315767291ec'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:29.056823 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-75920e15-1316-4279-ad71-d292e00deb0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91d7e28a0f374b078047c315767291ec'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:29.087788 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1109/2223] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:12:28 2021] DELETE /identity/v3/users/91d7e28a0f374b078047c315767291ec => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:29.092550 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15722f-32d2-46ad-a6c1-82fda2a7bfbd None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:29.093088 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15722f-32d2-46ad-a6c1-82fda2a7bfbd None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:29.093842 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15722f-32d2-46ad-a6c1-82fda2a7bfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:29.131134 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-de15722f-32d2-46ad-a6c1-82fda2a7bfbd None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:29.134197 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-de15722f-32d2-46ad-a6c1-82fda2a7bfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:29.196946 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-31d2b4ca-6229-47a2-bcf4-f25db014e4f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '555aa2edb9c24598b0a06f571072122b'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:29.198587 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-31d2b4ca-6229-47a2-bcf4-f25db014e4f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '555aa2edb9c24598b0a06f571072122b'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:29.201053 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-31d2b4ca-6229-47a2-bcf4-f25db014e4f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '555aa2edb9c24598b0a06f571072122b'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:29.239158 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1110/2224] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:12:29.259531 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-31d2b4ca-6229-47a2-bcf4-f25db014e4f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '555aa2edb9c24598b0a06f571072122b'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:29.279247 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-31d2b4ca-6229-47a2-bcf4-f25db014e4f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '555aa2edb9c24598b0a06f571072122b'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:29.300614 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1115/2225] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:12:28 2021] DELETE /identity/v3/users/555aa2edb9c24598b0a06f571072122b => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:29.332535 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15722f-32d2-46ad-a6c1-82fda2a7bfbd None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:29.334402 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-de15722f-32d2-46ad-a6c1-82fda2a7bfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:29.476174 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15722f-32d2-46ad-a6c1-82fda2a7bfbd None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:29.553411 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f9fa2-0664-423c-9d41-c876d7e5a3d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:29.554567 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f9fa2-0664-423c-9d41-c876d7e5a3d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:29.555137 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f9fa2-0664-423c-9d41-c876d7e5a3d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:29.555819 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f9fa2-0664-423c-9d41-c876d7e5a3d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:29.642316 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f9fa2-0664-423c-9d41-c876d7e5a3d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:29.644712 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f9fa2-0664-423c-9d41-c876d7e5a3d2 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:29.658535 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1111/2226] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:12:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:12:30.670473 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2b4ca-6229-47a2-bcf4-f25db014e4f3 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:30.672965 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-31d2b4ca-6229-47a2-bcf4-f25db014e4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:30.691654 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2b4ca-6229-47a2-bcf4-f25db014e4f3 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:30.706352 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37838b1b-f8f2-4888-920e-77055f9824bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:30.708177 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37838b1b-f8f2-4888-920e-77055f9824bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:30.708859 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37838b1b-f8f2-4888-920e-77055f9824bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:30.709619 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37838b1b-f8f2-4888-920e-77055f9824bb admin admin] PATH_INFO: `/v3/projects/4362e2ca76b643adb8cf0c24fdc3a70b` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:30.712362 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37838b1b-f8f2-4888-920e-77055f9824bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4362e2ca76b643adb8cf0c24fdc3a70b)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:30.715099 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37838b1b-f8f2-4888-920e-77055f9824bb admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:30.850298 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-37838b1b-f8f2-4888-920e-77055f9824bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4362e2ca76b643adb8cf0c24fdc3a70b', 'request_id': 'req-37838b1b-f8f2-4888-920e-77055f9824bb'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:30.868462 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-37838b1b-f8f2-4888-920e-77055f9824bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4362e2ca76b643adb8cf0c24fdc3a70b', 'request_id': 'req-37838b1b-f8f2-4888-920e-77055f9824bb'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:30.878229 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-37838b1b-f8f2-4888-920e-77055f9824bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4362e2ca76b643adb8cf0c24fdc3a70b', 'request_id': 'req-37838b1b-f8f2-4888-920e-77055f9824bb'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:30.908894 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-37838b1b-f8f2-4888-920e-77055f9824bb admin admin] The token cache is being invalidate because project 4362e2ca76b643adb8cf0c24fdc3a70b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:12:30.911635 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-37838b1b-f8f2-4888-920e-77055f9824bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:30.914119 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-37838b1b-f8f2-4888-920e-77055f9824bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:30.924152 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1116/2227] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:12:30 2021] DELETE /identity/v3/projects/4362e2ca76b643adb8cf0c24fdc3a70b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:30.926452 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c2ff4-d442-4e5f-ae43-e56d7553f3b9 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:30.926931 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c2ff4-d442-4e5f-ae43-e56d7553f3b9 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:30.927052 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c2ff4-d442-4e5f-ae43-e56d7553f3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:31.019507 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-038c2ff4-d442-4e5f-ae43-e56d7553f3b9 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:31.020771 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-038c2ff4-d442-4e5f-ae43-e56d7553f3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:31.135126 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1112/2228] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:31.144778 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a702c50-5f43-4795-99b5-4de9788dc038 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:31.146036 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a702c50-5f43-4795-99b5-4de9788dc038 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:31.147151 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a702c50-5f43-4795-99b5-4de9788dc038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:31.177933 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-0a702c50-5f43-4795-99b5-4de9788dc038 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:31.179515 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-0a702c50-5f43-4795-99b5-4de9788dc038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:31.202206 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1117/2229] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:31.202907 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c2ff4-d442-4e5f-ae43-e56d7553f3b9 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:31.214150 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c2ff4-d442-4e5f-ae43-e56d7553f3b9 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:31.223200 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337fd8d-6c5a-43e6-a7d3-6e610516b144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:31.224113 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337fd8d-6c5a-43e6-a7d3-6e610516b144 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:31.224693 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337fd8d-6c5a-43e6-a7d3-6e610516b144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:31.225317 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337fd8d-6c5a-43e6-a7d3-6e610516b144 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:31.226955 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337fd8d-6c5a-43e6-a7d3-6e610516b144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:12:31.227479 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337fd8d-6c5a-43e6-a7d3-6e610516b144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:31.229555 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337fd8d-6c5a-43e6-a7d3-6e610516b144 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:31.270374 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1113/2230] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:12:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:12:31.276141 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a702c50-5f43-4795-99b5-4de9788dc038 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:31.295189 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a702c50-5f43-4795-99b5-4de9788dc038 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:31.312583 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4e771-7378-4dc3-aaca-199a2ce833f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:31.313477 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4e771-7378-4dc3-aaca-199a2ce833f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:31.313866 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4e771-7378-4dc3-aaca-199a2ce833f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:31.314244 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4e771-7378-4dc3-aaca-199a2ce833f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:31.315076 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4e771-7378-4dc3-aaca-199a2ce833f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:31.318279 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4e771-7378-4dc3-aaca-199a2ce833f6 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:31.370782 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1118/2231] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:12:31 2021] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:12:31.375309 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337fd8d-6c5a-43e6-a7d3-6e610516b144 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:31.393474 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337fd8d-6c5a-43e6-a7d3-6e610516b144 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:31.536001 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46bcb8-3940-4f8c-bc50-e20f8eae1b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:31.536592 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46bcb8-3940-4f8c-bc50-e20f8eae1b86 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:31.536880 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46bcb8-3940-4f8c-bc50-e20f8eae1b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:31.537159 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46bcb8-3940-4f8c-bc50-e20f8eae1b86 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:31.541081 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46bcb8-3940-4f8c-bc50-e20f8eae1b86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:31.545759 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46bcb8-3940-4f8c-bc50-e20f8eae1b86 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:31.573654 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4e771-7378-4dc3-aaca-199a2ce833f6 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:31.575434 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-b8b4e771-7378-4dc3-aaca-199a2ce833f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:31.600016 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4e771-7378-4dc3-aaca-199a2ce833f6 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:31.612664 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1114/2232] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:12:31 2021] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:12:31.616045 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6000fe-f1a0-4f9a-b421-212bf60ffa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:31.617569 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6000fe-f1a0-4f9a-b421-212bf60ffa2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:31.617569 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6000fe-f1a0-4f9a-b421-212bf60ffa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:31.617797 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6000fe-f1a0-4f9a-b421-212bf60ffa2f admin admin] PATH_INFO: `/v3/projects/d35e6dbe26894896870d19cf03eacd3f` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:31.620130 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6000fe-f1a0-4f9a-b421-212bf60ffa2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d35e6dbe26894896870d19cf03eacd3f)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:31.622191 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6000fe-f1a0-4f9a-b421-212bf60ffa2f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:31.622823 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46bcb8-3940-4f8c-bc50-e20f8eae1b86 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:31.660790 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46bcb8-3940-4f8c-bc50-e20f8eae1b86 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:31.681144 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e330984-eead-4e06-8fcf-8d2b71d2a0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:31.682259 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e330984-eead-4e06-8fcf-8d2b71d2a0af admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:31.683699 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e330984-eead-4e06-8fcf-8d2b71d2a0af admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:31.683699 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e330984-eead-4e06-8fcf-8d2b71d2a0af admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:31.686639 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e330984-eead-4e06-8fcf-8d2b71d2a0af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:31.688557 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e330984-eead-4e06-8fcf-8d2b71d2a0af admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:31.755214 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-1e6000fe-f1a0-4f9a-b421-212bf60ffa2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd35e6dbe26894896870d19cf03eacd3f', 'request_id': 'req-1e6000fe-f1a0-4f9a-b421-212bf60ffa2f'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:31.758719 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1115/2233] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:31 2021] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:31.760611 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e330984-eead-4e06-8fcf-8d2b71d2a0af admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:31.780849 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-1e6000fe-f1a0-4f9a-b421-212bf60ffa2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd35e6dbe26894896870d19cf03eacd3f', 'request_id': 'req-1e6000fe-f1a0-4f9a-b421-212bf60ffa2f'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:31.795392 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-1e6000fe-f1a0-4f9a-b421-212bf60ffa2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd35e6dbe26894896870d19cf03eacd3f', 'request_id': 'req-1e6000fe-f1a0-4f9a-b421-212bf60ffa2f'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:31.797804 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e330984-eead-4e06-8fcf-8d2b71d2a0af admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:31.844590 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-1e6000fe-f1a0-4f9a-b421-212bf60ffa2f admin admin] The token cache is being invalidate because project d35e6dbe26894896870d19cf03eacd3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:12:31.845287 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-1e6000fe-f1a0-4f9a-b421-212bf60ffa2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:31.846650 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-1e6000fe-f1a0-4f9a-b421-212bf60ffa2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:31.861414 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1119/2234] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:12:31 2021] DELETE /identity/v3/projects/d35e6dbe26894896870d19cf03eacd3f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:31.865843 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6000fe-f1a0-4f9a-b421-212bf60ffa2f admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:31.868456 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-1e6000fe-f1a0-4f9a-b421-212bf60ffa2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:32.005127 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6a106-74a1-4b6d-b44f-9b5755647fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:32.005764 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6a106-74a1-4b6d-b44f-9b5755647fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:32.006019 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6a106-74a1-4b6d-b44f-9b5755647fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:32.008404 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6a106-74a1-4b6d-b44f-9b5755647fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:32.010420 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6a106-74a1-4b6d-b44f-9b5755647fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:32.024727 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6a106-74a1-4b6d-b44f-9b5755647fa6 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:32.044316 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1116/2235] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:31 2021] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:32.048322 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6a106-74a1-4b6d-b44f-9b5755647fa6 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:32.051621 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-21e6a106-74a1-4b6d-b44f-9b5755647fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:32.055395 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6000fe-f1a0-4f9a-b421-212bf60ffa2f admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:32.066372 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6c66d-e1ed-4db8-af1c-ef6c59195bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:32.067478 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6c66d-e1ed-4db8-af1c-ef6c59195bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:32.067903 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6c66d-e1ed-4db8-af1c-ef6c59195bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:32.068036 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6a106-74a1-4b6d-b44f-9b5755647fa6 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:32.068458 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6c66d-e1ed-4db8-af1c-ef6c59195bd2 admin admin] PATH_INFO: `/v3/users/9f8fc1305d574b5b8954e4089526f34f` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:32.088320 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6c66d-e1ed-4db8-af1c-ef6c59195bd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f8fc1305d574b5b8954e4089526f34f)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:32.088965 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59a7ea-64aa-4d04-bc2b-f71daabb1cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:32.089964 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59a7ea-64aa-4d04-bc2b-f71daabb1cf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:32.090099 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6c66d-e1ed-4db8-af1c-ef6c59195bd2 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:32.090388 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59a7ea-64aa-4d04-bc2b-f71daabb1cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:32.090740 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59a7ea-64aa-4d04-bc2b-f71daabb1cf8 admin admin] PATH_INFO: `/v3/projects/c21cd8bed9614523b4d36d5aaa035277/users/54d047591e804fb596b8453d9acbf692/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:32.133030 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59a7ea-64aa-4d04-bc2b-f71daabb1cf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c21cd8bed9614523b4d36d5aaa035277, user_id=54d047591e804fb596b8453d9acbf692, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:32.145751 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59a7ea-64aa-4d04-bc2b-f71daabb1cf8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:32.182768 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-04f6c66d-e1ed-4db8-af1c-ef6c59195bd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f8fc1305d574b5b8954e4089526f34f'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:32.183860 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-04f6c66d-e1ed-4db8-af1c-ef6c59195bd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f8fc1305d574b5b8954e4089526f34f'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:32.184663 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-04f6c66d-e1ed-4db8-af1c-ef6c59195bd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f8fc1305d574b5b8954e4089526f34f'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:32.192209 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1117/2236] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:12:32 2021] PUT /identity/v3/projects/c21cd8bed9614523b4d36d5aaa035277/users/54d047591e804fb596b8453d9acbf692/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:12:32.195587 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00504bfa-09bb-4b70-b658-d61c627c2d0f None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:32.195985 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00504bfa-09bb-4b70-b658-d61c627c2d0f None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:32.196792 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00504bfa-09bb-4b70-b658-d61c627c2d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:32.224535 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-04f6c66d-e1ed-4db8-af1c-ef6c59195bd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f8fc1305d574b5b8954e4089526f34f'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:32.242583 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-04f6c66d-e1ed-4db8-af1c-ef6c59195bd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f8fc1305d574b5b8954e4089526f34f'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:32.262394 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1120/2237] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:12:31 2021] DELETE /identity/v3/users/9f8fc1305d574b5b8954e4089526f34f => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:32.278054 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-00504bfa-09bb-4b70-b658-d61c627c2d0f None None] MFA Rules not processed for user `54d047591e804fb596b8453d9acbf692`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:32.279298 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-00504bfa-09bb-4b70-b658-d61c627c2d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:32.427302 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1118/2238] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:32 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:32.438851 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6c66d-e1ed-4db8-af1c-ef6c59195bd2 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:32.441210 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-04f6c66d-e1ed-4db8-af1c-ef6c59195bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:32.535698 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6c66d-e1ed-4db8-af1c-ef6c59195bd2 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:32.561964 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43469699-e7e1-40b0-9739-f91465da6083 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:32.564046 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43469699-e7e1-40b0-9739-f91465da6083 service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:32.564046 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43469699-e7e1-40b0-9739-f91465da6083 service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:32.564046 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43469699-e7e1-40b0-9739-f91465da6083 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:32.591893 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43469699-e7e1-40b0-9739-f91465da6083 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:32.594309 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43469699-e7e1-40b0-9739-f91465da6083 service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:32.606701 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1121/2239] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:12:32 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:12:33.247233 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00504bfa-09bb-4b70-b658-d61c627c2d0f None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:33.247233 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-00504bfa-09bb-4b70-b658-d61c627c2d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:33.459231 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00504bfa-09bb-4b70-b658-d61c627c2d0f None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:33.464841 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f9b51-f6cf-4699-8951-bec0a35210c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:33.465920 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f9b51-f6cf-4699-8951-bec0a35210c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:33.466201 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f9b51-f6cf-4699-8951-bec0a35210c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:33.466601 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f9b51-f6cf-4699-8951-bec0a35210c2 admin admin] PATH_INFO: `/v3/projects/c0d248c26b704ea29f71c761bc27bb30` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:33.467818 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f9b51-f6cf-4699-8951-bec0a35210c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0d248c26b704ea29f71c761bc27bb30)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:33.470041 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f9b51-f6cf-4699-8951-bec0a35210c2 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:33.562253 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-2d1f9b51-f6cf-4699-8951-bec0a35210c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0d248c26b704ea29f71c761bc27bb30', 'request_id': 'req-2d1f9b51-f6cf-4699-8951-bec0a35210c2'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:33.593716 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-2d1f9b51-f6cf-4699-8951-bec0a35210c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0d248c26b704ea29f71c761bc27bb30', 'request_id': 'req-2d1f9b51-f6cf-4699-8951-bec0a35210c2'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:33.603844 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-2d1f9b51-f6cf-4699-8951-bec0a35210c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0d248c26b704ea29f71c761bc27bb30', 'request_id': 'req-2d1f9b51-f6cf-4699-8951-bec0a35210c2'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:33.621259 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-2d1f9b51-f6cf-4699-8951-bec0a35210c2 admin admin] The token cache is being invalidate because project c0d248c26b704ea29f71c761bc27bb30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:12:33.621729 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-2d1f9b51-f6cf-4699-8951-bec0a35210c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:33.622470 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-2d1f9b51-f6cf-4699-8951-bec0a35210c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:33.624418 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1119/2240] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:12:33 2021] DELETE /identity/v3/projects/c0d248c26b704ea29f71c761bc27bb30 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:33.629187 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43469699-e7e1-40b0-9739-f91465da6083 service cinder] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:33.645994 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43469699-e7e1-40b0-9739-f91465da6083 service cinder] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:33.836509 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae495a-d4f9-4528-a160-700b733af192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:33.837339 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae495a-d4f9-4528-a160-700b733af192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:33.837644 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae495a-d4f9-4528-a160-700b733af192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:33.837926 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae495a-d4f9-4528-a160-700b733af192 admin admin] PATH_INFO: `/v3/users/87caa00890c846cbad0c2501aa3539a6` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:33.842657 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae495a-d4f9-4528-a160-700b733af192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87caa00890c846cbad0c2501aa3539a6)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:33.845329 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae495a-d4f9-4528-a160-700b733af192 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:33.977740 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-25ae495a-d4f9-4528-a160-700b733af192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87caa00890c846cbad0c2501aa3539a6'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:33.982127 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-25ae495a-d4f9-4528-a160-700b733af192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87caa00890c846cbad0c2501aa3539a6'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:33.982967 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-25ae495a-d4f9-4528-a160-700b733af192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87caa00890c846cbad0c2501aa3539a6'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:34.010970 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-25ae495a-d4f9-4528-a160-700b733af192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87caa00890c846cbad0c2501aa3539a6'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:34.046814 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-25ae495a-d4f9-4528-a160-700b733af192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87caa00890c846cbad0c2501aa3539a6'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:34.072840 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1122/2241] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:12:33 2021] DELETE /identity/v3/users/87caa00890c846cbad0c2501aa3539a6 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:34.789490 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f9b51-f6cf-4699-8951-bec0a35210c2 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:34.791050 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-2d1f9b51-f6cf-4699-8951-bec0a35210c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:34.812507 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f9b51-f6cf-4699-8951-bec0a35210c2 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:34.999992 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52e67a-7097-4baa-a851-782d3fec81b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:35.001139 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52e67a-7097-4baa-a851-782d3fec81b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:35.001763 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52e67a-7097-4baa-a851-782d3fec81b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:35.002114 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52e67a-7097-4baa-a851-782d3fec81b4 admin admin] PATH_INFO: `/v3/projects/41d126db1a8845b4987d4b1d5084d094` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:35.003740 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52e67a-7097-4baa-a851-782d3fec81b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41d126db1a8845b4987d4b1d5084d094)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:35.005870 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52e67a-7097-4baa-a851-782d3fec81b4 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:35.070135 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-6d52e67a-7097-4baa-a851-782d3fec81b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41d126db1a8845b4987d4b1d5084d094', 'request_id': 'req-6d52e67a-7097-4baa-a851-782d3fec81b4'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:35.089402 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-6d52e67a-7097-4baa-a851-782d3fec81b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41d126db1a8845b4987d4b1d5084d094', 'request_id': 'req-6d52e67a-7097-4baa-a851-782d3fec81b4'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:35.112176 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-6d52e67a-7097-4baa-a851-782d3fec81b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41d126db1a8845b4987d4b1d5084d094', 'request_id': 'req-6d52e67a-7097-4baa-a851-782d3fec81b4'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:35.126075 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-6d52e67a-7097-4baa-a851-782d3fec81b4 admin admin] The token cache is being invalidate because project 41d126db1a8845b4987d4b1d5084d094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:12:35.126336 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-6d52e67a-7097-4baa-a851-782d3fec81b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:35.127686 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-6d52e67a-7097-4baa-a851-782d3fec81b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:35.132438 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1120/2242] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:12:34 2021] DELETE /identity/v3/projects/41d126db1a8845b4987d4b1d5084d094 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:35.139486 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32559d-1569-4e90-a50f-36e11af5ba52 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:35.140012 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32559d-1569-4e90-a50f-36e11af5ba52 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:35.140012 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32559d-1569-4e90-a50f-36e11af5ba52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:35.177525 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-9f32559d-1569-4e90-a50f-36e11af5ba52 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:35.179101 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-9f32559d-1569-4e90-a50f-36e11af5ba52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:35.325506 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1123/2243] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:35.343659 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3fb7d-dea2-47ca-89c4-f768091970cb None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:35.344017 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3fb7d-dea2-47ca-89c4-f768091970cb None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:35.344347 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3fb7d-dea2-47ca-89c4-f768091970cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:35.394462 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-32d3fb7d-dea2-47ca-89c4-f768091970cb None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:35.395688 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-32d3fb7d-dea2-47ca-89c4-f768091970cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:35.431242 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1121/2244] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:35.435135 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32559d-1569-4e90-a50f-36e11af5ba52 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:35.447425 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32559d-1569-4e90-a50f-36e11af5ba52 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:35.457146 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c65a48-a3d0-4baf-b01b-d42e15028810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:35.457834 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c65a48-a3d0-4baf-b01b-d42e15028810 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:35.458116 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c65a48-a3d0-4baf-b01b-d42e15028810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:35.458393 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c65a48-a3d0-4baf-b01b-d42e15028810 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:35.459152 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c65a48-a3d0-4baf-b01b-d42e15028810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:12:35.460446 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c65a48-a3d0-4baf-b01b-d42e15028810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:35.462008 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c65a48-a3d0-4baf-b01b-d42e15028810 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:35.486108 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1124/2245] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:12:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:12:35.486777 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3fb7d-dea2-47ca-89c4-f768091970cb None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:35.496773 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3fb7d-dea2-47ca-89c4-f768091970cb None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:35.502590 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c6529-3007-4423-b4d7-6b63bb54d54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:35.503539 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c6529-3007-4423-b4d7-6b63bb54d54e admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:35.503830 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c6529-3007-4423-b4d7-6b63bb54d54e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:35.504107 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c6529-3007-4423-b4d7-6b63bb54d54e admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:35.504820 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c6529-3007-4423-b4d7-6b63bb54d54e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:35.507200 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c6529-3007-4423-b4d7-6b63bb54d54e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:35.545778 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1122/2246] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:12:35 2021] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:12:35.548594 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c65a48-a3d0-4baf-b01b-d42e15028810 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:35.559875 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c65a48-a3d0-4baf-b01b-d42e15028810 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:35.675299 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3555e-0e16-4093-a999-ee327d9dcedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:35.676076 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3555e-0e16-4093-a999-ee327d9dcedd admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:35.676887 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3555e-0e16-4093-a999-ee327d9dcedd admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:35.677554 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3555e-0e16-4093-a999-ee327d9dcedd admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:35.678365 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3555e-0e16-4093-a999-ee327d9dcedd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:35.682674 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3555e-0e16-4093-a999-ee327d9dcedd admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:35.710707 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1125/2247] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:12:35 2021] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:12:35.715088 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c6529-3007-4423-b4d7-6b63bb54d54e admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:35.726569 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c6529-3007-4423-b4d7-6b63bb54d54e admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:35.731171 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85085b-8e91-4993-9cd7-30b6dd3678b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:35.731817 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85085b-8e91-4993-9cd7-30b6dd3678b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:35.732095 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85085b-8e91-4993-9cd7-30b6dd3678b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:35.732366 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85085b-8e91-4993-9cd7-30b6dd3678b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:35.733094 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85085b-8e91-4993-9cd7-30b6dd3678b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:35.734717 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85085b-8e91-4993-9cd7-30b6dd3678b1 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:35.745237 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1123/2248] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:35 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:35.749369 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3555e-0e16-4093-a999-ee327d9dcedd admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:35.762895 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3555e-0e16-4093-a999-ee327d9dcedd admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:35.767930 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee190b07-46e6-451a-875a-e997c5f1242a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:35.768601 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee190b07-46e6-451a-875a-e997c5f1242a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:35.768881 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee190b07-46e6-451a-875a-e997c5f1242a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:35.769157 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee190b07-46e6-451a-875a-e997c5f1242a admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:35.769948 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee190b07-46e6-451a-875a-e997c5f1242a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:35.771546 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee190b07-46e6-451a-875a-e997c5f1242a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:35.782546 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1126/2249] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:35 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:35.786716 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85085b-8e91-4993-9cd7-30b6dd3678b1 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:35.797159 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85085b-8e91-4993-9cd7-30b6dd3678b1 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:35.801827 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd449d96-aa7c-4e38-a6d6-d32dd17c6fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:35.802690 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd449d96-aa7c-4e38-a6d6-d32dd17c6fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:35.802971 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd449d96-aa7c-4e38-a6d6-d32dd17c6fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:35.803244 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd449d96-aa7c-4e38-a6d6-d32dd17c6fdc admin admin] PATH_INFO: `/v3/projects/3c6659409dc942089e0b4e2013f91b63/users/0bb28138b73d4e92808fb35eb305fb6c/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:35.817252 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd449d96-aa7c-4e38-a6d6-d32dd17c6fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c6659409dc942089e0b4e2013f91b63, user_id=0bb28138b73d4e92808fb35eb305fb6c, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:35.820462 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd449d96-aa7c-4e38-a6d6-d32dd17c6fdc admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:35.832733 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1124/2250] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:12:35 2021] PUT /identity/v3/projects/3c6659409dc942089e0b4e2013f91b63/users/0bb28138b73d4e92808fb35eb305fb6c/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:35.845038 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50108eba-fdbe-4280-b25c-aec6ef5bc2ca None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:35.845428 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50108eba-fdbe-4280-b25c-aec6ef5bc2ca None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:35.846178 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50108eba-fdbe-4280-b25c-aec6ef5bc2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:35.874244 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-50108eba-fdbe-4280-b25c-aec6ef5bc2ca None None] MFA Rules not processed for user `0bb28138b73d4e92808fb35eb305fb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:35.875460 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-50108eba-fdbe-4280-b25c-aec6ef5bc2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:35.943117 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1127/2251] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:35 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:35.948525 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd449d96-aa7c-4e38-a6d6-d32dd17c6fdc admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:36.019851 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd449d96-aa7c-4e38-a6d6-d32dd17c6fdc admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:36.024727 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcf285-789d-4331-9cce-1cbb78868b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:36.025402 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcf285-789d-4331-9cce-1cbb78868b17 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:36.025707 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcf285-789d-4331-9cce-1cbb78868b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:36.025981 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcf285-789d-4331-9cce-1cbb78868b17 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:36.026686 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcf285-789d-4331-9cce-1cbb78868b17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:36.028598 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcf285-789d-4331-9cce-1cbb78868b17 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:36.058980 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1125/2252] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:12:35 2021] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:12:36.062985 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50108eba-fdbe-4280-b25c-aec6ef5bc2ca None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:36.074577 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50108eba-fdbe-4280-b25c-aec6ef5bc2ca None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:36.130033 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488e261-4676-436e-a986-7e43aa885849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:36.130693 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488e261-4676-436e-a986-7e43aa885849 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:36.130977 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488e261-4676-436e-a986-7e43aa885849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:36.131267 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488e261-4676-436e-a986-7e43aa885849 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:36.132789 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488e261-4676-436e-a986-7e43aa885849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:36.134735 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488e261-4676-436e-a986-7e43aa885849 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:36.153512 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1128/2253] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:12:36 2021] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:12:36.157828 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcf285-789d-4331-9cce-1cbb78868b17 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:36.167971 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcf285-789d-4331-9cce-1cbb78868b17 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:36.172582 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088be57-f4ec-4284-a24b-101c951f5287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:36.173264 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088be57-f4ec-4284-a24b-101c951f5287 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:36.173583 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088be57-f4ec-4284-a24b-101c951f5287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:36.173858 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088be57-f4ec-4284-a24b-101c951f5287 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:36.174589 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088be57-f4ec-4284-a24b-101c951f5287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:36.176176 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088be57-f4ec-4284-a24b-101c951f5287 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:36.189727 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1126/2254] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:36 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:36.193888 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488e261-4676-436e-a986-7e43aa885849 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:36.204684 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488e261-4676-436e-a986-7e43aa885849 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:36.209562 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943f64a-8857-4da0-89be-52af6c238c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:36.210493 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943f64a-8857-4da0-89be-52af6c238c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:36.210774 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943f64a-8857-4da0-89be-52af6c238c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:36.211045 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943f64a-8857-4da0-89be-52af6c238c80 admin admin] PATH_INFO: `/v3/projects/5821286a428a4cca951e2b646a9b0a02/users/c093ec42cfc34cb6bb90cd3243edb0ac/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:36.225021 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943f64a-8857-4da0-89be-52af6c238c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5821286a428a4cca951e2b646a9b0a02, user_id=c093ec42cfc34cb6bb90cd3243edb0ac, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:36.227871 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943f64a-8857-4da0-89be-52af6c238c80 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:36.240661 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1129/2255] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:12:36 2021] PUT /identity/v3/projects/5821286a428a4cca951e2b646a9b0a02/users/c093ec42cfc34cb6bb90cd3243edb0ac/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:12:36.245154 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088be57-f4ec-4284-a24b-101c951f5287 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:36.254870 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088be57-f4ec-4284-a24b-101c951f5287 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:36.331182 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef683e-2c3f-4035-abaf-a84c8b402c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:36.331971 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef683e-2c3f-4035-abaf-a84c8b402c72 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:36.332552 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef683e-2c3f-4035-abaf-a84c8b402c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:36.332919 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef683e-2c3f-4035-abaf-a84c8b402c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:36.333748 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef683e-2c3f-4035-abaf-a84c8b402c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:36.336095 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef683e-2c3f-4035-abaf-a84c8b402c72 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:36.350351 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1127/2256] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:36 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:36.354768 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943f64a-8857-4da0-89be-52af6c238c80 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:36.374733 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943f64a-8857-4da0-89be-52af6c238c80 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:36.380127 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff007a6-15d1-46f1-8404-b3c9ad107e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:36.381053 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff007a6-15d1-46f1-8404-b3c9ad107e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:36.381334 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff007a6-15d1-46f1-8404-b3c9ad107e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:36.382193 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff007a6-15d1-46f1-8404-b3c9ad107e94 admin admin] PATH_INFO: `/v3/projects/5821286a428a4cca951e2b646a9b0a02/users/c093ec42cfc34cb6bb90cd3243edb0ac/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:36.384528 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff007a6-15d1-46f1-8404-b3c9ad107e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5821286a428a4cca951e2b646a9b0a02, user_id=c093ec42cfc34cb6bb90cd3243edb0ac, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:36.387299 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff007a6-15d1-46f1-8404-b3c9ad107e94 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:36.400571 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1130/2257] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:12:36 2021] PUT /identity/v3/projects/5821286a428a4cca951e2b646a9b0a02/users/c093ec42cfc34cb6bb90cd3243edb0ac/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:36.411273 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf71d3e-8823-47c7-886b-34f6fc6dab9a None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:36.411656 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf71d3e-8823-47c7-886b-34f6fc6dab9a None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:36.412007 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf71d3e-8823-47c7-886b-34f6fc6dab9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:36.445910 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-6bf71d3e-8823-47c7-886b-34f6fc6dab9a None None] MFA Rules not processed for user `c093ec42cfc34cb6bb90cd3243edb0ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:36.447553 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-6bf71d3e-8823-47c7-886b-34f6fc6dab9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:36.527043 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1128/2258] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:36 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:36.537249 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff007a6-15d1-46f1-8404-b3c9ad107e94 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:36.539112 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-6ff007a6-15d1-46f1-8404-b3c9ad107e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:36.604101 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff007a6-15d1-46f1-8404-b3c9ad107e94 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:36.607774 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ad4e1-a1f4-438e-a6c7-30378b23e23e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:36.608414 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ad4e1-a1f4-438e-a6c7-30378b23e23e service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:36.608695 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ad4e1-a1f4-438e-a6c7-30378b23e23e service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:36.608969 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ad4e1-a1f4-438e-a6c7-30378b23e23e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:36.618041 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ad4e1-a1f4-438e-a6c7-30378b23e23e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:36.619467 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ad4e1-a1f4-438e-a6c7-30378b23e23e service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:36.628902 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1131/2259] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:12:36 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:12:36.998193 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf71d3e-8823-47c7-886b-34f6fc6dab9a None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:37.065037 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf71d3e-8823-47c7-886b-34f6fc6dab9a None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:37.069655 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b594f5d-770a-4370-a4f3-38cc429a7e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:37.070572 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b594f5d-770a-4370-a4f3-38cc429a7e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:37.070853 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b594f5d-770a-4370-a4f3-38cc429a7e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:37.071126 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b594f5d-770a-4370-a4f3-38cc429a7e32 admin admin] PATH_INFO: `/v3/users/0bb28138b73d4e92808fb35eb305fb6c` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:37.072308 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b594f5d-770a-4370-a4f3-38cc429a7e32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bb28138b73d4e92808fb35eb305fb6c)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:37.074264 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b594f5d-770a-4370-a4f3-38cc429a7e32 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:37.117964 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4b594f5d-770a-4370-a4f3-38cc429a7e32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bb28138b73d4e92808fb35eb305fb6c'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:37.118608 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4b594f5d-770a-4370-a4f3-38cc429a7e32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bb28138b73d4e92808fb35eb305fb6c'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:37.125099 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4b594f5d-770a-4370-a4f3-38cc429a7e32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bb28138b73d4e92808fb35eb305fb6c'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:37.125747 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4b594f5d-770a-4370-a4f3-38cc429a7e32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bb28138b73d4e92808fb35eb305fb6c'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:37.139293 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4b594f5d-770a-4370-a4f3-38cc429a7e32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bb28138b73d4e92808fb35eb305fb6c'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:37.154690 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1129/2260] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:12:36 2021] DELETE /identity/v3/users/0bb28138b73d4e92808fb35eb305fb6c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:37.159506 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a85568-8ac7-4723-a7b3-dc1953194633 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:37.159989 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a85568-8ac7-4723-a7b3-dc1953194633 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:37.160092 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a85568-8ac7-4723-a7b3-dc1953194633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:37.177541 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-b8a85568-8ac7-4723-a7b3-dc1953194633 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:37.179388 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-b8a85568-8ac7-4723-a7b3-dc1953194633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:37.238252 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1132/2261] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:37.248397 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b594f5d-770a-4370-a4f3-38cc429a7e32 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:37.249901 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-4b594f5d-770a-4370-a4f3-38cc429a7e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:37.308012 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b594f5d-770a-4370-a4f3-38cc429a7e32 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:37.311701 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375485c-b6af-4704-815c-90dfe6db4b6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:37.312346 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375485c-b6af-4704-815c-90dfe6db4b6d service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:37.312626 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375485c-b6af-4704-815c-90dfe6db4b6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:37.312902 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375485c-b6af-4704-815c-90dfe6db4b6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:37.322990 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375485c-b6af-4704-815c-90dfe6db4b6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:37.324435 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375485c-b6af-4704-815c-90dfe6db4b6d service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:37.334131 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1130/2262] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:12:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:12:37.662149 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a85568-8ac7-4723-a7b3-dc1953194633 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:37.664395 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-b8a85568-8ac7-4723-a7b3-dc1953194633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:37.676154 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a85568-8ac7-4723-a7b3-dc1953194633 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:37.683133 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5384de0-7279-4506-b42a-58ea2b39a9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:37.684121 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5384de0-7279-4506-b42a-58ea2b39a9f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:37.684472 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5384de0-7279-4506-b42a-58ea2b39a9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:37.684849 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5384de0-7279-4506-b42a-58ea2b39a9f7 admin admin] PATH_INFO: `/v3/projects/3c6659409dc942089e0b4e2013f91b63` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:37.686298 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5384de0-7279-4506-b42a-58ea2b39a9f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c6659409dc942089e0b4e2013f91b63)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:37.688348 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5384de0-7279-4506-b42a-58ea2b39a9f7 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:37.749898 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-c5384de0-7279-4506-b42a-58ea2b39a9f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c6659409dc942089e0b4e2013f91b63', 'request_id': 'req-c5384de0-7279-4506-b42a-58ea2b39a9f7'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:37.759735 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-c5384de0-7279-4506-b42a-58ea2b39a9f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c6659409dc942089e0b4e2013f91b63', 'request_id': 'req-c5384de0-7279-4506-b42a-58ea2b39a9f7'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:37.766500 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-c5384de0-7279-4506-b42a-58ea2b39a9f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c6659409dc942089e0b4e2013f91b63', 'request_id': 'req-c5384de0-7279-4506-b42a-58ea2b39a9f7'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:37.778563 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-c5384de0-7279-4506-b42a-58ea2b39a9f7 admin admin] The token cache is being invalidate because project 3c6659409dc942089e0b4e2013f91b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:12:37.778852 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-c5384de0-7279-4506-b42a-58ea2b39a9f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:37.781982 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-c5384de0-7279-4506-b42a-58ea2b39a9f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:37.783824 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1133/2263] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:12:37 2021] DELETE /identity/v3/projects/3c6659409dc942089e0b4e2013f91b63 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:37.787761 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375485c-b6af-4704-815c-90dfe6db4b6d service neutron] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:37.797534 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375485c-b6af-4704-815c-90dfe6db4b6d service neutron] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:37.861471 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de37b7-e74c-476b-b36e-fb0ac2f1bfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:37.862340 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de37b7-e74c-476b-b36e-fb0ac2f1bfa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:37.862623 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de37b7-e74c-476b-b36e-fb0ac2f1bfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:37.862896 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de37b7-e74c-476b-b36e-fb0ac2f1bfa2 admin admin] PATH_INFO: `/v3/users/c093ec42cfc34cb6bb90cd3243edb0ac` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:37.864095 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de37b7-e74c-476b-b36e-fb0ac2f1bfa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c093ec42cfc34cb6bb90cd3243edb0ac)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:37.866154 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de37b7-e74c-476b-b36e-fb0ac2f1bfa2 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:37.915157 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-a3de37b7-e74c-476b-b36e-fb0ac2f1bfa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c093ec42cfc34cb6bb90cd3243edb0ac'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:37.915796 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-a3de37b7-e74c-476b-b36e-fb0ac2f1bfa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c093ec42cfc34cb6bb90cd3243edb0ac'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:37.922606 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-a3de37b7-e74c-476b-b36e-fb0ac2f1bfa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c093ec42cfc34cb6bb90cd3243edb0ac'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:37.923270 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-a3de37b7-e74c-476b-b36e-fb0ac2f1bfa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c093ec42cfc34cb6bb90cd3243edb0ac'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:37.937109 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-a3de37b7-e74c-476b-b36e-fb0ac2f1bfa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c093ec42cfc34cb6bb90cd3243edb0ac'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:37.950281 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1131/2264] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:12:37 2021] DELETE /identity/v3/users/c093ec42cfc34cb6bb90cd3243edb0ac => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:12:38.239197 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5384de0-7279-4506-b42a-58ea2b39a9f7 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:38.240597 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c5384de0-7279-4506-b42a-58ea2b39a9f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:38.255818 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5384de0-7279-4506-b42a-58ea2b39a9f7 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:38.321196 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd3b54-3dbf-48a0-942a-e4a857d5efd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:38.322100 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd3b54-3dbf-48a0-942a-e4a857d5efd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:38.322434 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd3b54-3dbf-48a0-942a-e4a857d5efd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:38.322719 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd3b54-3dbf-48a0-942a-e4a857d5efd4 admin admin] PATH_INFO: `/v3/projects/5821286a428a4cca951e2b646a9b0a02` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:38.324655 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd3b54-3dbf-48a0-942a-e4a857d5efd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5821286a428a4cca951e2b646a9b0a02)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:38.328346 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd3b54-3dbf-48a0-942a-e4a857d5efd4 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:38.403342 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-eadd3b54-3dbf-48a0-942a-e4a857d5efd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5821286a428a4cca951e2b646a9b0a02', 'request_id': 'req-eadd3b54-3dbf-48a0-942a-e4a857d5efd4'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:38.412318 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-eadd3b54-3dbf-48a0-942a-e4a857d5efd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5821286a428a4cca951e2b646a9b0a02', 'request_id': 'req-eadd3b54-3dbf-48a0-942a-e4a857d5efd4'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:38.419886 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-eadd3b54-3dbf-48a0-942a-e4a857d5efd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5821286a428a4cca951e2b646a9b0a02', 'request_id': 'req-eadd3b54-3dbf-48a0-942a-e4a857d5efd4'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:38.442022 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-eadd3b54-3dbf-48a0-942a-e4a857d5efd4 admin admin] The token cache is being invalidate because project 5821286a428a4cca951e2b646a9b0a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:12:38.442022 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-eadd3b54-3dbf-48a0-942a-e4a857d5efd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:38.451547 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-eadd3b54-3dbf-48a0-942a-e4a857d5efd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:38.451547 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1134/2265] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:12:38 2021] DELETE /identity/v3/projects/5821286a428a4cca951e2b646a9b0a02 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:38.451818 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37730b96-08cd-4305-8215-81c1a41aae37 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:38.451818 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37730b96-08cd-4305-8215-81c1a41aae37 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:38.452294 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37730b96-08cd-4305-8215-81c1a41aae37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:38.473350 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-37730b96-08cd-4305-8215-81c1a41aae37 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:38.474592 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-37730b96-08cd-4305-8215-81c1a41aae37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:38.555512 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1132/2266] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:12:38.564742 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a7d1b-e5a0-4f82-a73a-8d589eadd59b None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:38.565022 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a7d1b-e5a0-4f82-a73a-8d589eadd59b None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:38.565298 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a7d1b-e5a0-4f82-a73a-8d589eadd59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:38.584269 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-f38a7d1b-e5a0-4f82-a73a-8d589eadd59b None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:38.586203 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f38a7d1b-e5a0-4f82-a73a-8d589eadd59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:38.595164 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1135/2267] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:38.599592 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37730b96-08cd-4305-8215-81c1a41aae37 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:38.609231 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37730b96-08cd-4305-8215-81c1a41aae37 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:38.614006 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa458eed-d496-4498-9458-421b9ea57803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:38.614759 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa458eed-d496-4498-9458-421b9ea57803 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:38.615039 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa458eed-d496-4498-9458-421b9ea57803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:38.615313 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa458eed-d496-4498-9458-421b9ea57803 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:38.616122 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa458eed-d496-4498-9458-421b9ea57803 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:12:38.616569 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa458eed-d496-4498-9458-421b9ea57803 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:38.618196 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa458eed-d496-4498-9458-421b9ea57803 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:38.634571 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1133/2268] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:12:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:12:38.639452 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a7d1b-e5a0-4f82-a73a-8d589eadd59b None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:38.653747 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a7d1b-e5a0-4f82-a73a-8d589eadd59b None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:38.660569 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d564b-0c4c-49c4-aa57-21897c1fd7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:38.661250 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d564b-0c4c-49c4-aa57-21897c1fd7d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:38.662800 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d564b-0c4c-49c4-aa57-21897c1fd7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:38.662800 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d564b-0c4c-49c4-aa57-21897c1fd7d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:38.662800 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d564b-0c4c-49c4-aa57-21897c1fd7d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:38.665164 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d564b-0c4c-49c4-aa57-21897c1fd7d4 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:38.691413 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1136/2269] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:12:38 2021] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:12:38.696349 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa458eed-d496-4498-9458-421b9ea57803 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:38.706154 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa458eed-d496-4498-9458-421b9ea57803 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:38.770437 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3223f4-08c5-4f8b-ba8f-f3dd462f8af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:38.771207 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3223f4-08c5-4f8b-ba8f-f3dd462f8af1 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:38.771487 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3223f4-08c5-4f8b-ba8f-f3dd462f8af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:38.771760 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3223f4-08c5-4f8b-ba8f-f3dd462f8af1 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:38.773261 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3223f4-08c5-4f8b-ba8f-f3dd462f8af1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:38.775478 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3223f4-08c5-4f8b-ba8f-f3dd462f8af1 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:38.798510 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1134/2270] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:12:38 2021] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:12:38.804488 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d564b-0c4c-49c4-aa57-21897c1fd7d4 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:38.815029 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d564b-0c4c-49c4-aa57-21897c1fd7d4 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:38.820612 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c91165-f683-45da-805e-a7110d92295a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:38.821326 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c91165-f683-45da-805e-a7110d92295a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:38.821667 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c91165-f683-45da-805e-a7110d92295a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:38.821945 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c91165-f683-45da-805e-a7110d92295a admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:38.823145 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c91165-f683-45da-805e-a7110d92295a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:38.824461 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c91165-f683-45da-805e-a7110d92295a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:38.836645 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1137/2271] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:38 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:38.840488 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3223f4-08c5-4f8b-ba8f-f3dd462f8af1 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:38.851375 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3223f4-08c5-4f8b-ba8f-f3dd462f8af1 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:38.860039 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b9f6a-344a-4da9-9d26-892b4f370f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:38.860720 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b9f6a-344a-4da9-9d26-892b4f370f29 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:38.861163 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b9f6a-344a-4da9-9d26-892b4f370f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:38.861427 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b9f6a-344a-4da9-9d26-892b4f370f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:38.862167 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b9f6a-344a-4da9-9d26-892b4f370f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:38.864253 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b9f6a-344a-4da9-9d26-892b4f370f29 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:38.887031 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1135/2272] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:38 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:38.888230 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c91165-f683-45da-805e-a7110d92295a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:38.899118 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c91165-f683-45da-805e-a7110d92295a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:38.904049 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d48c9-6c15-4197-94ac-0a5e4caadc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:38.904945 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d48c9-6c15-4197-94ac-0a5e4caadc64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:38.905226 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d48c9-6c15-4197-94ac-0a5e4caadc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:38.905529 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d48c9-6c15-4197-94ac-0a5e4caadc64 admin admin] PATH_INFO: `/v3/projects/46be4fb2c0a449129eaa80a438912a5d/users/0c5b77b3048d469699c150a063c7d7b8/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:38.933237 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d48c9-6c15-4197-94ac-0a5e4caadc64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46be4fb2c0a449129eaa80a438912a5d, user_id=0c5b77b3048d469699c150a063c7d7b8, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:38.937318 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d48c9-6c15-4197-94ac-0a5e4caadc64 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:38.961012 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1138/2273] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:12:38 2021] PUT /identity/v3/projects/46be4fb2c0a449129eaa80a438912a5d/users/0c5b77b3048d469699c150a063c7d7b8/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:12:38.971182 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db0629-d52d-4ce7-a8c9-d2e07015efa4 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:38.971635 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db0629-d52d-4ce7-a8c9-d2e07015efa4 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:38.971744 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db0629-d52d-4ce7-a8c9-d2e07015efa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:39.002583 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-00db0629-d52d-4ce7-a8c9-d2e07015efa4 None None] MFA Rules not processed for user `0c5b77b3048d469699c150a063c7d7b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:39.003714 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-00db0629-d52d-4ce7-a8c9-d2e07015efa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:39.115184 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1136/2274] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:38 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:39.126506 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d48c9-6c15-4197-94ac-0a5e4caadc64 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:39.128387 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-6e5d48c9-6c15-4197-94ac-0a5e4caadc64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:39.226445 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d48c9-6c15-4197-94ac-0a5e4caadc64 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:39.230484 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcffb8-ed93-485d-8c24-77b59d28035e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:39.231213 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcffb8-ed93-485d-8c24-77b59d28035e service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:39.231566 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcffb8-ed93-485d-8c24-77b59d28035e service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:39.232200 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcffb8-ed93-485d-8c24-77b59d28035e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:39.242882 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffcffb8-ed93-485d-8c24-77b59d28035e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:39.245814 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffcffb8-ed93-485d-8c24-77b59d28035e service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:39.258372 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1139/2275] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:12:39 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:12:45.171868 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db0629-d52d-4ce7-a8c9-d2e07015efa4 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:45.174012 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-00db0629-d52d-4ce7-a8c9-d2e07015efa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:45.244658 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db0629-d52d-4ce7-a8c9-d2e07015efa4 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:45.249339 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411430a-87c5-4d36-b2fd-a454f676e90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:45.250230 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411430a-87c5-4d36-b2fd-a454f676e90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:45.250510 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411430a-87c5-4d36-b2fd-a454f676e90b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:45.250782 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411430a-87c5-4d36-b2fd-a454f676e90b admin admin] PATH_INFO: `/v3/users/54d047591e804fb596b8453d9acbf692` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:45.251989 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411430a-87c5-4d36-b2fd-a454f676e90b admin admin] RBAC: Authorizing `identity:delete_user(user_id=54d047591e804fb596b8453d9acbf692)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:45.253983 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411430a-87c5-4d36-b2fd-a454f676e90b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:45.304559 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-8411430a-87c5-4d36-b2fd-a454f676e90b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54d047591e804fb596b8453d9acbf692'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:45.305316 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-8411430a-87c5-4d36-b2fd-a454f676e90b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54d047591e804fb596b8453d9acbf692'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:45.312338 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-8411430a-87c5-4d36-b2fd-a454f676e90b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54d047591e804fb596b8453d9acbf692'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:45.313825 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-8411430a-87c5-4d36-b2fd-a454f676e90b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54d047591e804fb596b8453d9acbf692'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:45.326868 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-8411430a-87c5-4d36-b2fd-a454f676e90b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54d047591e804fb596b8453d9acbf692'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:45.340826 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1137/2276] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:12:45 2021] DELETE /identity/v3/users/54d047591e804fb596b8453d9acbf692 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:45.345595 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b03d2-6361-47c6-96eb-03465938f9a7 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:45.346061 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b03d2-6361-47c6-96eb-03465938f9a7 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:45.346163 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b03d2-6361-47c6-96eb-03465938f9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:45.366437 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-5a2b03d2-6361-47c6-96eb-03465938f9a7 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:45.367840 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-5a2b03d2-6361-47c6-96eb-03465938f9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:45.427500 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1140/2277] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:45.438052 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411430a-87c5-4d36-b2fd-a454f676e90b admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:45.439710 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-8411430a-87c5-4d36-b2fd-a454f676e90b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:45.498600 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411430a-87c5-4d36-b2fd-a454f676e90b admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:45.502936 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e73c1-fd29-400b-a7d3-557315f8754b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:45.503589 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e73c1-fd29-400b-a7d3-557315f8754b service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:45.503870 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e73c1-fd29-400b-a7d3-557315f8754b service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:45.504148 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e73c1-fd29-400b-a7d3-557315f8754b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:45.514298 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e73c1-fd29-400b-a7d3-557315f8754b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:45.515754 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e73c1-fd29-400b-a7d3-557315f8754b service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:45.525409 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1138/2278] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:12:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:12:45.800665 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b03d2-6361-47c6-96eb-03465938f9a7 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:45.802138 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-5a2b03d2-6361-47c6-96eb-03465938f9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:45.817112 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b03d2-6361-47c6-96eb-03465938f9a7 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:45.824623 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604b698-8bab-4cf4-a61d-0eb466d1c128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:45.826063 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604b698-8bab-4cf4-a61d-0eb466d1c128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:45.826582 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604b698-8bab-4cf4-a61d-0eb466d1c128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:45.828369 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604b698-8bab-4cf4-a61d-0eb466d1c128 admin admin] PATH_INFO: `/v3/projects/c21cd8bed9614523b4d36d5aaa035277` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:45.830998 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604b698-8bab-4cf4-a61d-0eb466d1c128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c21cd8bed9614523b4d36d5aaa035277)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:45.835531 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604b698-8bab-4cf4-a61d-0eb466d1c128 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:45.899718 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-7604b698-8bab-4cf4-a61d-0eb466d1c128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c21cd8bed9614523b4d36d5aaa035277', 'request_id': 'req-7604b698-8bab-4cf4-a61d-0eb466d1c128'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:45.908909 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-7604b698-8bab-4cf4-a61d-0eb466d1c128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c21cd8bed9614523b4d36d5aaa035277', 'request_id': 'req-7604b698-8bab-4cf4-a61d-0eb466d1c128'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:45.915212 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-7604b698-8bab-4cf4-a61d-0eb466d1c128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c21cd8bed9614523b4d36d5aaa035277', 'request_id': 'req-7604b698-8bab-4cf4-a61d-0eb466d1c128'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:45.926714 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-7604b698-8bab-4cf4-a61d-0eb466d1c128 admin admin] The token cache is being invalidate because project c21cd8bed9614523b4d36d5aaa035277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:12:45.927092 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-7604b698-8bab-4cf4-a61d-0eb466d1c128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:45.927749 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-7604b698-8bab-4cf4-a61d-0eb466d1c128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:12:45.929980 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1141/2279] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:12:45 2021] DELETE /identity/v3/projects/c21cd8bed9614523b4d36d5aaa035277 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:12:45.938312 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af454190-2de2-4d00-8fb7-3b5d2fa41291 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:45.938614 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af454190-2de2-4d00-8fb7-3b5d2fa41291 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:45.938889 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af454190-2de2-4d00-8fb7-3b5d2fa41291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:45.957765 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-af454190-2de2-4d00-8fb7-3b5d2fa41291 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:45.959230 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-af454190-2de2-4d00-8fb7-3b5d2fa41291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:46.027318 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1139/2280] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:46.035137 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe458ee-c760-4e76-851f-b957dc2d5565 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:46.035434 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe458ee-c760-4e76-851f-b957dc2d5565 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:46.035721 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe458ee-c760-4e76-851f-b957dc2d5565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:46.057781 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-2fe458ee-c760-4e76-851f-b957dc2d5565 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:46.059013 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-2fe458ee-c760-4e76-851f-b957dc2d5565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:46.067217 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1142/2281] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:46.071763 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af454190-2de2-4d00-8fb7-3b5d2fa41291 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:46.081371 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af454190-2de2-4d00-8fb7-3b5d2fa41291 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:46.090728 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16394136-4177-4265-8a5c-14d198d6bd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:46.091387 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16394136-4177-4265-8a5c-14d198d6bd90 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:46.091942 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16394136-4177-4265-8a5c-14d198d6bd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:46.092222 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16394136-4177-4265-8a5c-14d198d6bd90 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:46.092961 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16394136-4177-4265-8a5c-14d198d6bd90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:12:46.093273 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16394136-4177-4265-8a5c-14d198d6bd90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:46.094927 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16394136-4177-4265-8a5c-14d198d6bd90 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:46.106491 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1140/2282] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:12:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:12:46.110747 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe458ee-c760-4e76-851f-b957dc2d5565 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:46.119838 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe458ee-c760-4e76-851f-b957dc2d5565 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:46.124462 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2fafc-f571-4f7e-b62b-7e1cfdab7fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:46.125093 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2fafc-f571-4f7e-b62b-7e1cfdab7fcb admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:46.125371 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2fafc-f571-4f7e-b62b-7e1cfdab7fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:46.125670 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2fafc-f571-4f7e-b62b-7e1cfdab7fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:46.126376 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2fafc-f571-4f7e-b62b-7e1cfdab7fcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:46.128256 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2fafc-f571-4f7e-b62b-7e1cfdab7fcb admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:46.159100 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1143/2283] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:12:46 2021] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:12:46.160051 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16394136-4177-4265-8a5c-14d198d6bd90 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:46.170104 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16394136-4177-4265-8a5c-14d198d6bd90 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:46.226249 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4985579-9f8d-4315-9936-a47f6c3e2e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:46.227179 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4985579-9f8d-4315-9936-a47f6c3e2e27 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:46.227433 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4985579-9f8d-4315-9936-a47f6c3e2e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:46.227709 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4985579-9f8d-4315-9936-a47f6c3e2e27 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:46.228434 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4985579-9f8d-4315-9936-a47f6c3e2e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:46.230381 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4985579-9f8d-4315-9936-a47f6c3e2e27 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:46.252633 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1141/2284] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:12:46 2021] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:12:46.257148 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2fafc-f571-4f7e-b62b-7e1cfdab7fcb admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:46.267106 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2fafc-f571-4f7e-b62b-7e1cfdab7fcb admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:46.271639 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c30cb-27be-48b6-976f-ca03e533f00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:46.272881 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c30cb-27be-48b6-976f-ca03e533f00c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:46.273168 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c30cb-27be-48b6-976f-ca03e533f00c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:46.273485 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c30cb-27be-48b6-976f-ca03e533f00c admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:46.274214 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c30cb-27be-48b6-976f-ca03e533f00c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:46.275792 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c30cb-27be-48b6-976f-ca03e533f00c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:46.286340 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1144/2285] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:46 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:12:46.290309 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4985579-9f8d-4315-9936-a47f6c3e2e27 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:46.299995 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4985579-9f8d-4315-9936-a47f6c3e2e27 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:46.304599 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1dfe4c-5fb8-4d8f-b5f8-4b838325f8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:46.305249 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dfe4c-5fb8-4d8f-b5f8-4b838325f8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:46.305563 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dfe4c-5fb8-4d8f-b5f8-4b838325f8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:46.305838 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dfe4c-5fb8-4d8f-b5f8-4b838325f8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:46.306574 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1dfe4c-5fb8-4d8f-b5f8-4b838325f8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:46.308161 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1dfe4c-5fb8-4d8f-b5f8-4b838325f8e8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:46.317947 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1142/2286] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:12:46 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:12:46.322496 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c30cb-27be-48b6-976f-ca03e533f00c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:46.332308 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c30cb-27be-48b6-976f-ca03e533f00c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:46.337566 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee2976-beee-4777-9697-72e6215eb866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:46.338433 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee2976-beee-4777-9697-72e6215eb866 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:46.338706 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee2976-beee-4777-9697-72e6215eb866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:46.338981 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee2976-beee-4777-9697-72e6215eb866 admin admin] PATH_INFO: `/v3/projects/f0ffa46c1b774f75ab767150235402af/users/cd4f9ff400fb49bfb064ace98c52b97a/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:46.352906 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee2976-beee-4777-9697-72e6215eb866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ffa46c1b774f75ab767150235402af, user_id=cd4f9ff400fb49bfb064ace98c52b97a, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:46.355545 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee2976-beee-4777-9697-72e6215eb866 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:46.367740 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1145/2287] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:12:46 2021] PUT /identity/v3/projects/f0ffa46c1b774f75ab767150235402af/users/cd4f9ff400fb49bfb064ace98c52b97a/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:12:46.378698 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e3a05-cc22-4c52-9de8-ef5b54b979ec None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:46.378988 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e3a05-cc22-4c52-9de8-ef5b54b979ec None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:46.379266 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e3a05-cc22-4c52-9de8-ef5b54b979ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:46.405407 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-434e3a05-cc22-4c52-9de8-ef5b54b979ec None None] MFA Rules not processed for user `cd4f9ff400fb49bfb064ace98c52b97a`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:12:46.406619 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-434e3a05-cc22-4c52-9de8-ef5b54b979ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:46.468111 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1143/2288] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:12:46 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:12:46.478519 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee2976-beee-4777-9697-72e6215eb866 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:12:46.480230 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-4fee2976-beee-4777-9697-72e6215eb866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:12:46.539762 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee2976-beee-4777-9697-72e6215eb866 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:12:46.543484 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f665cef-409c-4737-a145-a7f2baf75e07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:12:46.544120 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f665cef-409c-4737-a145-a7f2baf75e07 service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:12:46.544406 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f665cef-409c-4737-a145-a7f2baf75e07 service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:12:46.544693 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f665cef-409c-4737-a145-a7f2baf75e07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:12:46.553253 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f665cef-409c-4737-a145-a7f2baf75e07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:12:46.555412 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f665cef-409c-4737-a145-a7f2baf75e07 service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:12:46.564129 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1146/2289] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:12:46 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:13:08.564018 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a195826-363a-4f69-9a90-2b6c717b7ae9 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:08.564570 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a195826-363a-4f69-9a90-2b6c717b7ae9 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:08.564818 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a195826-363a-4f69-9a90-2b6c717b7ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:08.608762 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-4a195826-363a-4f69-9a90-2b6c717b7ae9 None None] MFA Rules not processed for user `b2f47cbf62d44a6ba7e6a6f0f2305630`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:08.610026 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-4a195826-363a-4f69-9a90-2b6c717b7ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:08.690611 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1144/2290] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Dec 15 16:13:08 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:13:08.720466 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f665cef-409c-4737-a145-a7f2baf75e07 service cinder] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:08.721978 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-3f665cef-409c-4737-a145-a7f2baf75e07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:08.796855 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f665cef-409c-4737-a145-a7f2baf75e07 service cinder] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:08.802105 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9bb5f-53ac-4c6f-a804-ba1d1ccc1616 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e3f652f76424e27a1d4329212d9b66d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:08.803082 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9bb5f-53ac-4c6f-a804-ba1d1ccc1616 service swift] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:08.803406 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9bb5f-53ac-4c6f-a804-ba1d1ccc1616 service swift] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:08.803833 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9bb5f-53ac-4c6f-a804-ba1d1ccc1616 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:08.813285 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9bb5f-53ac-4c6f-a804-ba1d1ccc1616 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:08.814973 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9bb5f-53ac-4c6f-a804-ba1d1ccc1616 service swift] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:08.824899 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1147/2291] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Dec 15 16:13:08 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:13:09.004082 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a195826-363a-4f69-9a90-2b6c717b7ae9 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:09.006146 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-4a195826-363a-4f69-9a90-2b6c717b7ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:09.135656 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a195826-363a-4f69-9a90-2b6c717b7ae9 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:09.142525 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399bef4-5d99-4669-b3ef-d94f315b3696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:09.143813 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399bef4-5d99-4669-b3ef-d94f315b3696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:09.144102 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399bef4-5d99-4669-b3ef-d94f315b3696 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:09.144379 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399bef4-5d99-4669-b3ef-d94f315b3696 admin admin] PATH_INFO: `/v3/users/0c5b77b3048d469699c150a063c7d7b8` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:09.145681 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399bef4-5d99-4669-b3ef-d94f315b3696 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c5b77b3048d469699c150a063c7d7b8)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:09.151317 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399bef4-5d99-4669-b3ef-d94f315b3696 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:09.230655 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-e399bef4-5d99-4669-b3ef-d94f315b3696 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c5b77b3048d469699c150a063c7d7b8'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:09.231835 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-e399bef4-5d99-4669-b3ef-d94f315b3696 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c5b77b3048d469699c150a063c7d7b8'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:09.254069 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-e399bef4-5d99-4669-b3ef-d94f315b3696 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c5b77b3048d469699c150a063c7d7b8'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:09.255044 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-e399bef4-5d99-4669-b3ef-d94f315b3696 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c5b77b3048d469699c150a063c7d7b8'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:09.277419 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-e399bef4-5d99-4669-b3ef-d94f315b3696 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c5b77b3048d469699c150a063c7d7b8'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:09.301302 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1145/2292] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:13:09 2021] DELETE /identity/v3/users/0c5b77b3048d469699c150a063c7d7b8 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:13:09.307002 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fa2ac-c983-4d94-8e7b-b56c8516e439 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:09.307557 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fa2ac-c983-4d94-8e7b-b56c8516e439 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:09.308118 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fa2ac-c983-4d94-8e7b-b56c8516e439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:09.341215 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-094fa2ac-c983-4d94-8e7b-b56c8516e439 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:09.343224 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-094fa2ac-c983-4d94-8e7b-b56c8516e439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:09.464806 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1148/2293] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:13:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:13:09.471316 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399bef4-5d99-4669-b3ef-d94f315b3696 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:09.472909 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-e399bef4-5d99-4669-b3ef-d94f315b3696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:09.577248 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399bef4-5d99-4669-b3ef-d94f315b3696 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:09.581280 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c632a-8386-4ee9-8f14-6b6136f08b51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:09.582017 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c632a-8386-4ee9-8f14-6b6136f08b51 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:09.582309 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c632a-8386-4ee9-8f14-6b6136f08b51 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:09.582589 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c632a-8386-4ee9-8f14-6b6136f08b51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:09.596218 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c632a-8386-4ee9-8f14-6b6136f08b51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:09.597761 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c632a-8386-4ee9-8f14-6b6136f08b51 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:09.611536 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1146/2294] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:13:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:13:10.016943 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fa2ac-c983-4d94-8e7b-b56c8516e439 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:10.019218 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-094fa2ac-c983-4d94-8e7b-b56c8516e439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:10.086295 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fa2ac-c983-4d94-8e7b-b56c8516e439 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:10.099498 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495e2bc-3b74-4ee0-99ee-81b560f63a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:10.101362 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495e2bc-3b74-4ee0-99ee-81b560f63a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:10.101918 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495e2bc-3b74-4ee0-99ee-81b560f63a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:10.102746 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495e2bc-3b74-4ee0-99ee-81b560f63a06 admin admin] PATH_INFO: `/v3/projects/46be4fb2c0a449129eaa80a438912a5d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:10.106954 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495e2bc-3b74-4ee0-99ee-81b560f63a06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46be4fb2c0a449129eaa80a438912a5d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:10.110556 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495e2bc-3b74-4ee0-99ee-81b560f63a06 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:10.253134 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-0495e2bc-3b74-4ee0-99ee-81b560f63a06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46be4fb2c0a449129eaa80a438912a5d', 'request_id': 'req-0495e2bc-3b74-4ee0-99ee-81b560f63a06'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:10.274498 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-0495e2bc-3b74-4ee0-99ee-81b560f63a06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46be4fb2c0a449129eaa80a438912a5d', 'request_id': 'req-0495e2bc-3b74-4ee0-99ee-81b560f63a06'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:10.282157 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-0495e2bc-3b74-4ee0-99ee-81b560f63a06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46be4fb2c0a449129eaa80a438912a5d', 'request_id': 'req-0495e2bc-3b74-4ee0-99ee-81b560f63a06'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:10.306805 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-0495e2bc-3b74-4ee0-99ee-81b560f63a06 admin admin] The token cache is being invalidate because project 46be4fb2c0a449129eaa80a438912a5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:13:10.308368 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-0495e2bc-3b74-4ee0-99ee-81b560f63a06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:10.309132 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-0495e2bc-3b74-4ee0-99ee-81b560f63a06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:10.310734 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1149/2295] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:13:10 2021] DELETE /identity/v3/projects/46be4fb2c0a449129eaa80a438912a5d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:13:12.962847 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c632a-8386-4ee9-8f14-6b6136f08b51 service neutron] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:12.964901 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-760c632a-8386-4ee9-8f14-6b6136f08b51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:12.979387 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c632a-8386-4ee9-8f14-6b6136f08b51 service neutron] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:13.052847 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b30c19-c722-4961-a7c4-353092878d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:13.054805 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b30c19-c722-4961-a7c4-353092878d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:13.055287 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b30c19-c722-4961-a7c4-353092878d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:13.055722 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b30c19-c722-4961-a7c4-353092878d08 admin admin] PATH_INFO: `/v3/users/cd4f9ff400fb49bfb064ace98c52b97a` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:13.057624 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b30c19-c722-4961-a7c4-353092878d08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd4f9ff400fb49bfb064ace98c52b97a)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:13.059774 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b30c19-c722-4961-a7c4-353092878d08 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:13.141303 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-46b30c19-c722-4961-a7c4-353092878d08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd4f9ff400fb49bfb064ace98c52b97a'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:13.142455 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-46b30c19-c722-4961-a7c4-353092878d08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd4f9ff400fb49bfb064ace98c52b97a'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:13.153471 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-46b30c19-c722-4961-a7c4-353092878d08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd4f9ff400fb49bfb064ace98c52b97a'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:13.154711 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-46b30c19-c722-4961-a7c4-353092878d08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd4f9ff400fb49bfb064ace98c52b97a'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:13.199075 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-46b30c19-c722-4961-a7c4-353092878d08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd4f9ff400fb49bfb064ace98c52b97a'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:13.226604 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1147/2296] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:13:12 2021] DELETE /identity/v3/users/cd4f9ff400fb49bfb064ace98c52b97a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:13:13.230862 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6e918-46fd-445c-bfac-284bcf251368 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:13.231394 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6e918-46fd-445c-bfac-284bcf251368 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:13.231394 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6e918-46fd-445c-bfac-284bcf251368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:13.260160 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-8ba6e918-46fd-445c-bfac-284bcf251368 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:13.262507 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-8ba6e918-46fd-445c-bfac-284bcf251368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:13.343693 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1150/2297] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:13:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:13:13.354326 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b30c19-c722-4961-a7c4-353092878d08 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:13.356080 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-46b30c19-c722-4961-a7c4-353092878d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:13.424887 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b30c19-c722-4961-a7c4-353092878d08 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:13.429246 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072907a9-f897-438f-a8e3-ceccb7933ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:13.429960 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072907a9-f897-438f-a8e3-ceccb7933ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:13.430225 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072907a9-f897-438f-a8e3-ceccb7933ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:13.430508 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072907a9-f897-438f-a8e3-ceccb7933ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:13.443509 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072907a9-f897-438f-a8e3-ceccb7933ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:13.445043 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072907a9-f897-438f-a8e3-ceccb7933ed7 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:13.458712 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1148/2298] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:13:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:13:13.813212 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6e918-46fd-445c-bfac-284bcf251368 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:13.814692 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-8ba6e918-46fd-445c-bfac-284bcf251368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:13.828247 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6e918-46fd-445c-bfac-284bcf251368 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:13.834076 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2d480-4d08-42f8-87eb-cf2f685908fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:13.835200 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2d480-4d08-42f8-87eb-cf2f685908fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:13.836148 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2d480-4d08-42f8-87eb-cf2f685908fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:13.836564 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2d480-4d08-42f8-87eb-cf2f685908fa admin admin] PATH_INFO: `/v3/projects/f0ffa46c1b774f75ab767150235402af` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:13.838747 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2d480-4d08-42f8-87eb-cf2f685908fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0ffa46c1b774f75ab767150235402af)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:13.841719 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2d480-4d08-42f8-87eb-cf2f685908fa admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:13.902425 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-65e2d480-4d08-42f8-87eb-cf2f685908fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0ffa46c1b774f75ab767150235402af', 'request_id': 'req-65e2d480-4d08-42f8-87eb-cf2f685908fa'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:13.927462 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-65e2d480-4d08-42f8-87eb-cf2f685908fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0ffa46c1b774f75ab767150235402af', 'request_id': 'req-65e2d480-4d08-42f8-87eb-cf2f685908fa'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:13.935495 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-65e2d480-4d08-42f8-87eb-cf2f685908fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0ffa46c1b774f75ab767150235402af', 'request_id': 'req-65e2d480-4d08-42f8-87eb-cf2f685908fa'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:13.949543 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-65e2d480-4d08-42f8-87eb-cf2f685908fa admin admin] The token cache is being invalidate because project f0ffa46c1b774f75ab767150235402af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:13:13.950421 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-65e2d480-4d08-42f8-87eb-cf2f685908fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:13.951322 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-65e2d480-4d08-42f8-87eb-cf2f685908fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:13.953102 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1151/2299] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:13:13 2021] DELETE /identity/v3/projects/f0ffa46c1b774f75ab767150235402af => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:13:13.959358 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1252ff-87cc-4bfb-b088-8ba48ca46b1c None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:13.959806 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1252ff-87cc-4bfb-b088-8ba48ca46b1c None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:13.960403 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1252ff-87cc-4bfb-b088-8ba48ca46b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:13.987310 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-4e1252ff-87cc-4bfb-b088-8ba48ca46b1c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:13.988515 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-4e1252ff-87cc-4bfb-b088-8ba48ca46b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:14.085561 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1149/2300] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:13:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:13:14.087981 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a51bb7-0be6-428e-93e0-df81cd773b20 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:14.088434 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a51bb7-0be6-428e-93e0-df81cd773b20 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:14.088892 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a51bb7-0be6-428e-93e0-df81cd773b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:14.109199 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-13a51bb7-0be6-428e-93e0-df81cd773b20 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:14.110374 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-13a51bb7-0be6-428e-93e0-df81cd773b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:14.122867 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1152/2301] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:13:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:13:14.126850 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1252ff-87cc-4bfb-b088-8ba48ca46b1c None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:14.140306 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1252ff-87cc-4bfb-b088-8ba48ca46b1c None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:14.148974 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7964e34-d614-4cd1-a5be-5e582ed076a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:14.149982 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7964e34-d614-4cd1-a5be-5e582ed076a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:14.150440 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7964e34-d614-4cd1-a5be-5e582ed076a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:14.150886 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7964e34-d614-4cd1-a5be-5e582ed076a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:14.151799 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7964e34-d614-4cd1-a5be-5e582ed076a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:13:14.152274 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7964e34-d614-4cd1-a5be-5e582ed076a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:14.153938 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7964e34-d614-4cd1-a5be-5e582ed076a4 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:14.175673 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1150/2302] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:13:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:13:14.176605 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a51bb7-0be6-428e-93e0-df81cd773b20 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:14.201946 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a51bb7-0be6-428e-93e0-df81cd773b20 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:14.211217 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3fab1-eabb-4957-80f7-c480de49e2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:14.212209 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3fab1-eabb-4957-80f7-c480de49e2ca admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:14.212550 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3fab1-eabb-4957-80f7-c480de49e2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:14.212900 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3fab1-eabb-4957-80f7-c480de49e2ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:14.213828 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3fab1-eabb-4957-80f7-c480de49e2ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:14.216230 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3fab1-eabb-4957-80f7-c480de49e2ca admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:14.271596 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1153/2303] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:13:14 2021] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:13:14.275662 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7964e34-d614-4cd1-a5be-5e582ed076a4 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:14.290645 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7964e34-d614-4cd1-a5be-5e582ed076a4 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:14.361283 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe861882-b712-4fd1-8db2-513fe74fe460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:14.362052 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe861882-b712-4fd1-8db2-513fe74fe460 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:14.362392 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe861882-b712-4fd1-8db2-513fe74fe460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:14.362653 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe861882-b712-4fd1-8db2-513fe74fe460 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:14.363709 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe861882-b712-4fd1-8db2-513fe74fe460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:14.366896 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe861882-b712-4fd1-8db2-513fe74fe460 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:14.409381 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1151/2304] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:13:14 2021] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:13:14.410876 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3fab1-eabb-4957-80f7-c480de49e2ca admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:14.429558 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3fab1-eabb-4957-80f7-c480de49e2ca admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:14.446247 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b93363-99b7-4eca-acca-d58e39d786fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:14.448449 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b93363-99b7-4eca-acca-d58e39d786fd admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:14.449485 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b93363-99b7-4eca-acca-d58e39d786fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:14.450238 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b93363-99b7-4eca-acca-d58e39d786fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:14.452014 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b93363-99b7-4eca-acca-d58e39d786fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:14.461259 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b93363-99b7-4eca-acca-d58e39d786fd admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:14.487960 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1154/2305] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:13:14 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:13:14.492607 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe861882-b712-4fd1-8db2-513fe74fe460 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:14.514636 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe861882-b712-4fd1-8db2-513fe74fe460 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:14.528349 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fbb59-68a6-4fc8-b5c8-743ccf9151af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:14.529024 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fbb59-68a6-4fc8-b5c8-743ccf9151af admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:14.529303 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fbb59-68a6-4fc8-b5c8-743ccf9151af admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:14.529722 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fbb59-68a6-4fc8-b5c8-743ccf9151af admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:14.530676 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045fbb59-68a6-4fc8-b5c8-743ccf9151af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:14.534666 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045fbb59-68a6-4fc8-b5c8-743ccf9151af admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:14.549439 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1152/2306] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:13:14 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:13:14.555945 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b93363-99b7-4eca-acca-d58e39d786fd admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:14.573963 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b93363-99b7-4eca-acca-d58e39d786fd admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:14.583732 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e06031-1f7c-40ac-98ec-f3841f10a243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:14.584896 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e06031-1f7c-40ac-98ec-f3841f10a243 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:14.585712 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e06031-1f7c-40ac-98ec-f3841f10a243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:14.586000 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e06031-1f7c-40ac-98ec-f3841f10a243 admin admin] PATH_INFO: `/v3/projects/86f465191392420cb4359d760957cafa/users/9e4665432f3b42c895c7b3fec4433520/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:14.622157 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e06031-1f7c-40ac-98ec-f3841f10a243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86f465191392420cb4359d760957cafa, user_id=9e4665432f3b42c895c7b3fec4433520, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:14.625068 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e06031-1f7c-40ac-98ec-f3841f10a243 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:14.650518 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1155/2307] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:13:14 2021] PUT /identity/v3/projects/86f465191392420cb4359d760957cafa/users/9e4665432f3b42c895c7b3fec4433520/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:13:14.666418 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cafd9-ba79-4452-9431-5fc78e3143ec None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:14.666711 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cafd9-ba79-4452-9431-5fc78e3143ec None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:14.666991 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cafd9-ba79-4452-9431-5fc78e3143ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:14.727438 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-c10cafd9-ba79-4452-9431-5fc78e3143ec None None] MFA Rules not processed for user `9e4665432f3b42c895c7b3fec4433520`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:14.729850 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-c10cafd9-ba79-4452-9431-5fc78e3143ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:14.851956 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1153/2308] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:13:14 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:13:14.853437 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e06031-1f7c-40ac-98ec-f3841f10a243 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:14.943470 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e06031-1f7c-40ac-98ec-f3841f10a243 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:14.955631 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0608a11-dd54-4243-96f0-615165a88e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:14.957152 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0608a11-dd54-4243-96f0-615165a88e02 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:14.957684 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0608a11-dd54-4243-96f0-615165a88e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:14.958180 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0608a11-dd54-4243-96f0-615165a88e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:14.959991 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0608a11-dd54-4243-96f0-615165a88e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:14.963826 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0608a11-dd54-4243-96f0-615165a88e02 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:15.003706 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1156/2309] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:13:14 2021] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:13:15.005266 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cafd9-ba79-4452-9431-5fc78e3143ec None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:15.017159 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cafd9-ba79-4452-9431-5fc78e3143ec None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:15.095335 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d9a32-2fbd-4295-9228-a64d62aef818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:15.096154 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d9a32-2fbd-4295-9228-a64d62aef818 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:15.096636 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d9a32-2fbd-4295-9228-a64d62aef818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:15.096982 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d9a32-2fbd-4295-9228-a64d62aef818 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:15.097955 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d9a32-2fbd-4295-9228-a64d62aef818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:15.100973 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d9a32-2fbd-4295-9228-a64d62aef818 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:15.127286 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1154/2310] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:13:15 2021] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:13:15.131251 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0608a11-dd54-4243-96f0-615165a88e02 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:15.143102 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0608a11-dd54-4243-96f0-615165a88e02 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:15.152356 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa6dc3-d9cd-482f-9a35-b671b532fe12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:15.156286 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa6dc3-d9cd-482f-9a35-b671b532fe12 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:15.156689 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa6dc3-d9cd-482f-9a35-b671b532fe12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:15.156974 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa6dc3-d9cd-482f-9a35-b671b532fe12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:15.158159 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa6dc3-d9cd-482f-9a35-b671b532fe12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:15.159801 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa6dc3-d9cd-482f-9a35-b671b532fe12 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:15.175465 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1157/2311] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:13:15 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:13:15.179742 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d9a32-2fbd-4295-9228-a64d62aef818 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:15.190749 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d9a32-2fbd-4295-9228-a64d62aef818 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:15.195708 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac68b2-e95d-40ca-9533-3eb7e3552f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:15.196469 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac68b2-e95d-40ca-9533-3eb7e3552f15 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:15.196824 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac68b2-e95d-40ca-9533-3eb7e3552f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:15.197171 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac68b2-e95d-40ca-9533-3eb7e3552f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:15.197955 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac68b2-e95d-40ca-9533-3eb7e3552f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:15.199603 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac68b2-e95d-40ca-9533-3eb7e3552f15 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:15.210780 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1155/2312] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:13:15 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:13:15.215453 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa6dc3-d9cd-482f-9a35-b671b532fe12 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:15.227118 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa6dc3-d9cd-482f-9a35-b671b532fe12 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:15.231923 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049d82b-b8e3-4072-843e-338cb738d557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:15.232812 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049d82b-b8e3-4072-843e-338cb738d557 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:15.233084 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049d82b-b8e3-4072-843e-338cb738d557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:15.233357 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049d82b-b8e3-4072-843e-338cb738d557 admin admin] PATH_INFO: `/v3/projects/e21802687e8744f885d1c0ed18914fa7/users/c03503b8db27436e9acf9fe06d7e40f2/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:15.249862 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049d82b-b8e3-4072-843e-338cb738d557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e21802687e8744f885d1c0ed18914fa7, user_id=c03503b8db27436e9acf9fe06d7e40f2, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:15.252593 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049d82b-b8e3-4072-843e-338cb738d557 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:15.268093 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1158/2313] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:13:15 2021] PUT /identity/v3/projects/e21802687e8744f885d1c0ed18914fa7/users/c03503b8db27436e9acf9fe06d7e40f2/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:13:15.280056 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc1ab8-740a-4c96-b0fd-48809c283da8 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:15.280345 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc1ab8-740a-4c96-b0fd-48809c283da8 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:15.280621 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc1ab8-740a-4c96-b0fd-48809c283da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:15.308988 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-a9fc1ab8-740a-4c96-b0fd-48809c283da8 None None] MFA Rules not processed for user `c03503b8db27436e9acf9fe06d7e40f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:15.310251 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-a9fc1ab8-740a-4c96-b0fd-48809c283da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:15.378605 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1156/2314] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:13:15 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:13:15.383273 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049d82b-b8e3-4072-843e-338cb738d557 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:15.449711 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049d82b-b8e3-4072-843e-338cb738d557 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:15.454658 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c5d6c-6aff-454a-8a07-e5d22335d3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:15.455316 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c5d6c-6aff-454a-8a07-e5d22335d3eb admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:15.455636 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c5d6c-6aff-454a-8a07-e5d22335d3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:15.455910 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c5d6c-6aff-454a-8a07-e5d22335d3eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:15.456618 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c5d6c-6aff-454a-8a07-e5d22335d3eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:15.458586 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c5d6c-6aff-454a-8a07-e5d22335d3eb admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:15.487239 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1159/2315] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:13:15 2021] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:13:15.492032 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc1ab8-740a-4c96-b0fd-48809c283da8 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:15.503746 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc1ab8-740a-4c96-b0fd-48809c283da8 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:15.612619 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbff0d8-91d0-416f-8647-51af8640dfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:15.613310 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbff0d8-91d0-416f-8647-51af8640dfe5 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:15.613822 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbff0d8-91d0-416f-8647-51af8640dfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:15.614111 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbff0d8-91d0-416f-8647-51af8640dfe5 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:15.614831 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbff0d8-91d0-416f-8647-51af8640dfe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:15.617506 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbff0d8-91d0-416f-8647-51af8640dfe5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:15.659775 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1157/2316] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:13:15 2021] POST /identity/v3/users => generated 295 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:13:15.661067 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c5d6c-6aff-454a-8a07-e5d22335d3eb admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:15.684619 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c5d6c-6aff-454a-8a07-e5d22335d3eb admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:15.690613 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96af15-82b7-457c-af0b-8fd93e28b396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:15.691364 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96af15-82b7-457c-af0b-8fd93e28b396 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:15.691729 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96af15-82b7-457c-af0b-8fd93e28b396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:15.692158 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96af15-82b7-457c-af0b-8fd93e28b396 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:15.693163 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96af15-82b7-457c-af0b-8fd93e28b396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:15.695329 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96af15-82b7-457c-af0b-8fd93e28b396 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:15.714836 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1160/2317] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:13:15 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:13:15.716282 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbff0d8-91d0-416f-8647-51af8640dfe5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:15.733829 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbff0d8-91d0-416f-8647-51af8640dfe5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:15.824978 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b215d-8c6b-49b0-93c9-d909f8750402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:15.825722 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b215d-8c6b-49b0-93c9-d909f8750402 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:15.825950 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b215d-8c6b-49b0-93c9-d909f8750402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:15.826232 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b215d-8c6b-49b0-93c9-d909f8750402 admin admin] PATH_INFO: `/v3/projects/b75fbfec3d3746628e13595b070a7677/users/e537007db52f4595bec9239cfeeeff7e/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:15.901108 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b215d-8c6b-49b0-93c9-d909f8750402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75fbfec3d3746628e13595b070a7677, user_id=e537007db52f4595bec9239cfeeeff7e, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:15.915360 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b215d-8c6b-49b0-93c9-d909f8750402 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:16.001599 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1158/2318] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:13:15 2021] PUT /identity/v3/projects/b75fbfec3d3746628e13595b070a7677/users/e537007db52f4595bec9239cfeeeff7e/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:13:16.005748 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96af15-82b7-457c-af0b-8fd93e28b396 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:16.018330 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96af15-82b7-457c-af0b-8fd93e28b396 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:16.106407 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c957b19-e9b5-4832-b874-33262571ac22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:16.107117 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c957b19-e9b5-4832-b874-33262571ac22 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:16.107423 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c957b19-e9b5-4832-b874-33262571ac22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:16.107818 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c957b19-e9b5-4832-b874-33262571ac22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:16.108578 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c957b19-e9b5-4832-b874-33262571ac22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:16.110231 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c957b19-e9b5-4832-b874-33262571ac22 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:16.124823 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1161/2319] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:13:16 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:13:16.126137 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b215d-8c6b-49b0-93c9-d909f8750402 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:16.137374 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b215d-8c6b-49b0-93c9-d909f8750402 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:16.142656 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0efa0-060e-4214-9c19-e984358340b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:16.144604 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0efa0-060e-4214-9c19-e984358340b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:16.144604 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0efa0-060e-4214-9c19-e984358340b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:16.144604 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0efa0-060e-4214-9c19-e984358340b1 admin admin] PATH_INFO: `/v3/projects/b75fbfec3d3746628e13595b070a7677/users/e537007db52f4595bec9239cfeeeff7e/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:16.147318 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0efa0-060e-4214-9c19-e984358340b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75fbfec3d3746628e13595b070a7677, user_id=e537007db52f4595bec9239cfeeeff7e, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:16.150120 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0efa0-060e-4214-9c19-e984358340b1 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:16.177428 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1159/2320] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:13:16 2021] PUT /identity/v3/projects/b75fbfec3d3746628e13595b070a7677/users/e537007db52f4595bec9239cfeeeff7e/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:13:16.186905 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2be932-3e4c-4dc6-af36-82ae8a9a404e None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:16.187195 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2be932-3e4c-4dc6-af36-82ae8a9a404e None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:16.187516 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2be932-3e4c-4dc6-af36-82ae8a9a404e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:16.219544 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-cb2be932-3e4c-4dc6-af36-82ae8a9a404e None None] MFA Rules not processed for user `e537007db52f4595bec9239cfeeeff7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:16.220710 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-cb2be932-3e4c-4dc6-af36-82ae8a9a404e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:16.299973 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1162/2321] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:13:16 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:13:16.311473 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0efa0-060e-4214-9c19-e984358340b1 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:16.313165 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-0ab0efa0-060e-4214-9c19-e984358340b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:16.380146 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0efa0-060e-4214-9c19-e984358340b1 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:16.386773 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f57b1-49a3-4e94-a751-f21b62dda963 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:16.387442 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f57b1-49a3-4e94-a751-f21b62dda963 service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:16.387729 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f57b1-49a3-4e94-a751-f21b62dda963 service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:16.388003 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f57b1-49a3-4e94-a751-f21b62dda963 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:16.450622 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f57b1-49a3-4e94-a751-f21b62dda963 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:16.452062 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f57b1-49a3-4e94-a751-f21b62dda963 service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:16.463382 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1160/2322] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:13:16 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:13:18.044033 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2be932-3e4c-4dc6-af36-82ae8a9a404e None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:18.045806 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-cb2be932-3e4c-4dc6-af36-82ae8a9a404e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:18.068448 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2be932-3e4c-4dc6-af36-82ae8a9a404e None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:18.073663 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c59c6-3fbb-4cf3-b0ba-277546cabfa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:18.074569 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c59c6-3fbb-4cf3-b0ba-277546cabfa8 service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:18.075017 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c59c6-3fbb-4cf3-b0ba-277546cabfa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:18.075446 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c59c6-3fbb-4cf3-b0ba-277546cabfa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:18.176402 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c59c6-3fbb-4cf3-b0ba-277546cabfa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:18.178175 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c59c6-3fbb-4cf3-b0ba-277546cabfa8 service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:18.202091 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1163/2323] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:13:18 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:13:18.601264 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f57b1-49a3-4e94-a751-f21b62dda963 service cinder] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:18.602925 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-d75f57b1-49a3-4e94-a751-f21b62dda963 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:18.682625 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f57b1-49a3-4e94-a751-f21b62dda963 service cinder] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:18.686776 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8aa41f-d86e-43a6-80a9-a0dbb5bad997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:18.687429 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8aa41f-d86e-43a6-80a9-a0dbb5bad997 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:18.687728 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8aa41f-d86e-43a6-80a9-a0dbb5bad997 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:18.687982 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8aa41f-d86e-43a6-80a9-a0dbb5bad997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:18.690540 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-0a8aa41f-d86e-43a6-80a9-a0dbb5bad997 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:18.780419 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8aa41f-d86e-43a6-80a9-a0dbb5bad997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:18.781950 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8aa41f-d86e-43a6-80a9-a0dbb5bad997 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:18.802934 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1161/2324] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:13:18 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:13:19.159458 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c59c6-3fbb-4cf3-b0ba-277546cabfa8 service cinder] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:19.174288 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c59c6-3fbb-4cf3-b0ba-277546cabfa8 service cinder] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:19.180592 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84832507-634c-48c8-b373-6cf34029dace service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:19.181713 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84832507-634c-48c8-b373-6cf34029dace service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:19.182202 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84832507-634c-48c8-b373-6cf34029dace service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:19.182697 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84832507-634c-48c8-b373-6cf34029dace service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:19.200089 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84832507-634c-48c8-b373-6cf34029dace service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:19.202077 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84832507-634c-48c8-b373-6cf34029dace service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:19.215664 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1164/2325] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:13:19 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:13:19.610100 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275cbb9-0515-4bca-9056-2c77e0d59ba4 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:19.614511 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275cbb9-0515-4bca-9056-2c77e0d59ba4 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:19.614870 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275cbb9-0515-4bca-9056-2c77e0d59ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:19.633454 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-c275cbb9-0515-4bca-9056-2c77e0d59ba4 None None] MFA Rules not processed for user `df09b0b78f6646ed8c520c5c46b3eb58`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:19.634688 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-c275cbb9-0515-4bca-9056-2c77e0d59ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:19.741916 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1162/2326] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:13:19 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:13:23.489786 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84832507-634c-48c8-b373-6cf34029dace service cinder] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:23.691077 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84832507-634c-48c8-b373-6cf34029dace service cinder] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:23.697867 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c6df7-2f71-465a-ae20-bed4c775cfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:23.699060 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c6df7-2f71-465a-ae20-bed4c775cfe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:23.699501 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c6df7-2f71-465a-ae20-bed4c775cfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:23.700072 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c6df7-2f71-465a-ae20-bed4c775cfe4 admin admin] PATH_INFO: `/v3/users/9e4665432f3b42c895c7b3fec4433520` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:23.701627 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c6df7-2f71-465a-ae20-bed4c775cfe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e4665432f3b42c895c7b3fec4433520)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:23.704216 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c6df7-2f71-465a-ae20-bed4c775cfe4 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:23.775377 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-152c6df7-2f71-465a-ae20-bed4c775cfe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e4665432f3b42c895c7b3fec4433520'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:23.776301 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-152c6df7-2f71-465a-ae20-bed4c775cfe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e4665432f3b42c895c7b3fec4433520'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:23.777032 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-152c6df7-2f71-465a-ae20-bed4c775cfe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e4665432f3b42c895c7b3fec4433520'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:23.793785 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-152c6df7-2f71-465a-ae20-bed4c775cfe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e4665432f3b42c895c7b3fec4433520'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:23.807601 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-152c6df7-2f71-465a-ae20-bed4c775cfe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e4665432f3b42c895c7b3fec4433520'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:23.828163 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1165/2327] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:13:23 2021] DELETE /identity/v3/users/9e4665432f3b42c895c7b3fec4433520 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:13:23.832474 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb29944-6cd8-4d83-8bbd-3be73c5ccb25 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:23.833467 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb29944-6cd8-4d83-8bbd-3be73c5ccb25 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:23.833786 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb29944-6cd8-4d83-8bbd-3be73c5ccb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:23.878980 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-2cb29944-6cd8-4d83-8bbd-3be73c5ccb25 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:23.880272 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-2cb29944-6cd8-4d83-8bbd-3be73c5ccb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:23.944030 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1163/2328] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:13:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:13:23.951824 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c6df7-2f71-465a-ae20-bed4c775cfe4 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:23.954142 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-152c6df7-2f71-465a-ae20-bed4c775cfe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:24.037669 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c6df7-2f71-465a-ae20-bed4c775cfe4 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:24.041588 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb8b35-cd28-476f-8c3f-39722a553e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:24.042367 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb8b35-cd28-476f-8c3f-39722a553e33 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:24.043361 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb8b35-cd28-476f-8c3f-39722a553e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:24.044172 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb8b35-cd28-476f-8c3f-39722a553e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:24.054385 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb8b35-cd28-476f-8c3f-39722a553e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:24.056560 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb8b35-cd28-476f-8c3f-39722a553e33 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:24.066594 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1166/2329] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:13:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:13:24.467342 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb29944-6cd8-4d83-8bbd-3be73c5ccb25 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:24.469027 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-2cb29944-6cd8-4d83-8bbd-3be73c5ccb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:24.491324 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb29944-6cd8-4d83-8bbd-3be73c5ccb25 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:24.497658 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe2042-44fc-4d40-8739-bbc0d457c1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:24.499138 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe2042-44fc-4d40-8739-bbc0d457c1b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:24.499814 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe2042-44fc-4d40-8739-bbc0d457c1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:24.500380 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe2042-44fc-4d40-8739-bbc0d457c1b7 admin admin] PATH_INFO: `/v3/projects/86f465191392420cb4359d760957cafa` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:24.501595 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe2042-44fc-4d40-8739-bbc0d457c1b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86f465191392420cb4359d760957cafa)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:24.503516 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe2042-44fc-4d40-8739-bbc0d457c1b7 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:24.554924 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-09fe2042-44fc-4d40-8739-bbc0d457c1b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86f465191392420cb4359d760957cafa', 'request_id': 'req-09fe2042-44fc-4d40-8739-bbc0d457c1b7'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:24.562587 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-09fe2042-44fc-4d40-8739-bbc0d457c1b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86f465191392420cb4359d760957cafa', 'request_id': 'req-09fe2042-44fc-4d40-8739-bbc0d457c1b7'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:24.568462 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-09fe2042-44fc-4d40-8739-bbc0d457c1b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86f465191392420cb4359d760957cafa', 'request_id': 'req-09fe2042-44fc-4d40-8739-bbc0d457c1b7'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:24.585342 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-09fe2042-44fc-4d40-8739-bbc0d457c1b7 admin admin] The token cache is being invalidate because project 86f465191392420cb4359d760957cafa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:13:24.585697 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-09fe2042-44fc-4d40-8739-bbc0d457c1b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:24.586364 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-09fe2042-44fc-4d40-8739-bbc0d457c1b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:24.588422 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1164/2330] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:13:24 2021] DELETE /identity/v3/projects/86f465191392420cb4359d760957cafa => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:13:24.592486 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb8b35-cd28-476f-8c3f-39722a553e33 service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:24.602864 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb8b35-cd28-476f-8c3f-39722a553e33 service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:24.658784 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49145e-2160-4886-a320-02bfdded7b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:24.659654 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49145e-2160-4886-a320-02bfdded7b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:24.659937 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49145e-2160-4886-a320-02bfdded7b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:24.660259 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49145e-2160-4886-a320-02bfdded7b00 admin admin] PATH_INFO: `/v3/users/c03503b8db27436e9acf9fe06d7e40f2` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:24.661689 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49145e-2160-4886-a320-02bfdded7b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c03503b8db27436e9acf9fe06d7e40f2)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:24.664478 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49145e-2160-4886-a320-02bfdded7b00 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:24.712235 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-bb49145e-2160-4886-a320-02bfdded7b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c03503b8db27436e9acf9fe06d7e40f2'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:24.713074 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-bb49145e-2160-4886-a320-02bfdded7b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c03503b8db27436e9acf9fe06d7e40f2'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:24.713797 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-bb49145e-2160-4886-a320-02bfdded7b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c03503b8db27436e9acf9fe06d7e40f2'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:24.728194 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-bb49145e-2160-4886-a320-02bfdded7b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c03503b8db27436e9acf9fe06d7e40f2'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:24.739138 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-bb49145e-2160-4886-a320-02bfdded7b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c03503b8db27436e9acf9fe06d7e40f2'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:24.754412 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1167/2331] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:13:24 2021] DELETE /identity/v3/users/c03503b8db27436e9acf9fe06d7e40f2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:13:25.403544 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe2042-44fc-4d40-8739-bbc0d457c1b7 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:25.405113 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-09fe2042-44fc-4d40-8739-bbc0d457c1b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:25.428919 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe2042-44fc-4d40-8739-bbc0d457c1b7 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:25.586451 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fc326-0994-47a4-94b5-a0ac2d9040e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:25.587814 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fc326-0994-47a4-94b5-a0ac2d9040e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:25.588483 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fc326-0994-47a4-94b5-a0ac2d9040e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:25.588968 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fc326-0994-47a4-94b5-a0ac2d9040e0 admin admin] PATH_INFO: `/v3/projects/e21802687e8744f885d1c0ed18914fa7` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:25.590786 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7fc326-0994-47a4-94b5-a0ac2d9040e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e21802687e8744f885d1c0ed18914fa7)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:25.593326 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7fc326-0994-47a4-94b5-a0ac2d9040e0 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:25.677838 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-0e7fc326-0994-47a4-94b5-a0ac2d9040e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e21802687e8744f885d1c0ed18914fa7', 'request_id': 'req-0e7fc326-0994-47a4-94b5-a0ac2d9040e0'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:25.688942 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-0e7fc326-0994-47a4-94b5-a0ac2d9040e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e21802687e8744f885d1c0ed18914fa7', 'request_id': 'req-0e7fc326-0994-47a4-94b5-a0ac2d9040e0'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:25.698205 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-0e7fc326-0994-47a4-94b5-a0ac2d9040e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e21802687e8744f885d1c0ed18914fa7', 'request_id': 'req-0e7fc326-0994-47a4-94b5-a0ac2d9040e0'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:25.712439 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-0e7fc326-0994-47a4-94b5-a0ac2d9040e0 admin admin] The token cache is being invalidate because project e21802687e8744f885d1c0ed18914fa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:13:25.712882 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-0e7fc326-0994-47a4-94b5-a0ac2d9040e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:25.713705 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-0e7fc326-0994-47a4-94b5-a0ac2d9040e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:25.715696 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1165/2332] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:13:25 2021] DELETE /identity/v3/projects/e21802687e8744f885d1c0ed18914fa7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:13:25.719841 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49145e-2160-4886-a320-02bfdded7b00 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:25.722844 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-bb49145e-2160-4886-a320-02bfdded7b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:25.741306 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49145e-2160-4886-a320-02bfdded7b00 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:25.813799 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfa4c1-806b-4fec-8c87-065540f48678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:25.814845 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfa4c1-806b-4fec-8c87-065540f48678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:25.815226 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfa4c1-806b-4fec-8c87-065540f48678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:25.815757 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfa4c1-806b-4fec-8c87-065540f48678 admin admin] PATH_INFO: `/v3/users/e537007db52f4595bec9239cfeeeff7e` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:25.817562 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfa4c1-806b-4fec-8c87-065540f48678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e537007db52f4595bec9239cfeeeff7e)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:25.819566 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfa4c1-806b-4fec-8c87-065540f48678 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:25.870758 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-f5cfa4c1-806b-4fec-8c87-065540f48678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e537007db52f4595bec9239cfeeeff7e'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:25.871429 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-f5cfa4c1-806b-4fec-8c87-065540f48678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e537007db52f4595bec9239cfeeeff7e'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:25.872778 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-f5cfa4c1-806b-4fec-8c87-065540f48678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e537007db52f4595bec9239cfeeeff7e'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:25.885055 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-f5cfa4c1-806b-4fec-8c87-065540f48678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e537007db52f4595bec9239cfeeeff7e'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:25.892433 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-f5cfa4c1-806b-4fec-8c87-065540f48678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e537007db52f4595bec9239cfeeeff7e'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:25.905457 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1168/2333] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:13:25 2021] DELETE /identity/v3/users/e537007db52f4595bec9239cfeeeff7e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:13:26.180695 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fc326-0994-47a4-94b5-a0ac2d9040e0 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:26.182182 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-0e7fc326-0994-47a4-94b5-a0ac2d9040e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:26.197541 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fc326-0994-47a4-94b5-a0ac2d9040e0 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:26.261862 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd7aff-e973-4611-8021-356a48817200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:26.262727 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd7aff-e973-4611-8021-356a48817200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:26.263007 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd7aff-e973-4611-8021-356a48817200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:26.263282 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd7aff-e973-4611-8021-356a48817200 admin admin] PATH_INFO: `/v3/projects/b75fbfec3d3746628e13595b070a7677` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:26.264490 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd7aff-e973-4611-8021-356a48817200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b75fbfec3d3746628e13595b070a7677)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:26.266413 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd7aff-e973-4611-8021-356a48817200 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:26.313400 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-e9bd7aff-e973-4611-8021-356a48817200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b75fbfec3d3746628e13595b070a7677', 'request_id': 'req-e9bd7aff-e973-4611-8021-356a48817200'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:26.321125 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-e9bd7aff-e973-4611-8021-356a48817200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b75fbfec3d3746628e13595b070a7677', 'request_id': 'req-e9bd7aff-e973-4611-8021-356a48817200'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:26.326831 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-e9bd7aff-e973-4611-8021-356a48817200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b75fbfec3d3746628e13595b070a7677', 'request_id': 'req-e9bd7aff-e973-4611-8021-356a48817200'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:26.337782 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-e9bd7aff-e973-4611-8021-356a48817200 admin admin] The token cache is being invalidate because project b75fbfec3d3746628e13595b070a7677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:13:26.338187 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-e9bd7aff-e973-4611-8021-356a48817200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:26.338851 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-e9bd7aff-e973-4611-8021-356a48817200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:13:26.340364 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1166/2334] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:13:26 2021] DELETE /identity/v3/projects/b75fbfec3d3746628e13595b070a7677 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:13:26.892385 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfa4c1-806b-4fec-8c87-065540f48678 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:26.896346 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f5cfa4c1-806b-4fec-8c87-065540f48678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:26.997535 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfa4c1-806b-4fec-8c87-065540f48678 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:27.056885 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb180715-06f6-4154-8e2c-2bd5e74effcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:27.057591 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb180715-06f6-4154-8e2c-2bd5e74effcc service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:27.057878 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb180715-06f6-4154-8e2c-2bd5e74effcc service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:27.058154 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb180715-06f6-4154-8e2c-2bd5e74effcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:27.060002 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-cb180715-06f6-4154-8e2c-2bd5e74effcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:27.122725 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb180715-06f6-4154-8e2c-2bd5e74effcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:27.124138 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb180715-06f6-4154-8e2c-2bd5e74effcc service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:27.134567 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1169/2335] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:13:26 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:13:28.206548 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9ed56-ba33-4218-9082-0394a87a2c02 None None] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:28.206548 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9ed56-ba33-4218-9082-0394a87a2c02 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:28.206548 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9ed56-ba33-4218-9082-0394a87a2c02 None None] PATH_INFO: `/` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:28.206548 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1167/2336] 10.222.0.36 () {54 vars in 921 bytes} [Wed Dec 15 16:13:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 16:13:28.212369 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbc583-96f6-498d-85e0-ccd5caebd64c None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:28.212887 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbc583-96f6-498d-85e0-ccd5caebd64c None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:28.213093 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbc583-96f6-498d-85e0-ccd5caebd64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:28.235017 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-d2bbc583-96f6-498d-85e0-ccd5caebd64c None None] MFA Rules not processed for user `bc13934328e742f9a1a85d1c84ab83dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:28.236423 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-d2bbc583-96f6-498d-85e0-ccd5caebd64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:28.306616 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1170/2337] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Dec 15 16:13:28 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:13:28.320555 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9ed56-ba33-4218-9082-0394a87a2c02 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:28.322418 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-2ed9ed56-ba33-4218-9082-0394a87a2c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:28.387494 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9ed56-ba33-4218-9082-0394a87a2c02 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:28.391755 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1178688-32c3-4226-a227-bf6431032177 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9072bd35fdf046669c196133f485d334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:28.392544 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1178688-32c3-4226-a227-bf6431032177 service glance] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:28.392889 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1178688-32c3-4226-a227-bf6431032177 service glance] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:28.393229 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1178688-32c3-4226-a227-bf6431032177 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:28.404379 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1178688-32c3-4226-a227-bf6431032177 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:28.406015 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1178688-32c3-4226-a227-bf6431032177 service glance] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:28.419121 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1168/2338] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:13:28 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:13:28.501051 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82849ce-44a5-4a3f-a343-997208b1f7f0 None None] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:28.501337 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82849ce-44a5-4a3f-a343-997208b1f7f0 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:28.501646 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82849ce-44a5-4a3f-a343-997208b1f7f0 None None] PATH_INFO: `/` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:28.503435 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1171/2339] 10.222.0.36 () {54 vars in 921 bytes} [Wed Dec 15 16:13:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 16:13:28.509751 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9c6e9-e89f-4fb6-aa58-9ae82e3e1105 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:28.510140 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9c6e9-e89f-4fb6-aa58-9ae82e3e1105 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:28.510490 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9c6e9-e89f-4fb6-aa58-9ae82e3e1105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:28.528711 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-10b9c6e9-e89f-4fb6-aa58-9ae82e3e1105 None None] MFA Rules not processed for user `f2f08f47d4e6442a92901fb7d8bed0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:28.530004 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-10b9c6e9-e89f-4fb6-aa58-9ae82e3e1105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:28.536870 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1169/2340] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Dec 15 16:13:28 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:13:28.549796 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82849ce-44a5-4a3f-a343-997208b1f7f0 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:28.552856 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-b82849ce-44a5-4a3f-a343-997208b1f7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:28.569665 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82849ce-44a5-4a3f-a343-997208b1f7f0 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:28.573798 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601555a-8df0-4900-bbd6-603d5caee99b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:28.574626 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601555a-8df0-4900-bbd6-603d5caee99b service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:28.574903 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601555a-8df0-4900-bbd6-603d5caee99b service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:28.575172 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601555a-8df0-4900-bbd6-603d5caee99b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:28.582278 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601555a-8df0-4900-bbd6-603d5caee99b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:28.583849 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601555a-8df0-4900-bbd6-603d5caee99b service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:28.592165 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1172/2341] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:13:28 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:13:31.566732 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea6140-2bcf-4493-90f6-4c9a4a694387 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:31.567234 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea6140-2bcf-4493-90f6-4c9a4a694387 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:31.567340 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea6140-2bcf-4493-90f6-4c9a4a694387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:31.587245 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-feea6140-2bcf-4493-90f6-4c9a4a694387 None None] MFA Rules not processed for user `b2f47cbf62d44a6ba7e6a6f0f2305630`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:13:31.588457 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-feea6140-2bcf-4493-90f6-4c9a4a694387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:31.644722 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1170/2342] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Dec 15 16:13:31 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:13:31.658282 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601555a-8df0-4900-bbd6-603d5caee99b service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:31.659672 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-5601555a-8df0-4900-bbd6-603d5caee99b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:31.734001 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601555a-8df0-4900-bbd6-603d5caee99b service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:31.738994 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ced4b-c796-4cb0-98a5-db792c8f9311 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e3f652f76424e27a1d4329212d9b66d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:31.739637 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ced4b-c796-4cb0-98a5-db792c8f9311 service swift] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:31.739922 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ced4b-c796-4cb0-98a5-db792c8f9311 service swift] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:31.740204 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ced4b-c796-4cb0-98a5-db792c8f9311 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:31.749130 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ced4b-c796-4cb0-98a5-db792c8f9311 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:31.750742 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ced4b-c796-4cb0-98a5-db792c8f9311 service swift] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:31.759398 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1173/2343] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Dec 15 16:13:31 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:13:50.076334 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea6140-2bcf-4493-90f6-4c9a4a694387 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:13:50.077781 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-feea6140-2bcf-4493-90f6-4c9a4a694387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:50.165085 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea6140-2bcf-4493-90f6-4c9a4a694387 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:13:50.170442 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2a9aa-06df-42d4-a34f-c3ef465189fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e186d6728a2341399252238c559002f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:13:50.171098 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2a9aa-06df-42d4-a34f-c3ef465189fd service placement] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:13:50.171378 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2a9aa-06df-42d4-a34f-c3ef465189fd service placement] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:13:50.171652 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2a9aa-06df-42d4-a34f-c3ef465189fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:13:50.173696 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-3ca2a9aa-06df-42d4-a34f-c3ef465189fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:13:50.185695 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2a9aa-06df-42d4-a34f-c3ef465189fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:13:50.187287 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2a9aa-06df-42d4-a34f-c3ef465189fd service placement] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:13:50.197716 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1171/2344] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:13:50 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:01.864691 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57eb85e-1732-4651-8ec7-6feb22f1fe6f None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:01.865244 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57eb85e-1732-4651-8ec7-6feb22f1fe6f None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:01.865244 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57eb85e-1732-4651-8ec7-6feb22f1fe6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:01.894194 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-c57eb85e-1732-4651-8ec7-6feb22f1fe6f None None] MFA Rules not processed for user `b2f47cbf62d44a6ba7e6a6f0f2305630`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:01.895425 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c57eb85e-1732-4651-8ec7-6feb22f1fe6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:01.909749 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1174/2345] 10.222.0.36 () {58 vars in 967 bytes} [Wed Dec 15 16:14:01 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:01.923318 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2a9aa-06df-42d4-a34f-c3ef465189fd service placement] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:01.935770 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2a9aa-06df-42d4-a34f-c3ef465189fd service placement] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:01.941589 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d5c7a-ee87-4a95-ad57-f9609776900b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e3f652f76424e27a1d4329212d9b66d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:01.942296 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d5c7a-ee87-4a95-ad57-f9609776900b service swift] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:01.942684 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d5c7a-ee87-4a95-ad57-f9609776900b service swift] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:01.943026 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d5c7a-ee87-4a95-ad57-f9609776900b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:01.953072 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d5c7a-ee87-4a95-ad57-f9609776900b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:01.954686 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d5c7a-ee87-4a95-ad57-f9609776900b service swift] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:01.962644 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1172/2346] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Dec 15 16:14:01 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:14:23.096240 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57eb85e-1732-4651-8ec7-6feb22f1fe6f None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:23.097815 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c57eb85e-1732-4651-8ec7-6feb22f1fe6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:23.167768 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57eb85e-1732-4651-8ec7-6feb22f1fe6f None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:23.172969 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b935024-0ff3-48ce-96c8-43af1b1a7035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:23.173879 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b935024-0ff3-48ce-96c8-43af1b1a7035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:23.174164 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b935024-0ff3-48ce-96c8-43af1b1a7035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:23.174442 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b935024-0ff3-48ce-96c8-43af1b1a7035 admin admin] PATH_INFO: `/v3/users/df09b0b78f6646ed8c520c5c46b3eb58` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:23.175657 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b935024-0ff3-48ce-96c8-43af1b1a7035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df09b0b78f6646ed8c520c5c46b3eb58)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:23.177612 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b935024-0ff3-48ce-96c8-43af1b1a7035 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:23.221404 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2b935024-0ff3-48ce-96c8-43af1b1a7035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df09b0b78f6646ed8c520c5c46b3eb58'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:23.222060 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2b935024-0ff3-48ce-96c8-43af1b1a7035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df09b0b78f6646ed8c520c5c46b3eb58'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:23.222654 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2b935024-0ff3-48ce-96c8-43af1b1a7035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df09b0b78f6646ed8c520c5c46b3eb58'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:23.234265 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2b935024-0ff3-48ce-96c8-43af1b1a7035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df09b0b78f6646ed8c520c5c46b3eb58'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:23.241918 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2b935024-0ff3-48ce-96c8-43af1b1a7035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df09b0b78f6646ed8c520c5c46b3eb58'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:23.254362 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1175/2347] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:14:23 2021] DELETE /identity/v3/users/df09b0b78f6646ed8c520c5c46b3eb58 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:23.427211 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d5c7a-ee87-4a95-ad57-f9609776900b service swift] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:23.437975 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d5c7a-ee87-4a95-ad57-f9609776900b service swift] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:23.496481 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05f1e7-6ed2-46fa-9d01-b9f17de9e23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:23.497336 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05f1e7-6ed2-46fa-9d01-b9f17de9e23e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:23.497651 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05f1e7-6ed2-46fa-9d01-b9f17de9e23e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:23.497930 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05f1e7-6ed2-46fa-9d01-b9f17de9e23e admin admin] PATH_INFO: `/v3/projects/59432b92e45948e5962f7a60e09135b3` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:23.499133 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05f1e7-6ed2-46fa-9d01-b9f17de9e23e admin admin] RBAC: Authorizing `identity:delete_project(project_id=59432b92e45948e5962f7a60e09135b3)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:23.501157 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05f1e7-6ed2-46fa-9d01-b9f17de9e23e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:23.552414 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-be05f1e7-6ed2-46fa-9d01-b9f17de9e23e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59432b92e45948e5962f7a60e09135b3', 'request_id': 'req-be05f1e7-6ed2-46fa-9d01-b9f17de9e23e'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:23.559248 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-be05f1e7-6ed2-46fa-9d01-b9f17de9e23e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59432b92e45948e5962f7a60e09135b3', 'request_id': 'req-be05f1e7-6ed2-46fa-9d01-b9f17de9e23e'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:23.564517 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-be05f1e7-6ed2-46fa-9d01-b9f17de9e23e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59432b92e45948e5962f7a60e09135b3', 'request_id': 'req-be05f1e7-6ed2-46fa-9d01-b9f17de9e23e'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:23.575808 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-be05f1e7-6ed2-46fa-9d01-b9f17de9e23e admin admin] The token cache is being invalidate because project 59432b92e45948e5962f7a60e09135b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:14:23.576155 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-be05f1e7-6ed2-46fa-9d01-b9f17de9e23e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:23.576812 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-be05f1e7-6ed2-46fa-9d01-b9f17de9e23e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:23.578523 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1173/2348] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:14:23 2021] DELETE /identity/v3/projects/59432b92e45948e5962f7a60e09135b3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:23.584297 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f1bde-c92f-4dfd-aea3-9f72b524f77c None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:23.585210 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f1bde-c92f-4dfd-aea3-9f72b524f77c None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:23.585517 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f1bde-c92f-4dfd-aea3-9f72b524f77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:23.641151 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-e90f1bde-c92f-4dfd-aea3-9f72b524f77c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:23.642446 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-e90f1bde-c92f-4dfd-aea3-9f72b524f77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:23.701288 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1176/2349] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:23.709152 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b983a-9572-454a-99d7-695210092141 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:23.709982 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b983a-9572-454a-99d7-695210092141 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:23.710359 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b983a-9572-454a-99d7-695210092141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:23.728813 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-015b983a-9572-454a-99d7-695210092141 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:23.730131 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-015b983a-9572-454a-99d7-695210092141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:23.738872 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1174/2350] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:23.743543 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f1bde-c92f-4dfd-aea3-9f72b524f77c None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:23.753441 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f1bde-c92f-4dfd-aea3-9f72b524f77c None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:23.758972 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef648f6-a773-4104-b419-6feef8232bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:23.759621 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef648f6-a773-4104-b419-6feef8232bcb admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:23.759900 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef648f6-a773-4104-b419-6feef8232bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:23.760170 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef648f6-a773-4104-b419-6feef8232bcb admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:23.760905 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef648f6-a773-4104-b419-6feef8232bcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:14:23.761207 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef648f6-a773-4104-b419-6feef8232bcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:23.762819 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef648f6-a773-4104-b419-6feef8232bcb admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:23.777772 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1177/2351] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:14:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:14:23.778919 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b983a-9572-454a-99d7-695210092141 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:23.788512 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b983a-9572-454a-99d7-695210092141 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:23.793123 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d53d1-57e4-48c9-8bde-33f2c8029413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:23.793806 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d53d1-57e4-48c9-8bde-33f2c8029413 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:23.794086 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d53d1-57e4-48c9-8bde-33f2c8029413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:23.794359 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d53d1-57e4-48c9-8bde-33f2c8029413 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:23.795076 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d53d1-57e4-48c9-8bde-33f2c8029413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:23.796960 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d53d1-57e4-48c9-8bde-33f2c8029413 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:23.823576 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1175/2352] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:14:23 2021] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:14:23.827608 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef648f6-a773-4104-b419-6feef8232bcb admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:23.837671 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef648f6-a773-4104-b419-6feef8232bcb admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:23.893858 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d677fd-b22f-4fff-a758-ca0076b06174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:23.894555 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d677fd-b22f-4fff-a758-ca0076b06174 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:23.894866 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d677fd-b22f-4fff-a758-ca0076b06174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:23.895143 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d677fd-b22f-4fff-a758-ca0076b06174 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:23.895885 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d677fd-b22f-4fff-a758-ca0076b06174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:23.898756 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d677fd-b22f-4fff-a758-ca0076b06174 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:23.918590 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1178/2353] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:14:23 2021] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:14:23.922667 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d53d1-57e4-48c9-8bde-33f2c8029413 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:23.933766 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d53d1-57e4-48c9-8bde-33f2c8029413 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:23.938366 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea1931-c71a-40a4-a89a-0bab04a08564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:23.939011 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea1931-c71a-40a4-a89a-0bab04a08564 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:23.939291 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea1931-c71a-40a4-a89a-0bab04a08564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:23.939561 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea1931-c71a-40a4-a89a-0bab04a08564 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:23.940287 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea1931-c71a-40a4-a89a-0bab04a08564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:23.941918 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea1931-c71a-40a4-a89a-0bab04a08564 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:23.953339 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1176/2354] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:23 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:14:23.957248 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d677fd-b22f-4fff-a758-ca0076b06174 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:23.967922 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d677fd-b22f-4fff-a758-ca0076b06174 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:23.972771 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0bc43-7738-4972-9e24-fbb5145679e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:23.973431 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0bc43-7738-4972-9e24-fbb5145679e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:23.973715 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0bc43-7738-4972-9e24-fbb5145679e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:23.973986 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0bc43-7738-4972-9e24-fbb5145679e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:23.974709 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0bc43-7738-4972-9e24-fbb5145679e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:23.976821 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0bc43-7738-4972-9e24-fbb5145679e1 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:23.986647 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1179/2355] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:23 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:14:23.991530 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea1931-c71a-40a4-a89a-0bab04a08564 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:24.001285 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea1931-c71a-40a4-a89a-0bab04a08564 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:24.005862 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36140d9d-b6a8-4347-9986-805c08c67e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:24.006957 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36140d9d-b6a8-4347-9986-805c08c67e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:24.007238 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36140d9d-b6a8-4347-9986-805c08c67e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:24.007520 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36140d9d-b6a8-4347-9986-805c08c67e12 admin admin] PATH_INFO: `/v3/projects/9b6d7c89937e4ee6a047db03e8f5b56b/users/60c58b7e0133457d9d05f45bc123a22d/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:24.021328 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36140d9d-b6a8-4347-9986-805c08c67e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b6d7c89937e4ee6a047db03e8f5b56b, user_id=60c58b7e0133457d9d05f45bc123a22d, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:24.024007 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36140d9d-b6a8-4347-9986-805c08c67e12 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:24.036691 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1177/2356] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:14:23 2021] PUT /identity/v3/projects/9b6d7c89937e4ee6a047db03e8f5b56b/users/60c58b7e0133457d9d05f45bc123a22d/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:24.048216 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea565bf-d20b-4119-b57d-7db478be615a None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:24.048506 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea565bf-d20b-4119-b57d-7db478be615a None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:24.048779 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea565bf-d20b-4119-b57d-7db478be615a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:24.075440 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-9ea565bf-d20b-4119-b57d-7db478be615a None None] MFA Rules not processed for user `60c58b7e0133457d9d05f45bc123a22d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:24.077053 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-9ea565bf-d20b-4119-b57d-7db478be615a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:24.139244 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1180/2357] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:24 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:14:24.143739 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36140d9d-b6a8-4347-9986-805c08c67e12 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:24.202141 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36140d9d-b6a8-4347-9986-805c08c67e12 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:24.206778 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33c712-3529-4ce1-910c-9d6d01e8785d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:24.207363 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33c712-3529-4ce1-910c-9d6d01e8785d admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:24.207643 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33c712-3529-4ce1-910c-9d6d01e8785d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:24.207913 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33c712-3529-4ce1-910c-9d6d01e8785d admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:24.208598 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33c712-3529-4ce1-910c-9d6d01e8785d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:24.211116 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33c712-3529-4ce1-910c-9d6d01e8785d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:24.236191 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1178/2358] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:14:24 2021] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:14:24.240441 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea565bf-d20b-4119-b57d-7db478be615a None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:24.252177 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea565bf-d20b-4119-b57d-7db478be615a None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:24.306656 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e553c-a961-4517-a701-c74246a1f6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:24.307314 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e553c-a961-4517-a701-c74246a1f6a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:24.307596 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e553c-a961-4517-a701-c74246a1f6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:24.307869 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e553c-a961-4517-a701-c74246a1f6a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:24.308575 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e553c-a961-4517-a701-c74246a1f6a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:24.310506 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e553c-a961-4517-a701-c74246a1f6a8 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:24.329535 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1181/2359] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:14:24 2021] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:14:24.333212 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33c712-3529-4ce1-910c-9d6d01e8785d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:24.343708 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33c712-3529-4ce1-910c-9d6d01e8785d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:24.348572 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944f20b-ed05-4359-9d34-715c49857957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:24.349220 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944f20b-ed05-4359-9d34-715c49857957 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:24.349524 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944f20b-ed05-4359-9d34-715c49857957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:24.349800 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944f20b-ed05-4359-9d34-715c49857957 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:24.351309 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944f20b-ed05-4359-9d34-715c49857957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:24.352913 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944f20b-ed05-4359-9d34-715c49857957 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:24.363085 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1179/2360] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:24 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:14:24.367196 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e553c-a961-4517-a701-c74246a1f6a8 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:24.376741 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e553c-a961-4517-a701-c74246a1f6a8 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:24.381318 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d0009-5e81-48b7-89c9-e4d4e6d97b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:24.382215 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d0009-5e81-48b7-89c9-e4d4e6d97b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:24.382490 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d0009-5e81-48b7-89c9-e4d4e6d97b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:24.382759 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d0009-5e81-48b7-89c9-e4d4e6d97b34 admin admin] PATH_INFO: `/v3/projects/87ac11951bfd45318549bdec6625db78/users/dd7175e7979d42cba4091e2a79ea4b3f/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:24.396491 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d0009-5e81-48b7-89c9-e4d4e6d97b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ac11951bfd45318549bdec6625db78, user_id=dd7175e7979d42cba4091e2a79ea4b3f, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:24.399785 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d0009-5e81-48b7-89c9-e4d4e6d97b34 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:24.413277 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1182/2361] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:14:24 2021] PUT /identity/v3/projects/87ac11951bfd45318549bdec6625db78/users/dd7175e7979d42cba4091e2a79ea4b3f/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:24.417112 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944f20b-ed05-4359-9d34-715c49857957 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:24.426980 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944f20b-ed05-4359-9d34-715c49857957 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:24.483301 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7ea8e-21a3-4cae-840d-65c04434286a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:24.483953 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7ea8e-21a3-4cae-840d-65c04434286a admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:24.484145 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7ea8e-21a3-4cae-840d-65c04434286a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:24.484417 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7ea8e-21a3-4cae-840d-65c04434286a admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:24.485143 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c7ea8e-21a3-4cae-840d-65c04434286a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:24.486785 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c7ea8e-21a3-4cae-840d-65c04434286a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:24.496250 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1180/2362] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:24 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:14:24.500459 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d0009-5e81-48b7-89c9-e4d4e6d97b34 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:24.510527 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d0009-5e81-48b7-89c9-e4d4e6d97b34 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:24.515072 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dce5bc-288d-4825-b2af-0caf41f36073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:24.515925 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dce5bc-288d-4825-b2af-0caf41f36073 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:24.516202 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dce5bc-288d-4825-b2af-0caf41f36073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:24.516477 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dce5bc-288d-4825-b2af-0caf41f36073 admin admin] PATH_INFO: `/v3/projects/87ac11951bfd45318549bdec6625db78/users/dd7175e7979d42cba4091e2a79ea4b3f/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:24.518495 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dce5bc-288d-4825-b2af-0caf41f36073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ac11951bfd45318549bdec6625db78, user_id=dd7175e7979d42cba4091e2a79ea4b3f, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:24.521100 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dce5bc-288d-4825-b2af-0caf41f36073 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:24.531804 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1183/2363] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:14:24 2021] PUT /identity/v3/projects/87ac11951bfd45318549bdec6625db78/users/dd7175e7979d42cba4091e2a79ea4b3f/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:24.542656 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78664258-811e-4dd0-82b9-8c5195297189 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:24.542947 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78664258-811e-4dd0-82b9-8c5195297189 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:24.543221 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78664258-811e-4dd0-82b9-8c5195297189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:24.570825 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-78664258-811e-4dd0-82b9-8c5195297189 None None] MFA Rules not processed for user `dd7175e7979d42cba4091e2a79ea4b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:24.572076 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-78664258-811e-4dd0-82b9-8c5195297189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:24.639083 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1181/2364] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:24 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:24.650238 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dce5bc-288d-4825-b2af-0caf41f36073 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:24.651991 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-a0dce5bc-288d-4825-b2af-0caf41f36073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:24.731349 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dce5bc-288d-4825-b2af-0caf41f36073 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:24.735166 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b130d-29ae-4020-a016-baa61a81a39b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:24.735742 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b130d-29ae-4020-a016-baa61a81a39b service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:24.736023 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b130d-29ae-4020-a016-baa61a81a39b service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:24.736295 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b130d-29ae-4020-a016-baa61a81a39b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:24.746130 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b130d-29ae-4020-a016-baa61a81a39b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:24.747711 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b130d-29ae-4020-a016-baa61a81a39b service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:24.757951 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1184/2365] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:24 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:25.028382 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78664258-811e-4dd0-82b9-8c5195297189 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:25.089923 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78664258-811e-4dd0-82b9-8c5195297189 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:25.094362 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69312831-7a50-4f45-9922-12911363aad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:25.095213 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69312831-7a50-4f45-9922-12911363aad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:25.095490 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69312831-7a50-4f45-9922-12911363aad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:25.095758 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69312831-7a50-4f45-9922-12911363aad8 admin admin] PATH_INFO: `/v3/users/60c58b7e0133457d9d05f45bc123a22d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:25.096943 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69312831-7a50-4f45-9922-12911363aad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60c58b7e0133457d9d05f45bc123a22d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:25.098889 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69312831-7a50-4f45-9922-12911363aad8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:25.142559 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-69312831-7a50-4f45-9922-12911363aad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60c58b7e0133457d9d05f45bc123a22d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:25.143195 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-69312831-7a50-4f45-9922-12911363aad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60c58b7e0133457d9d05f45bc123a22d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:25.150319 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-69312831-7a50-4f45-9922-12911363aad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60c58b7e0133457d9d05f45bc123a22d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:25.150963 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-69312831-7a50-4f45-9922-12911363aad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60c58b7e0133457d9d05f45bc123a22d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:25.164952 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-69312831-7a50-4f45-9922-12911363aad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60c58b7e0133457d9d05f45bc123a22d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:25.179000 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1182/2366] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:14:25 2021] DELETE /identity/v3/users/60c58b7e0133457d9d05f45bc123a22d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:25.184319 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab78264-1a47-494e-81a2-dd2fe95ec0ba None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:25.184878 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab78264-1a47-494e-81a2-dd2fe95ec0ba None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:25.184878 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab78264-1a47-494e-81a2-dd2fe95ec0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:25.202047 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-aab78264-1a47-494e-81a2-dd2fe95ec0ba None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:25.203242 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-aab78264-1a47-494e-81a2-dd2fe95ec0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:25.261245 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1185/2367] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:25.271038 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69312831-7a50-4f45-9922-12911363aad8 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:25.272643 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-69312831-7a50-4f45-9922-12911363aad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:25.327871 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69312831-7a50-4f45-9922-12911363aad8 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:25.331484 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fbdf2-70b1-492f-93e1-ece172c01bfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:25.332117 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fbdf2-70b1-492f-93e1-ece172c01bfc service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:25.332401 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fbdf2-70b1-492f-93e1-ece172c01bfc service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:25.332675 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fbdf2-70b1-492f-93e1-ece172c01bfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:25.341629 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fbdf2-70b1-492f-93e1-ece172c01bfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:25.343060 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fbdf2-70b1-492f-93e1-ece172c01bfc service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:25.352252 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1183/2368] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:25.612130 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab78264-1a47-494e-81a2-dd2fe95ec0ba None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:25.613608 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-aab78264-1a47-494e-81a2-dd2fe95ec0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:25.631298 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab78264-1a47-494e-81a2-dd2fe95ec0ba None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:25.636637 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5e1f9-aa95-48eb-bf0a-f5e4ee96f428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:25.637547 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5e1f9-aa95-48eb-bf0a-f5e4ee96f428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:25.637836 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5e1f9-aa95-48eb-bf0a-f5e4ee96f428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:25.638112 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5e1f9-aa95-48eb-bf0a-f5e4ee96f428 admin admin] PATH_INFO: `/v3/projects/9b6d7c89937e4ee6a047db03e8f5b56b` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:25.639478 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5e1f9-aa95-48eb-bf0a-f5e4ee96f428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b6d7c89937e4ee6a047db03e8f5b56b)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:25.641376 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5e1f9-aa95-48eb-bf0a-f5e4ee96f428 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:25.690702 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-d1b5e1f9-aa95-48eb-bf0a-f5e4ee96f428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b6d7c89937e4ee6a047db03e8f5b56b', 'request_id': 'req-d1b5e1f9-aa95-48eb-bf0a-f5e4ee96f428'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:25.698413 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-d1b5e1f9-aa95-48eb-bf0a-f5e4ee96f428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b6d7c89937e4ee6a047db03e8f5b56b', 'request_id': 'req-d1b5e1f9-aa95-48eb-bf0a-f5e4ee96f428'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:25.704042 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-d1b5e1f9-aa95-48eb-bf0a-f5e4ee96f428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b6d7c89937e4ee6a047db03e8f5b56b', 'request_id': 'req-d1b5e1f9-aa95-48eb-bf0a-f5e4ee96f428'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:25.715018 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-d1b5e1f9-aa95-48eb-bf0a-f5e4ee96f428 admin admin] The token cache is being invalidate because project 9b6d7c89937e4ee6a047db03e8f5b56b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:14:25.715305 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-d1b5e1f9-aa95-48eb-bf0a-f5e4ee96f428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:25.715952 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-d1b5e1f9-aa95-48eb-bf0a-f5e4ee96f428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:25.717521 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1186/2369] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:14:25 2021] DELETE /identity/v3/projects/9b6d7c89937e4ee6a047db03e8f5b56b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:14:25.721460 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fbdf2-70b1-492f-93e1-ece172c01bfc service neutron] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:25.731588 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fbdf2-70b1-492f-93e1-ece172c01bfc service neutron] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:25.784837 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47a8ea-3995-47f0-ad8b-091e23dff879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:25.785629 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47a8ea-3995-47f0-ad8b-091e23dff879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:25.785910 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47a8ea-3995-47f0-ad8b-091e23dff879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:25.786188 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47a8ea-3995-47f0-ad8b-091e23dff879 admin admin] PATH_INFO: `/v3/users/dd7175e7979d42cba4091e2a79ea4b3f` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:25.787375 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47a8ea-3995-47f0-ad8b-091e23dff879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd7175e7979d42cba4091e2a79ea4b3f)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:25.789922 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47a8ea-3995-47f0-ad8b-091e23dff879 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:25.832083 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-8f47a8ea-3995-47f0-ad8b-091e23dff879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd7175e7979d42cba4091e2a79ea4b3f'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:25.832718 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-8f47a8ea-3995-47f0-ad8b-091e23dff879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd7175e7979d42cba4091e2a79ea4b3f'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:25.839849 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-8f47a8ea-3995-47f0-ad8b-091e23dff879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd7175e7979d42cba4091e2a79ea4b3f'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:25.840741 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-8f47a8ea-3995-47f0-ad8b-091e23dff879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd7175e7979d42cba4091e2a79ea4b3f'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:25.855233 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-8f47a8ea-3995-47f0-ad8b-091e23dff879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd7175e7979d42cba4091e2a79ea4b3f'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:25.869066 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1184/2370] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:14:25 2021] DELETE /identity/v3/users/dd7175e7979d42cba4091e2a79ea4b3f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:26.148028 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5e1f9-aa95-48eb-bf0a-f5e4ee96f428 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:26.149557 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-d1b5e1f9-aa95-48eb-bf0a-f5e4ee96f428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:26.164404 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5e1f9-aa95-48eb-bf0a-f5e4ee96f428 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:26.222792 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae16f8f-a57e-43cd-a348-494ce81a0236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:26.223644 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae16f8f-a57e-43cd-a348-494ce81a0236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:26.223924 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae16f8f-a57e-43cd-a348-494ce81a0236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:26.224197 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae16f8f-a57e-43cd-a348-494ce81a0236 admin admin] PATH_INFO: `/v3/projects/87ac11951bfd45318549bdec6625db78` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:26.226046 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae16f8f-a57e-43cd-a348-494ce81a0236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87ac11951bfd45318549bdec6625db78)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:26.227939 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae16f8f-a57e-43cd-a348-494ce81a0236 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:26.273009 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-cae16f8f-a57e-43cd-a348-494ce81a0236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87ac11951bfd45318549bdec6625db78', 'request_id': 'req-cae16f8f-a57e-43cd-a348-494ce81a0236'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:26.280134 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-cae16f8f-a57e-43cd-a348-494ce81a0236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87ac11951bfd45318549bdec6625db78', 'request_id': 'req-cae16f8f-a57e-43cd-a348-494ce81a0236'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:26.285710 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-cae16f8f-a57e-43cd-a348-494ce81a0236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87ac11951bfd45318549bdec6625db78', 'request_id': 'req-cae16f8f-a57e-43cd-a348-494ce81a0236'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:26.297213 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-cae16f8f-a57e-43cd-a348-494ce81a0236 admin admin] The token cache is being invalidate because project 87ac11951bfd45318549bdec6625db78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:14:26.297446 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-cae16f8f-a57e-43cd-a348-494ce81a0236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:26.298072 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-cae16f8f-a57e-43cd-a348-494ce81a0236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:26.299615 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1187/2371] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:14:26 2021] DELETE /identity/v3/projects/87ac11951bfd45318549bdec6625db78 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:26.306097 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e213310-79ff-4d4b-9724-c435e05d4fbc None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:26.306398 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e213310-79ff-4d4b-9724-c435e05d4fbc None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:26.306678 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e213310-79ff-4d4b-9724-c435e05d4fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:26.324868 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-4e213310-79ff-4d4b-9724-c435e05d4fbc None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:26.326119 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-4e213310-79ff-4d4b-9724-c435e05d4fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:26.384031 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1185/2372] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:26.393223 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258d740-fbbb-472d-ab91-bfad4b37be87 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:26.393540 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258d740-fbbb-472d-ab91-bfad4b37be87 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:26.393820 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258d740-fbbb-472d-ab91-bfad4b37be87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:26.411768 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-2258d740-fbbb-472d-ab91-bfad4b37be87 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:26.413522 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-2258d740-fbbb-472d-ab91-bfad4b37be87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:26.421262 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1188/2373] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:14:26.425305 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e213310-79ff-4d4b-9724-c435e05d4fbc None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:26.435432 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e213310-79ff-4d4b-9724-c435e05d4fbc None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:26.440020 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78933f39-cd65-453d-b794-5beecf5cce39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:26.440655 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78933f39-cd65-453d-b794-5beecf5cce39 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:26.440933 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78933f39-cd65-453d-b794-5beecf5cce39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:26.441206 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78933f39-cd65-453d-b794-5beecf5cce39 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:26.441964 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78933f39-cd65-453d-b794-5beecf5cce39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:14:26.442267 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78933f39-cd65-453d-b794-5beecf5cce39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:26.443926 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78933f39-cd65-453d-b794-5beecf5cce39 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:26.454970 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1186/2374] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:14:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:14:26.459187 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258d740-fbbb-472d-ab91-bfad4b37be87 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:26.468306 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258d740-fbbb-472d-ab91-bfad4b37be87 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:26.472930 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be804f9-4ca0-4e0c-b9fd-91d2625b78ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:26.473611 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be804f9-4ca0-4e0c-b9fd-91d2625b78ae admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:26.473893 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be804f9-4ca0-4e0c-b9fd-91d2625b78ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:26.474167 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be804f9-4ca0-4e0c-b9fd-91d2625b78ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:26.474865 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be804f9-4ca0-4e0c-b9fd-91d2625b78ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:26.477483 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be804f9-4ca0-4e0c-b9fd-91d2625b78ae admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:26.502036 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1189/2375] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:14:26 2021] POST /identity/v3/projects => generated 409 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:14:26.506063 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78933f39-cd65-453d-b794-5beecf5cce39 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:26.516328 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78933f39-cd65-453d-b794-5beecf5cce39 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:26.578044 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6450a8d-2803-4a50-9eb2-3a6328cfd7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:26.578714 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6450a8d-2803-4a50-9eb2-3a6328cfd7ea admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:26.579015 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6450a8d-2803-4a50-9eb2-3a6328cfd7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:26.579286 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6450a8d-2803-4a50-9eb2-3a6328cfd7ea admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:26.580264 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6450a8d-2803-4a50-9eb2-3a6328cfd7ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:26.582257 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6450a8d-2803-4a50-9eb2-3a6328cfd7ea admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:26.602609 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1187/2376] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:14:26 2021] POST /identity/v3/users => generated 305 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:14:26.606962 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be804f9-4ca0-4e0c-b9fd-91d2625b78ae admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:26.617695 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be804f9-4ca0-4e0c-b9fd-91d2625b78ae admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:26.623603 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008267e5-c69a-497b-9b34-ef2601e9c097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:26.624267 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008267e5-c69a-497b-9b34-ef2601e9c097 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:26.624710 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008267e5-c69a-497b-9b34-ef2601e9c097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:26.625182 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008267e5-c69a-497b-9b34-ef2601e9c097 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:26.626172 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008267e5-c69a-497b-9b34-ef2601e9c097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:26.628124 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008267e5-c69a-497b-9b34-ef2601e9c097 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:26.640296 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1190/2377] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:26 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:14:26.644408 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6450a8d-2803-4a50-9eb2-3a6328cfd7ea admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:26.654898 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6450a8d-2803-4a50-9eb2-3a6328cfd7ea admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:26.660258 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a42353-a16a-41e4-afa5-5a1a46422eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:26.660920 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a42353-a16a-41e4-afa5-5a1a46422eda admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:26.661229 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a42353-a16a-41e4-afa5-5a1a46422eda admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:26.661513 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a42353-a16a-41e4-afa5-5a1a46422eda admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:26.662252 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a42353-a16a-41e4-afa5-5a1a46422eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:26.663861 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a42353-a16a-41e4-afa5-5a1a46422eda admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:26.673955 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1188/2378] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:26 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:14:26.678181 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008267e5-c69a-497b-9b34-ef2601e9c097 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:26.688831 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008267e5-c69a-497b-9b34-ef2601e9c097 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:26.693649 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2e369-9086-4657-bea4-d7a66047d600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:26.695435 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2e369-9086-4657-bea4-d7a66047d600 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:26.695744 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2e369-9086-4657-bea4-d7a66047d600 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:26.696063 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2e369-9086-4657-bea4-d7a66047d600 admin admin] PATH_INFO: `/v3/projects/d36063f866dc4a9d8b70068e8ce4367c/users/6a47f6f8d8aa444b99f6071d4e1bec84/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:26.710778 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2e369-9086-4657-bea4-d7a66047d600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d36063f866dc4a9d8b70068e8ce4367c, user_id=6a47f6f8d8aa444b99f6071d4e1bec84, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:26.713496 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2e369-9086-4657-bea4-d7a66047d600 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:26.726916 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1191/2379] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:14:26 2021] PUT /identity/v3/projects/d36063f866dc4a9d8b70068e8ce4367c/users/6a47f6f8d8aa444b99f6071d4e1bec84/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:26.737086 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bce034-41bd-482a-8094-8e080ddc29f8 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:26.737600 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bce034-41bd-482a-8094-8e080ddc29f8 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:26.737810 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bce034-41bd-482a-8094-8e080ddc29f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:26.767652 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-f0bce034-41bd-482a-8094-8e080ddc29f8 None None] MFA Rules not processed for user `6a47f6f8d8aa444b99f6071d4e1bec84`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:26.768853 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-f0bce034-41bd-482a-8094-8e080ddc29f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:26.832567 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1189/2380] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:26 2021] POST /identity/v3/auth/tokens => generated 3276 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:26.837282 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2e369-9086-4657-bea4-d7a66047d600 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:26.898440 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2e369-9086-4657-bea4-d7a66047d600 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:26.903333 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f420058-d557-472b-96c5-53643c8fe622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:26.904067 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f420058-d557-472b-96c5-53643c8fe622 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:26.904408 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f420058-d557-472b-96c5-53643c8fe622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:26.905113 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f420058-d557-472b-96c5-53643c8fe622 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:26.905875 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f420058-d557-472b-96c5-53643c8fe622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:26.908100 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f420058-d557-472b-96c5-53643c8fe622 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:26.937374 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1192/2381] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:14:26 2021] POST /identity/v3/projects => generated 409 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:14:26.942887 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bce034-41bd-482a-8094-8e080ddc29f8 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:26.976763 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bce034-41bd-482a-8094-8e080ddc29f8 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:27.045136 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be5c65-b5fa-4d3d-8b3c-c7b745d5cb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:27.045848 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be5c65-b5fa-4d3d-8b3c-c7b745d5cb0e admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:27.046131 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be5c65-b5fa-4d3d-8b3c-c7b745d5cb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:27.046565 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be5c65-b5fa-4d3d-8b3c-c7b745d5cb0e admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:27.047256 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be5c65-b5fa-4d3d-8b3c-c7b745d5cb0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:27.049189 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be5c65-b5fa-4d3d-8b3c-c7b745d5cb0e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:27.073663 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1190/2382] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:14:26 2021] POST /identity/v3/users => generated 311 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:14:27.077683 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f420058-d557-472b-96c5-53643c8fe622 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:27.088282 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f420058-d557-472b-96c5-53643c8fe622 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:27.093846 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b79a58-f807-41ba-b20d-c3626bd31502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:27.094508 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b79a58-f807-41ba-b20d-c3626bd31502 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:27.094916 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b79a58-f807-41ba-b20d-c3626bd31502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:27.095206 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b79a58-f807-41ba-b20d-c3626bd31502 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:27.095955 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b79a58-f807-41ba-b20d-c3626bd31502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:27.097624 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b79a58-f807-41ba-b20d-c3626bd31502 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:27.109799 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1193/2383] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:27 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:14:27.114854 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be5c65-b5fa-4d3d-8b3c-c7b745d5cb0e admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:27.126953 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be5c65-b5fa-4d3d-8b3c-c7b745d5cb0e admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:27.134654 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df994961-ca86-4bd3-85df-4963604d67b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:27.135943 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df994961-ca86-4bd3-85df-4963604d67b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:27.136457 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df994961-ca86-4bd3-85df-4963604d67b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:27.137597 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df994961-ca86-4bd3-85df-4963604d67b0 admin admin] PATH_INFO: `/v3/projects/70e328997fed472da81442fb6a610386/users/a1e986895acb481888fdeb7364e0c5e0/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:27.156985 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df994961-ca86-4bd3-85df-4963604d67b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70e328997fed472da81442fb6a610386, user_id=a1e986895acb481888fdeb7364e0c5e0, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:27.160802 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df994961-ca86-4bd3-85df-4963604d67b0 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:27.176307 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1191/2384] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:14:27 2021] PUT /identity/v3/projects/70e328997fed472da81442fb6a610386/users/a1e986895acb481888fdeb7364e0c5e0/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:27.180894 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b79a58-f807-41ba-b20d-c3626bd31502 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:27.191285 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b79a58-f807-41ba-b20d-c3626bd31502 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:27.256237 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5229cf7-3e26-4d2e-b1ff-7a00f194bc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:27.257616 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5229cf7-3e26-4d2e-b1ff-7a00f194bc80 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:27.257881 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5229cf7-3e26-4d2e-b1ff-7a00f194bc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:27.258148 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5229cf7-3e26-4d2e-b1ff-7a00f194bc80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:27.258891 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5229cf7-3e26-4d2e-b1ff-7a00f194bc80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:27.260481 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5229cf7-3e26-4d2e-b1ff-7a00f194bc80 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:27.270396 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1194/2385] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:27 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:14:27.275243 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df994961-ca86-4bd3-85df-4963604d67b0 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:27.285771 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df994961-ca86-4bd3-85df-4963604d67b0 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:27.291502 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc4f67-e527-4eac-ad99-99774cb122ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:27.292427 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc4f67-e527-4eac-ad99-99774cb122ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:27.292710 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc4f67-e527-4eac-ad99-99774cb122ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:27.292985 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc4f67-e527-4eac-ad99-99774cb122ef admin admin] PATH_INFO: `/v3/projects/70e328997fed472da81442fb6a610386/users/a1e986895acb481888fdeb7364e0c5e0/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:27.295013 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc4f67-e527-4eac-ad99-99774cb122ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=70e328997fed472da81442fb6a610386, user_id=a1e986895acb481888fdeb7364e0c5e0, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:27.297677 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc4f67-e527-4eac-ad99-99774cb122ef admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:27.312331 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1192/2386] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:14:27 2021] PUT /identity/v3/projects/70e328997fed472da81442fb6a610386/users/a1e986895acb481888fdeb7364e0c5e0/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:27.323483 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e58eac-72b5-4bc4-9d4b-12f1758b06ce None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:27.323770 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e58eac-72b5-4bc4-9d4b-12f1758b06ce None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:27.324042 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e58eac-72b5-4bc4-9d4b-12f1758b06ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:27.350164 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-43e58eac-72b5-4bc4-9d4b-12f1758b06ce None None] MFA Rules not processed for user `a1e986895acb481888fdeb7364e0c5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:27.351504 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-43e58eac-72b5-4bc4-9d4b-12f1758b06ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:27.417991 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1195/2387] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:27 2021] POST /identity/v3/auth/tokens => generated 3343 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:27.427760 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc4f67-e527-4eac-ad99-99774cb122ef admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:27.430084 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-f5fc4f67-e527-4eac-ad99-99774cb122ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:27.484235 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc4f67-e527-4eac-ad99-99774cb122ef admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:27.487828 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b577274-2f2c-4f45-b2de-e1dfc4c687c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:27.488460 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b577274-2f2c-4f45-b2de-e1dfc4c687c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:27.488741 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b577274-2f2c-4f45-b2de-e1dfc4c687c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:27.489315 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b577274-2f2c-4f45-b2de-e1dfc4c687c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:27.499762 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b577274-2f2c-4f45-b2de-e1dfc4c687c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:27.501233 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b577274-2f2c-4f45-b2de-e1dfc4c687c9 service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:27.511022 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1193/2388] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:27 2021] GET /identity/v3/auth/tokens => generated 3343 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:27.652738 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e58eac-72b5-4bc4-9d4b-12f1758b06ce None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:27.663083 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e58eac-72b5-4bc4-9d4b-12f1758b06ce None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:27.666746 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d89dc9-c041-4fb7-99cc-4a7b1be034d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:27.667396 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d89dc9-c041-4fb7-99cc-4a7b1be034d2 service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:27.667664 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d89dc9-c041-4fb7-99cc-4a7b1be034d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:27.667935 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d89dc9-c041-4fb7-99cc-4a7b1be034d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:27.728012 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d89dc9-c041-4fb7-99cc-4a7b1be034d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:27.729466 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d89dc9-c041-4fb7-99cc-4a7b1be034d2 service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:27.738092 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1196/2389] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:27 2021] GET /identity/v3/auth/tokens => generated 3276 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:31.635421 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b577274-2f2c-4f45-b2de-e1dfc4c687c9 service cinder] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:31.638099 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-1b577274-2f2c-4f45-b2de-e1dfc4c687c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:31.701497 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b577274-2f2c-4f45-b2de-e1dfc4c687c9 service cinder] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:31.706065 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfcba00-0d06-4f17-ae88-dea99cced119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:31.706922 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfcba00-0d06-4f17-ae88-dea99cced119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:31.707201 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfcba00-0d06-4f17-ae88-dea99cced119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:31.707472 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfcba00-0d06-4f17-ae88-dea99cced119 admin admin] PATH_INFO: `/v3/users/c7af97c50dab46dd85477944b2450a4d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:31.708689 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfcba00-0d06-4f17-ae88-dea99cced119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7af97c50dab46dd85477944b2450a4d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:31.710846 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfcba00-0d06-4f17-ae88-dea99cced119 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:31.755561 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-7cfcba00-0d06-4f17-ae88-dea99cced119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7af97c50dab46dd85477944b2450a4d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:31.756579 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-7cfcba00-0d06-4f17-ae88-dea99cced119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7af97c50dab46dd85477944b2450a4d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:31.763704 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-7cfcba00-0d06-4f17-ae88-dea99cced119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7af97c50dab46dd85477944b2450a4d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:31.764313 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-7cfcba00-0d06-4f17-ae88-dea99cced119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7af97c50dab46dd85477944b2450a4d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:31.775453 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-7cfcba00-0d06-4f17-ae88-dea99cced119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7af97c50dab46dd85477944b2450a4d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:31.788809 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1194/2390] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:14:31 2021] DELETE /identity/v3/users/c7af97c50dab46dd85477944b2450a4d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:31.956958 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d89dc9-c041-4fb7-99cc-4a7b1be034d2 service cinder] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:31.968863 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d89dc9-c041-4fb7-99cc-4a7b1be034d2 service cinder] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:32.024746 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb01372-f3f0-4821-8fa1-1693901f57b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:32.025556 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb01372-f3f0-4821-8fa1-1693901f57b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:32.025846 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb01372-f3f0-4821-8fa1-1693901f57b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:32.026120 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb01372-f3f0-4821-8fa1-1693901f57b7 admin admin] PATH_INFO: `/v3/projects/9f1847fe78e7459f800877907c42878d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:32.027315 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb01372-f3f0-4821-8fa1-1693901f57b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f1847fe78e7459f800877907c42878d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:32.029221 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb01372-f3f0-4821-8fa1-1693901f57b7 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:32.075381 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-bcb01372-f3f0-4821-8fa1-1693901f57b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f1847fe78e7459f800877907c42878d', 'request_id': 'req-bcb01372-f3f0-4821-8fa1-1693901f57b7'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:32.082538 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-bcb01372-f3f0-4821-8fa1-1693901f57b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f1847fe78e7459f800877907c42878d', 'request_id': 'req-bcb01372-f3f0-4821-8fa1-1693901f57b7'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:32.088094 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-bcb01372-f3f0-4821-8fa1-1693901f57b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f1847fe78e7459f800877907c42878d', 'request_id': 'req-bcb01372-f3f0-4821-8fa1-1693901f57b7'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:32.098627 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-bcb01372-f3f0-4821-8fa1-1693901f57b7 admin admin] The token cache is being invalidate because project 9f1847fe78e7459f800877907c42878d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:14:32.098909 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-bcb01372-f3f0-4821-8fa1-1693901f57b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:32.099546 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-bcb01372-f3f0-4821-8fa1-1693901f57b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:32.101278 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1197/2391] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:14:31 2021] DELETE /identity/v3/projects/9f1847fe78e7459f800877907c42878d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:32.107249 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81b7cf-46b2-4a65-8a07-5ef95cf1e601 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:32.107543 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81b7cf-46b2-4a65-8a07-5ef95cf1e601 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:32.107825 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81b7cf-46b2-4a65-8a07-5ef95cf1e601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:32.126002 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-8c81b7cf-46b2-4a65-8a07-5ef95cf1e601 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:32.127208 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-8c81b7cf-46b2-4a65-8a07-5ef95cf1e601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:32.186000 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1195/2392] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:32.193610 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d27202-37ba-4ec5-b98a-0ecceb2695f9 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:32.194741 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d27202-37ba-4ec5-b98a-0ecceb2695f9 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:32.195063 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d27202-37ba-4ec5-b98a-0ecceb2695f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:32.214153 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-e2d27202-37ba-4ec5-b98a-0ecceb2695f9 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:32.215354 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-e2d27202-37ba-4ec5-b98a-0ecceb2695f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:32.223109 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1198/2393] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:32.227775 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81b7cf-46b2-4a65-8a07-5ef95cf1e601 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:32.237248 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81b7cf-46b2-4a65-8a07-5ef95cf1e601 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:32.242663 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1226f-b6e1-41f9-aebf-b4f03cfeaffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:32.243301 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1226f-b6e1-41f9-aebf-b4f03cfeaffd admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:32.243582 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1226f-b6e1-41f9-aebf-b4f03cfeaffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:32.243855 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1226f-b6e1-41f9-aebf-b4f03cfeaffd admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:32.244581 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1226f-b6e1-41f9-aebf-b4f03cfeaffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:14:32.244883 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1226f-b6e1-41f9-aebf-b4f03cfeaffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:32.246506 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1226f-b6e1-41f9-aebf-b4f03cfeaffd admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:32.257992 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1196/2394] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:14:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:14:32.262201 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d27202-37ba-4ec5-b98a-0ecceb2695f9 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:32.271677 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d27202-37ba-4ec5-b98a-0ecceb2695f9 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:32.277369 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf04e99-efba-40b5-8fcd-30762a4c49c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:32.278075 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf04e99-efba-40b5-8fcd-30762a4c49c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:32.278362 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf04e99-efba-40b5-8fcd-30762a4c49c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:32.278638 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf04e99-efba-40b5-8fcd-30762a4c49c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:32.279363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf04e99-efba-40b5-8fcd-30762a4c49c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:32.281273 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf04e99-efba-40b5-8fcd-30762a4c49c7 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:32.309049 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1199/2395] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:14:32 2021] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:14:32.313198 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1226f-b6e1-41f9-aebf-b4f03cfeaffd admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:32.323432 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1226f-b6e1-41f9-aebf-b4f03cfeaffd admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:32.379509 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfee554-4800-432f-b831-8abc19fe87d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:32.381075 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfee554-4800-432f-b831-8abc19fe87d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:32.381567 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfee554-4800-432f-b831-8abc19fe87d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:32.382705 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfee554-4800-432f-b831-8abc19fe87d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:32.383508 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfee554-4800-432f-b831-8abc19fe87d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:32.385727 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfee554-4800-432f-b831-8abc19fe87d5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:32.406788 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1197/2396] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:14:32 2021] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:14:32.411094 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf04e99-efba-40b5-8fcd-30762a4c49c7 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:32.421801 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf04e99-efba-40b5-8fcd-30762a4c49c7 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:32.426433 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb48e6-8ff3-4bb7-bdee-fe6c46af3a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:32.427081 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb48e6-8ff3-4bb7-bdee-fe6c46af3a52 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:32.427607 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb48e6-8ff3-4bb7-bdee-fe6c46af3a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:32.432591 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb48e6-8ff3-4bb7-bdee-fe6c46af3a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:32.433363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb48e6-8ff3-4bb7-bdee-fe6c46af3a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:32.435079 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb48e6-8ff3-4bb7-bdee-fe6c46af3a52 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:32.446165 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1200/2397] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:32 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:14:32.450122 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfee554-4800-432f-b831-8abc19fe87d5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:32.460353 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfee554-4800-432f-b831-8abc19fe87d5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:32.465263 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfea6a6-2578-4cef-b446-ee8db496dfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:32.465945 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfea6a6-2578-4cef-b446-ee8db496dfdb admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:32.466228 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfea6a6-2578-4cef-b446-ee8db496dfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:32.466504 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfea6a6-2578-4cef-b446-ee8db496dfdb admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:32.467240 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfea6a6-2578-4cef-b446-ee8db496dfdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:32.468835 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfea6a6-2578-4cef-b446-ee8db496dfdb admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:32.478971 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1198/2398] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:32 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:14:32.482972 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb48e6-8ff3-4bb7-bdee-fe6c46af3a52 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:32.494793 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb48e6-8ff3-4bb7-bdee-fe6c46af3a52 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:32.499399 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d55ae-9e3e-4b20-8d5d-c9c08d0edb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:32.500402 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d55ae-9e3e-4b20-8d5d-c9c08d0edb18 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:32.500692 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d55ae-9e3e-4b20-8d5d-c9c08d0edb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:32.500967 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d55ae-9e3e-4b20-8d5d-c9c08d0edb18 admin admin] PATH_INFO: `/v3/projects/a7996572f97149c6926d71541907c651/users/8a90d61b81eb4328a7d4ba8773f2d4bf/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:32.515200 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d55ae-9e3e-4b20-8d5d-c9c08d0edb18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7996572f97149c6926d71541907c651, user_id=8a90d61b81eb4328a7d4ba8773f2d4bf, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:32.517845 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d55ae-9e3e-4b20-8d5d-c9c08d0edb18 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:32.531654 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1201/2399] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:14:32 2021] PUT /identity/v3/projects/a7996572f97149c6926d71541907c651/users/8a90d61b81eb4328a7d4ba8773f2d4bf/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:32.542650 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9e828-66f9-4841-959d-245e34e72815 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:32.542939 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9e828-66f9-4841-959d-245e34e72815 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:32.543230 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9e828-66f9-4841-959d-245e34e72815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:32.568746 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-6fd9e828-66f9-4841-959d-245e34e72815 None None] MFA Rules not processed for user `8a90d61b81eb4328a7d4ba8773f2d4bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:32.570550 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-6fd9e828-66f9-4841-959d-245e34e72815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:32.633521 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1199/2400] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:32 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:32.638040 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d55ae-9e3e-4b20-8d5d-c9c08d0edb18 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:32.698233 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d55ae-9e3e-4b20-8d5d-c9c08d0edb18 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:32.702793 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3779814-fcc1-4ecd-b459-677663229b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:32.703682 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3779814-fcc1-4ecd-b459-677663229b81 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:32.703967 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3779814-fcc1-4ecd-b459-677663229b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:32.704241 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3779814-fcc1-4ecd-b459-677663229b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:32.704940 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3779814-fcc1-4ecd-b459-677663229b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:32.707038 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3779814-fcc1-4ecd-b459-677663229b81 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:32.732213 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1202/2401] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:14:32 2021] POST /identity/v3/projects => generated 363 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:14:32.736385 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9e828-66f9-4841-959d-245e34e72815 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:32.747051 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9e828-66f9-4841-959d-245e34e72815 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:32.805225 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03e055-a25d-41df-9f1e-f0726600faff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:32.805926 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03e055-a25d-41df-9f1e-f0726600faff admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:32.806217 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03e055-a25d-41df-9f1e-f0726600faff admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:32.806484 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03e055-a25d-41df-9f1e-f0726600faff admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:32.807226 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03e055-a25d-41df-9f1e-f0726600faff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:32.809159 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03e055-a25d-41df-9f1e-f0726600faff admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:32.828418 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1200/2402] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:14:32 2021] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:14:32.832426 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3779814-fcc1-4ecd-b459-677663229b81 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:32.843130 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3779814-fcc1-4ecd-b459-677663229b81 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:32.847713 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed3e4a-033f-4ece-9c62-ee22ad0c635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:32.848354 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed3e4a-033f-4ece-9c62-ee22ad0c635f admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:32.848628 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed3e4a-033f-4ece-9c62-ee22ad0c635f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:32.848898 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed3e4a-033f-4ece-9c62-ee22ad0c635f admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:32.849687 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed3e4a-033f-4ece-9c62-ee22ad0c635f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:32.851527 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed3e4a-033f-4ece-9c62-ee22ad0c635f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:32.861833 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1203/2403] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:32 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:14:32.866729 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03e055-a25d-41df-9f1e-f0726600faff admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:32.880372 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03e055-a25d-41df-9f1e-f0726600faff admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:32.885708 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c808104-0989-40bc-b9f6-382b3284a6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:32.886575 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c808104-0989-40bc-b9f6-382b3284a6e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:32.886856 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c808104-0989-40bc-b9f6-382b3284a6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:32.887126 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c808104-0989-40bc-b9f6-382b3284a6e5 admin admin] PATH_INFO: `/v3/projects/367f1292448d44e4bb455fe6ae7c9b7a/users/98a3e2faa88a40f393cbcccc7f598252/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:32.902070 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c808104-0989-40bc-b9f6-382b3284a6e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=367f1292448d44e4bb455fe6ae7c9b7a, user_id=98a3e2faa88a40f393cbcccc7f598252, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:32.904739 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c808104-0989-40bc-b9f6-382b3284a6e5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:32.917982 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1201/2404] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:14:32 2021] PUT /identity/v3/projects/367f1292448d44e4bb455fe6ae7c9b7a/users/98a3e2faa88a40f393cbcccc7f598252/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:32.921994 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed3e4a-033f-4ece-9c62-ee22ad0c635f admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:32.931626 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed3e4a-033f-4ece-9c62-ee22ad0c635f admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:32.984867 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61900d2a-a71c-4f9a-9c36-f953187544f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:32.985550 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61900d2a-a71c-4f9a-9c36-f953187544f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:32.985833 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61900d2a-a71c-4f9a-9c36-f953187544f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:32.986107 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61900d2a-a71c-4f9a-9c36-f953187544f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:32.986833 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61900d2a-a71c-4f9a-9c36-f953187544f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:32.988403 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61900d2a-a71c-4f9a-9c36-f953187544f4 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:32.997670 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1204/2405] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:32 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:14:33.001973 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c808104-0989-40bc-b9f6-382b3284a6e5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:33.012516 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c808104-0989-40bc-b9f6-382b3284a6e5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:33.017217 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c175f8-dc6b-4c82-b9ec-5953110d98bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:33.018115 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c175f8-dc6b-4c82-b9ec-5953110d98bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:33.018400 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c175f8-dc6b-4c82-b9ec-5953110d98bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:33.018673 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c175f8-dc6b-4c82-b9ec-5953110d98bf admin admin] PATH_INFO: `/v3/projects/367f1292448d44e4bb455fe6ae7c9b7a/users/98a3e2faa88a40f393cbcccc7f598252/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:33.020626 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c175f8-dc6b-4c82-b9ec-5953110d98bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=367f1292448d44e4bb455fe6ae7c9b7a, user_id=98a3e2faa88a40f393cbcccc7f598252, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:33.024023 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c175f8-dc6b-4c82-b9ec-5953110d98bf admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:33.034319 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1202/2406] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:14:33 2021] PUT /identity/v3/projects/367f1292448d44e4bb455fe6ae7c9b7a/users/98a3e2faa88a40f393cbcccc7f598252/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:33.045692 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab83ff-f4c9-48ae-929e-e25d2979c6dc None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:33.045989 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab83ff-f4c9-48ae-929e-e25d2979c6dc None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:33.046265 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab83ff-f4c9-48ae-929e-e25d2979c6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:33.072910 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-a7ab83ff-f4c9-48ae-929e-e25d2979c6dc None None] MFA Rules not processed for user `98a3e2faa88a40f393cbcccc7f598252`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:33.074199 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-a7ab83ff-f4c9-48ae-929e-e25d2979c6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:33.140593 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1205/2407] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:33 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:33.151409 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c175f8-dc6b-4c82-b9ec-5953110d98bf admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:33.153111 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-81c175f8-dc6b-4c82-b9ec-5953110d98bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:33.207970 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c175f8-dc6b-4c82-b9ec-5953110d98bf admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:33.212252 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01094b-6f02-4a6c-905f-b2dcfaa265b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:33.212879 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01094b-6f02-4a6c-905f-b2dcfaa265b1 service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:33.213160 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01094b-6f02-4a6c-905f-b2dcfaa265b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:33.213460 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01094b-6f02-4a6c-905f-b2dcfaa265b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:33.222249 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01094b-6f02-4a6c-905f-b2dcfaa265b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:33.223685 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01094b-6f02-4a6c-905f-b2dcfaa265b1 service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:33.235787 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1203/2408] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:33 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:33.304251 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab83ff-f4c9-48ae-929e-e25d2979c6dc None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:33.305790 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-a7ab83ff-f4c9-48ae-929e-e25d2979c6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:33.320069 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab83ff-f4c9-48ae-929e-e25d2979c6dc None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:33.323947 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104cc03-71d7-4e8e-bc19-f839e3e0dda8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:33.324622 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104cc03-71d7-4e8e-bc19-f839e3e0dda8 service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:33.324943 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104cc03-71d7-4e8e-bc19-f839e3e0dda8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:33.325176 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104cc03-71d7-4e8e-bc19-f839e3e0dda8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:33.380987 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104cc03-71d7-4e8e-bc19-f839e3e0dda8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:33.383273 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104cc03-71d7-4e8e-bc19-f839e3e0dda8 service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:33.393087 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1206/2409] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:33 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:36.036792 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01094b-6f02-4a6c-905f-b2dcfaa265b1 service cinder] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:36.038998 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-9b01094b-6f02-4a6c-905f-b2dcfaa265b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:36.112405 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01094b-6f02-4a6c-905f-b2dcfaa265b1 service cinder] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:36.118794 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e8d0b-1bd1-40ee-9341-c3b965c1462a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:36.120081 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e8d0b-1bd1-40ee-9341-c3b965c1462a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:36.120626 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e8d0b-1bd1-40ee-9341-c3b965c1462a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:36.120965 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e8d0b-1bd1-40ee-9341-c3b965c1462a admin admin] PATH_INFO: `/v3/users/6a47f6f8d8aa444b99f6071d4e1bec84` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:36.122319 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e8d0b-1bd1-40ee-9341-c3b965c1462a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a47f6f8d8aa444b99f6071d4e1bec84)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:36.124893 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e8d0b-1bd1-40ee-9341-c3b965c1462a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:36.185086 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-769e8d0b-1bd1-40ee-9341-c3b965c1462a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a47f6f8d8aa444b99f6071d4e1bec84'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:36.185895 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-769e8d0b-1bd1-40ee-9341-c3b965c1462a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a47f6f8d8aa444b99f6071d4e1bec84'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:36.193686 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-769e8d0b-1bd1-40ee-9341-c3b965c1462a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a47f6f8d8aa444b99f6071d4e1bec84'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:36.194827 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-769e8d0b-1bd1-40ee-9341-c3b965c1462a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a47f6f8d8aa444b99f6071d4e1bec84'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:36.209784 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-769e8d0b-1bd1-40ee-9341-c3b965c1462a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a47f6f8d8aa444b99f6071d4e1bec84'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:36.225667 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1204/2410] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:14:36 2021] DELETE /identity/v3/users/6a47f6f8d8aa444b99f6071d4e1bec84 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:36.230504 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e8e5d-dfeb-42a4-a47d-a64c15be3744 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:36.230969 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e8e5d-dfeb-42a4-a47d-a64c15be3744 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:36.231063 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e8e5d-dfeb-42a4-a47d-a64c15be3744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:36.248592 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-ec2e8e5d-dfeb-42a4-a47d-a64c15be3744 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:36.249814 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-ec2e8e5d-dfeb-42a4-a47d-a64c15be3744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:36.312367 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1207/2411] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:36.323305 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e8d0b-1bd1-40ee-9341-c3b965c1462a admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:36.324694 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-769e8d0b-1bd1-40ee-9341-c3b965c1462a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:36.384847 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e8d0b-1bd1-40ee-9341-c3b965c1462a admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:36.388464 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad46af8-cb58-42fb-81a2-99b846a6130a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:36.389107 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad46af8-cb58-42fb-81a2-99b846a6130a service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:36.389399 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad46af8-cb58-42fb-81a2-99b846a6130a service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:36.389683 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad46af8-cb58-42fb-81a2-99b846a6130a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:36.400197 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad46af8-cb58-42fb-81a2-99b846a6130a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:36.401877 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad46af8-cb58-42fb-81a2-99b846a6130a service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:36.411846 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1205/2412] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:36.669511 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e8e5d-dfeb-42a4-a47d-a64c15be3744 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:36.670945 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-ec2e8e5d-dfeb-42a4-a47d-a64c15be3744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:36.684289 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e8e5d-dfeb-42a4-a47d-a64c15be3744 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:36.688999 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245822b8-f6ff-4fbb-a41e-796f165e9fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:36.689874 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245822b8-f6ff-4fbb-a41e-796f165e9fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:36.690662 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245822b8-f6ff-4fbb-a41e-796f165e9fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:36.690950 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245822b8-f6ff-4fbb-a41e-796f165e9fd6 admin admin] PATH_INFO: `/v3/projects/d36063f866dc4a9d8b70068e8ce4367c` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:36.692352 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245822b8-f6ff-4fbb-a41e-796f165e9fd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d36063f866dc4a9d8b70068e8ce4367c)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:36.694922 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245822b8-f6ff-4fbb-a41e-796f165e9fd6 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:36.739043 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-245822b8-f6ff-4fbb-a41e-796f165e9fd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd36063f866dc4a9d8b70068e8ce4367c', 'request_id': 'req-245822b8-f6ff-4fbb-a41e-796f165e9fd6'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:36.746724 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-245822b8-f6ff-4fbb-a41e-796f165e9fd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd36063f866dc4a9d8b70068e8ce4367c', 'request_id': 'req-245822b8-f6ff-4fbb-a41e-796f165e9fd6'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:36.752100 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-245822b8-f6ff-4fbb-a41e-796f165e9fd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd36063f866dc4a9d8b70068e8ce4367c', 'request_id': 'req-245822b8-f6ff-4fbb-a41e-796f165e9fd6'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:36.763001 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-245822b8-f6ff-4fbb-a41e-796f165e9fd6 admin admin] The token cache is being invalidate because project d36063f866dc4a9d8b70068e8ce4367c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:14:36.763292 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-245822b8-f6ff-4fbb-a41e-796f165e9fd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:36.763946 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-245822b8-f6ff-4fbb-a41e-796f165e9fd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:36.765497 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1208/2413] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:14:36 2021] DELETE /identity/v3/projects/d36063f866dc4a9d8b70068e8ce4367c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:36.769630 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad46af8-cb58-42fb-81a2-99b846a6130a service neutron] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:36.779267 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad46af8-cb58-42fb-81a2-99b846a6130a service neutron] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:36.833437 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d653c2f-0c03-4fae-b8df-b340b889959a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:36.834305 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d653c2f-0c03-4fae-b8df-b340b889959a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:36.834613 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d653c2f-0c03-4fae-b8df-b340b889959a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:36.834969 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d653c2f-0c03-4fae-b8df-b340b889959a admin admin] PATH_INFO: `/v3/users/a1e986895acb481888fdeb7364e0c5e0` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:36.836073 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d653c2f-0c03-4fae-b8df-b340b889959a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1e986895acb481888fdeb7364e0c5e0)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:36.838032 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d653c2f-0c03-4fae-b8df-b340b889959a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:36.883682 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5d653c2f-0c03-4fae-b8df-b340b889959a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1e986895acb481888fdeb7364e0c5e0'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:36.884254 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5d653c2f-0c03-4fae-b8df-b340b889959a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1e986895acb481888fdeb7364e0c5e0'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:36.890865 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5d653c2f-0c03-4fae-b8df-b340b889959a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1e986895acb481888fdeb7364e0c5e0'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:36.891483 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5d653c2f-0c03-4fae-b8df-b340b889959a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1e986895acb481888fdeb7364e0c5e0'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:36.903417 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5d653c2f-0c03-4fae-b8df-b340b889959a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1e986895acb481888fdeb7364e0c5e0'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:36.915617 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1206/2414] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:14:36 2021] DELETE /identity/v3/users/a1e986895acb481888fdeb7364e0c5e0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:37.201890 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245822b8-f6ff-4fbb-a41e-796f165e9fd6 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:37.203297 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-245822b8-f6ff-4fbb-a41e-796f165e9fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:37.217796 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245822b8-f6ff-4fbb-a41e-796f165e9fd6 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:37.277028 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b7ccf-9e8f-478d-96cd-1895392b7a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:37.277933 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b7ccf-9e8f-478d-96cd-1895392b7a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:37.278210 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b7ccf-9e8f-478d-96cd-1895392b7a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:37.278482 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b7ccf-9e8f-478d-96cd-1895392b7a2f admin admin] PATH_INFO: `/v3/projects/70e328997fed472da81442fb6a610386` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:37.279675 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b7ccf-9e8f-478d-96cd-1895392b7a2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=70e328997fed472da81442fb6a610386)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:37.281593 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b7ccf-9e8f-478d-96cd-1895392b7a2f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:37.327172 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2d7b7ccf-9e8f-478d-96cd-1895392b7a2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70e328997fed472da81442fb6a610386', 'request_id': 'req-2d7b7ccf-9e8f-478d-96cd-1895392b7a2f'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:37.333676 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2d7b7ccf-9e8f-478d-96cd-1895392b7a2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70e328997fed472da81442fb6a610386', 'request_id': 'req-2d7b7ccf-9e8f-478d-96cd-1895392b7a2f'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:37.339397 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2d7b7ccf-9e8f-478d-96cd-1895392b7a2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70e328997fed472da81442fb6a610386', 'request_id': 'req-2d7b7ccf-9e8f-478d-96cd-1895392b7a2f'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:37.349863 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2d7b7ccf-9e8f-478d-96cd-1895392b7a2f admin admin] The token cache is being invalidate because project 70e328997fed472da81442fb6a610386 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:14:37.350150 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2d7b7ccf-9e8f-478d-96cd-1895392b7a2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:37.350879 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2d7b7ccf-9e8f-478d-96cd-1895392b7a2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:37.352407 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1209/2415] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:14:37 2021] DELETE /identity/v3/projects/70e328997fed472da81442fb6a610386 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:37.359770 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd97bd-4cf6-4033-afbe-1e531e1db030 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:37.360274 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd97bd-4cf6-4033-afbe-1e531e1db030 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:37.360374 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd97bd-4cf6-4033-afbe-1e531e1db030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:37.378104 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-6ddd97bd-4cf6-4033-afbe-1e531e1db030 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:37.379355 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-6ddd97bd-4cf6-4033-afbe-1e531e1db030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:37.435851 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1207/2416] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:14:37.443348 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b6e90-222f-4f69-a924-f52d95a9d222 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:37.443647 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b6e90-222f-4f69-a924-f52d95a9d222 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:37.443963 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b6e90-222f-4f69-a924-f52d95a9d222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:37.462132 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-b00b6e90-222f-4f69-a924-f52d95a9d222 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:37.463352 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-b00b6e90-222f-4f69-a924-f52d95a9d222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:37.471124 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1210/2417] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:37.475631 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd97bd-4cf6-4033-afbe-1e531e1db030 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:37.485102 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd97bd-4cf6-4033-afbe-1e531e1db030 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:37.489659 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5a077-aeb2-455c-87e0-f0580d65b916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:37.490302 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5a077-aeb2-455c-87e0-f0580d65b916 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:37.490585 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5a077-aeb2-455c-87e0-f0580d65b916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:37.491458 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5a077-aeb2-455c-87e0-f0580d65b916 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:37.492222 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5a077-aeb2-455c-87e0-f0580d65b916 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:14:37.492528 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5a077-aeb2-455c-87e0-f0580d65b916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:37.494173 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5a077-aeb2-455c-87e0-f0580d65b916 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:37.505119 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1208/2418] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:14:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:14:37.509758 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b6e90-222f-4f69-a924-f52d95a9d222 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:37.518757 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b6e90-222f-4f69-a924-f52d95a9d222 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:37.523387 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42186ba-571c-4aa1-b8ca-65609ca24d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:37.524017 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42186ba-571c-4aa1-b8ca-65609ca24d5b admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:37.524299 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42186ba-571c-4aa1-b8ca-65609ca24d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:37.524573 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42186ba-571c-4aa1-b8ca-65609ca24d5b admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:37.525275 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42186ba-571c-4aa1-b8ca-65609ca24d5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:37.527202 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42186ba-571c-4aa1-b8ca-65609ca24d5b admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:37.552741 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1211/2419] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:14:37 2021] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:14:37.557442 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5a077-aeb2-455c-87e0-f0580d65b916 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:37.567269 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5a077-aeb2-455c-87e0-f0580d65b916 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:37.624411 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca8912-8050-4066-b552-04ce21a0bf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:37.625108 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca8912-8050-4066-b552-04ce21a0bf19 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:37.625422 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca8912-8050-4066-b552-04ce21a0bf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:37.625698 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca8912-8050-4066-b552-04ce21a0bf19 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:37.626408 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca8912-8050-4066-b552-04ce21a0bf19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:37.628361 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca8912-8050-4066-b552-04ce21a0bf19 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:37.648296 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1209/2420] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:14:37 2021] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:14:37.652357 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42186ba-571c-4aa1-b8ca-65609ca24d5b admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:37.663429 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42186ba-571c-4aa1-b8ca-65609ca24d5b admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:37.668392 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e554976-6bfb-41be-9681-9c1de2f85438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:37.669043 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e554976-6bfb-41be-9681-9c1de2f85438 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:37.669325 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e554976-6bfb-41be-9681-9c1de2f85438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:37.669652 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e554976-6bfb-41be-9681-9c1de2f85438 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:37.670396 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e554976-6bfb-41be-9681-9c1de2f85438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:37.672016 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e554976-6bfb-41be-9681-9c1de2f85438 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:37.683105 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1212/2421] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:37 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:14:37.687046 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca8912-8050-4066-b552-04ce21a0bf19 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:37.697417 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca8912-8050-4066-b552-04ce21a0bf19 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:37.702226 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcdddf-6686-4c7d-9ade-1e64782f9b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:37.702870 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcdddf-6686-4c7d-9ade-1e64782f9b35 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:37.703154 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcdddf-6686-4c7d-9ade-1e64782f9b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:37.703430 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcdddf-6686-4c7d-9ade-1e64782f9b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:37.704160 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcdddf-6686-4c7d-9ade-1e64782f9b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:37.705805 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcdddf-6686-4c7d-9ade-1e64782f9b35 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:37.715584 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1210/2422] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:37 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:14:37.719632 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e554976-6bfb-41be-9681-9c1de2f85438 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:37.729905 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e554976-6bfb-41be-9681-9c1de2f85438 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:37.734526 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45677100-5889-4c71-9925-b2ecf74e723a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:37.735379 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45677100-5889-4c71-9925-b2ecf74e723a admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:37.735658 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45677100-5889-4c71-9925-b2ecf74e723a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:37.735927 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45677100-5889-4c71-9925-b2ecf74e723a admin admin] PATH_INFO: `/v3/projects/93a14da06052423ab8bd91e54794a0d3/users/2361ab9e8b68406f937e79a34ac0899d/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:37.750578 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45677100-5889-4c71-9925-b2ecf74e723a admin admin] RBAC: Authorizing `identity:create_grant(project_id=93a14da06052423ab8bd91e54794a0d3, user_id=2361ab9e8b68406f937e79a34ac0899d, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:37.753207 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45677100-5889-4c71-9925-b2ecf74e723a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:37.765361 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1213/2423] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:14:37 2021] PUT /identity/v3/projects/93a14da06052423ab8bd91e54794a0d3/users/2361ab9e8b68406f937e79a34ac0899d/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:14:37.776018 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d18d3-91fb-4d56-8ba5-201567a51be2 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:37.776313 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d18d3-91fb-4d56-8ba5-201567a51be2 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:37.776591 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d18d3-91fb-4d56-8ba5-201567a51be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:37.802806 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-028d18d3-91fb-4d56-8ba5-201567a51be2 None None] MFA Rules not processed for user `2361ab9e8b68406f937e79a34ac0899d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:37.804594 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-028d18d3-91fb-4d56-8ba5-201567a51be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:37.865051 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1211/2424] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:37 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:37.869769 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45677100-5889-4c71-9925-b2ecf74e723a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:37.928384 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45677100-5889-4c71-9925-b2ecf74e723a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:37.933194 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aef016-310d-4d4b-99d4-14a167426d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:37.933901 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aef016-310d-4d4b-99d4-14a167426d90 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:37.934205 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aef016-310d-4d4b-99d4-14a167426d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:37.934481 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aef016-310d-4d4b-99d4-14a167426d90 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:37.935177 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aef016-310d-4d4b-99d4-14a167426d90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:37.937115 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aef016-310d-4d4b-99d4-14a167426d90 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:37.961497 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1214/2425] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:14:37 2021] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:14:37.965578 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d18d3-91fb-4d56-8ba5-201567a51be2 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:37.976927 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d18d3-91fb-4d56-8ba5-201567a51be2 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:38.029700 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b3444-8166-4ef2-ab53-f36d40f89b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:38.030359 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b3444-8166-4ef2-ab53-f36d40f89b46 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:38.030641 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b3444-8166-4ef2-ab53-f36d40f89b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:38.030918 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b3444-8166-4ef2-ab53-f36d40f89b46 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:38.031606 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b3444-8166-4ef2-ab53-f36d40f89b46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:38.033552 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b3444-8166-4ef2-ab53-f36d40f89b46 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:38.055210 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1212/2426] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:14:37 2021] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:14:38.059362 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aef016-310d-4d4b-99d4-14a167426d90 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:38.069670 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aef016-310d-4d4b-99d4-14a167426d90 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:38.074491 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f9288-8036-4cda-be9a-4070cff5985d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:38.075151 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f9288-8036-4cda-be9a-4070cff5985d admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:38.075432 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f9288-8036-4cda-be9a-4070cff5985d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:38.075708 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f9288-8036-4cda-be9a-4070cff5985d admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:38.076625 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f9288-8036-4cda-be9a-4070cff5985d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:38.078250 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f9288-8036-4cda-be9a-4070cff5985d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:38.089346 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1215/2427] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:38 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:14:38.093560 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b3444-8166-4ef2-ab53-f36d40f89b46 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:38.104110 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b3444-8166-4ef2-ab53-f36d40f89b46 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:38.108686 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fc460-bb69-4b3b-9c40-d55840801923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:38.109582 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fc460-bb69-4b3b-9c40-d55840801923 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:38.109863 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fc460-bb69-4b3b-9c40-d55840801923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:38.110138 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fc460-bb69-4b3b-9c40-d55840801923 admin admin] PATH_INFO: `/v3/projects/c375d3d6935045fd9b4103df6a80da92/users/560aefa729d943caa437543cdb22a828/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:38.124181 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fc460-bb69-4b3b-9c40-d55840801923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c375d3d6935045fd9b4103df6a80da92, user_id=560aefa729d943caa437543cdb22a828, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:38.126854 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fc460-bb69-4b3b-9c40-d55840801923 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:38.142469 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1213/2428] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:14:38 2021] PUT /identity/v3/projects/c375d3d6935045fd9b4103df6a80da92/users/560aefa729d943caa437543cdb22a828/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:38.146443 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f9288-8036-4cda-be9a-4070cff5985d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:38.156859 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f9288-8036-4cda-be9a-4070cff5985d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:38.212633 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858cfc7-b9fc-401c-947e-ea5522ca50a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:38.213368 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858cfc7-b9fc-401c-947e-ea5522ca50a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:38.213682 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858cfc7-b9fc-401c-947e-ea5522ca50a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:38.213960 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858cfc7-b9fc-401c-947e-ea5522ca50a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:38.214697 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858cfc7-b9fc-401c-947e-ea5522ca50a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:38.216290 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858cfc7-b9fc-401c-947e-ea5522ca50a6 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:38.226022 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1216/2429] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:38 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:14:38.230162 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fc460-bb69-4b3b-9c40-d55840801923 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:38.240362 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fc460-bb69-4b3b-9c40-d55840801923 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:38.244984 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57ccf8-34f2-445e-af7c-4a61854e12fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:38.245889 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57ccf8-34f2-445e-af7c-4a61854e12fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:38.246170 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57ccf8-34f2-445e-af7c-4a61854e12fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:38.246441 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57ccf8-34f2-445e-af7c-4a61854e12fa admin admin] PATH_INFO: `/v3/projects/c375d3d6935045fd9b4103df6a80da92/users/560aefa729d943caa437543cdb22a828/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:38.248584 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57ccf8-34f2-445e-af7c-4a61854e12fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c375d3d6935045fd9b4103df6a80da92, user_id=560aefa729d943caa437543cdb22a828, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:38.251369 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57ccf8-34f2-445e-af7c-4a61854e12fa admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:38.262186 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1214/2430] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:14:38 2021] PUT /identity/v3/projects/c375d3d6935045fd9b4103df6a80da92/users/560aefa729d943caa437543cdb22a828/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:38.273064 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc2118-5c25-4e79-b278-9d595e447308 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:38.273470 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc2118-5c25-4e79-b278-9d595e447308 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:38.273819 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc2118-5c25-4e79-b278-9d595e447308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:38.302146 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-65cc2118-5c25-4e79-b278-9d595e447308 None None] MFA Rules not processed for user `560aefa729d943caa437543cdb22a828`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:38.304049 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-65cc2118-5c25-4e79-b278-9d595e447308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:38.374236 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1217/2431] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:38 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:38.385113 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57ccf8-34f2-445e-af7c-4a61854e12fa admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:38.386952 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-fb57ccf8-34f2-445e-af7c-4a61854e12fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:38.443538 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57ccf8-34f2-445e-af7c-4a61854e12fa admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:38.447163 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484de8f-64dc-4439-9e3e-d863c1366ceb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:38.447797 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484de8f-64dc-4439-9e3e-d863c1366ceb service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:38.448080 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484de8f-64dc-4439-9e3e-d863c1366ceb service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:38.448356 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484de8f-64dc-4439-9e3e-d863c1366ceb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:38.457065 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484de8f-64dc-4439-9e3e-d863c1366ceb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:38.458527 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484de8f-64dc-4439-9e3e-d863c1366ceb service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:38.467639 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1215/2432] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:38 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:38.543540 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc2118-5c25-4e79-b278-9d595e447308 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:38.552924 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc2118-5c25-4e79-b278-9d595e447308 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:38.557169 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303614b-46c9-4155-ade2-35253dbccf0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:38.557827 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303614b-46c9-4155-ade2-35253dbccf0d service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:38.558105 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303614b-46c9-4155-ade2-35253dbccf0d service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:38.558375 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303614b-46c9-4155-ade2-35253dbccf0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:38.612880 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303614b-46c9-4155-ade2-35253dbccf0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:38.614345 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303614b-46c9-4155-ade2-35253dbccf0d service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:38.622917 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1218/2433] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:38 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:43.262386 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484de8f-64dc-4439-9e3e-d863c1366ceb service cinder] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:43.331165 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484de8f-64dc-4439-9e3e-d863c1366ceb service cinder] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:43.336044 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25857097-aaba-464b-8323-fa4398b5982d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:43.337266 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25857097-aaba-464b-8323-fa4398b5982d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:43.337743 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25857097-aaba-464b-8323-fa4398b5982d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:43.338204 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25857097-aaba-464b-8323-fa4398b5982d admin admin] PATH_INFO: `/v3/users/2361ab9e8b68406f937e79a34ac0899d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:43.340162 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25857097-aaba-464b-8323-fa4398b5982d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2361ab9e8b68406f937e79a34ac0899d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:43.343241 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25857097-aaba-464b-8323-fa4398b5982d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:43.388528 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-25857097-aaba-464b-8323-fa4398b5982d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2361ab9e8b68406f937e79a34ac0899d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:43.389164 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-25857097-aaba-464b-8323-fa4398b5982d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2361ab9e8b68406f937e79a34ac0899d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:43.395917 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-25857097-aaba-464b-8323-fa4398b5982d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2361ab9e8b68406f937e79a34ac0899d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:43.396554 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-25857097-aaba-464b-8323-fa4398b5982d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2361ab9e8b68406f937e79a34ac0899d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:43.408059 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-25857097-aaba-464b-8323-fa4398b5982d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2361ab9e8b68406f937e79a34ac0899d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:43.420892 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1216/2434] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:14:43 2021] DELETE /identity/v3/users/2361ab9e8b68406f937e79a34ac0899d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:43.425464 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81ea8d-1b90-47ba-b5aa-5c4e7f9b2f2c None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:43.425919 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81ea8d-1b90-47ba-b5aa-5c4e7f9b2f2c None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:43.426058 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81ea8d-1b90-47ba-b5aa-5c4e7f9b2f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:43.443847 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-4f81ea8d-1b90-47ba-b5aa-5c4e7f9b2f2c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:43.445613 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-4f81ea8d-1b90-47ba-b5aa-5c4e7f9b2f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:43.502827 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1219/2435] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:43.512757 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25857097-aaba-464b-8323-fa4398b5982d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:43.514167 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-25857097-aaba-464b-8323-fa4398b5982d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:43.570513 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25857097-aaba-464b-8323-fa4398b5982d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:43.578144 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263ba92-1803-4e71-baab-3f2b2b6bf1b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:43.578795 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263ba92-1803-4e71-baab-3f2b2b6bf1b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:43.579078 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263ba92-1803-4e71-baab-3f2b2b6bf1b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:43.579353 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263ba92-1803-4e71-baab-3f2b2b6bf1b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:43.589258 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263ba92-1803-4e71-baab-3f2b2b6bf1b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:43.590751 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263ba92-1803-4e71-baab-3f2b2b6bf1b9 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:43.609370 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1217/2436] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:43.702520 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81ea8d-1b90-47ba-b5aa-5c4e7f9b2f2c None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:43.703826 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-4f81ea8d-1b90-47ba-b5aa-5c4e7f9b2f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:43.716096 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81ea8d-1b90-47ba-b5aa-5c4e7f9b2f2c None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:43.721735 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d4137-d25b-4a52-8e5b-88a4eee14865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:43.722822 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d4137-d25b-4a52-8e5b-88a4eee14865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:43.723168 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d4137-d25b-4a52-8e5b-88a4eee14865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:43.723510 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d4137-d25b-4a52-8e5b-88a4eee14865 admin admin] PATH_INFO: `/v3/users/8a90d61b81eb4328a7d4ba8773f2d4bf` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:43.724809 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d4137-d25b-4a52-8e5b-88a4eee14865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a90d61b81eb4328a7d4ba8773f2d4bf)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:43.727544 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d4137-d25b-4a52-8e5b-88a4eee14865 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:43.781331 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b44d4137-d25b-4a52-8e5b-88a4eee14865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a90d61b81eb4328a7d4ba8773f2d4bf'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:43.782223 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b44d4137-d25b-4a52-8e5b-88a4eee14865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a90d61b81eb4328a7d4ba8773f2d4bf'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:43.782724 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b44d4137-d25b-4a52-8e5b-88a4eee14865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a90d61b81eb4328a7d4ba8773f2d4bf'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:43.795005 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b44d4137-d25b-4a52-8e5b-88a4eee14865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a90d61b81eb4328a7d4ba8773f2d4bf'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:43.804295 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b44d4137-d25b-4a52-8e5b-88a4eee14865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a90d61b81eb4328a7d4ba8773f2d4bf'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:43.817685 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1220/2437] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:14:43 2021] DELETE /identity/v3/users/8a90d61b81eb4328a7d4ba8773f2d4bf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:43.822195 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63489dc1-c894-4215-938b-7a53d034e044 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:43.822480 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63489dc1-c894-4215-938b-7a53d034e044 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:43.822750 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63489dc1-c894-4215-938b-7a53d034e044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:43.840274 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-63489dc1-c894-4215-938b-7a53d034e044 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:43.841408 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-63489dc1-c894-4215-938b-7a53d034e044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:43.878756 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d4137-d25b-4a52-8e5b-88a4eee14865 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:43.880273 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-b44d4137-d25b-4a52-8e5b-88a4eee14865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:43.907407 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1218/2438] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:43.919443 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63489dc1-c894-4215-938b-7a53d034e044 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:43.920912 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-63489dc1-c894-4215-938b-7a53d034e044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:43.947129 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d4137-d25b-4a52-8e5b-88a4eee14865 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:43.951818 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bf22c-8afa-4174-a089-df98aef9ccce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:43.952659 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bf22c-8afa-4174-a089-df98aef9ccce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:43.952935 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bf22c-8afa-4174-a089-df98aef9ccce admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:43.953207 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bf22c-8afa-4174-a089-df98aef9ccce admin admin] PATH_INFO: `/v3/projects/93a14da06052423ab8bd91e54794a0d3` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:43.954416 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8bf22c-8afa-4174-a089-df98aef9ccce admin admin] RBAC: Authorizing `identity:delete_project(project_id=93a14da06052423ab8bd91e54794a0d3)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:43.956451 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8bf22c-8afa-4174-a089-df98aef9ccce admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:43.976908 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63489dc1-c894-4215-938b-7a53d034e044 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:43.980687 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a23bf9-73c9-44fe-803c-ce57647de4ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:43.981330 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a23bf9-73c9-44fe-803c-ce57647de4ce service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:43.981645 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a23bf9-73c9-44fe-803c-ce57647de4ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:43.981920 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a23bf9-73c9-44fe-803c-ce57647de4ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:43.991839 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a23bf9-73c9-44fe-803c-ce57647de4ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:43.993321 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a23bf9-73c9-44fe-803c-ce57647de4ce service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:44.003373 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1219/2439] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:44.004840 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-cf8bf22c-8afa-4174-a089-df98aef9ccce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93a14da06052423ab8bd91e54794a0d3', 'request_id': 'req-cf8bf22c-8afa-4174-a089-df98aef9ccce'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:44.012857 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-cf8bf22c-8afa-4174-a089-df98aef9ccce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93a14da06052423ab8bd91e54794a0d3', 'request_id': 'req-cf8bf22c-8afa-4174-a089-df98aef9ccce'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:44.018607 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-cf8bf22c-8afa-4174-a089-df98aef9ccce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93a14da06052423ab8bd91e54794a0d3', 'request_id': 'req-cf8bf22c-8afa-4174-a089-df98aef9ccce'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:44.030231 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-cf8bf22c-8afa-4174-a089-df98aef9ccce admin admin] The token cache is being invalidate because project 93a14da06052423ab8bd91e54794a0d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:14:44.030523 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-cf8bf22c-8afa-4174-a089-df98aef9ccce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:44.031647 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-cf8bf22c-8afa-4174-a089-df98aef9ccce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:44.032757 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1221/2440] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:14:43 2021] DELETE /identity/v3/projects/93a14da06052423ab8bd91e54794a0d3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:14:44.036889 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a23bf9-73c9-44fe-803c-ce57647de4ce service neutron] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:44.052514 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a23bf9-73c9-44fe-803c-ce57647de4ce service neutron] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:44.115166 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18158862-4d04-4cc2-a5af-b67150842a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:44.116727 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18158862-4d04-4cc2-a5af-b67150842a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:44.117005 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18158862-4d04-4cc2-a5af-b67150842a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:44.117274 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18158862-4d04-4cc2-a5af-b67150842a20 admin admin] PATH_INFO: `/v3/users/560aefa729d943caa437543cdb22a828` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:44.119009 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18158862-4d04-4cc2-a5af-b67150842a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=560aefa729d943caa437543cdb22a828)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:44.120592 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18158862-4d04-4cc2-a5af-b67150842a20 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:44.174551 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-18158862-4d04-4cc2-a5af-b67150842a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '560aefa729d943caa437543cdb22a828'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:44.175300 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-18158862-4d04-4cc2-a5af-b67150842a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '560aefa729d943caa437543cdb22a828'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:44.182863 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-18158862-4d04-4cc2-a5af-b67150842a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '560aefa729d943caa437543cdb22a828'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:44.183624 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-18158862-4d04-4cc2-a5af-b67150842a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '560aefa729d943caa437543cdb22a828'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:44.195625 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-18158862-4d04-4cc2-a5af-b67150842a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '560aefa729d943caa437543cdb22a828'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:44.208789 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1220/2441] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:14:44 2021] DELETE /identity/v3/users/560aefa729d943caa437543cdb22a828 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:44.337221 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bf22c-8afa-4174-a089-df98aef9ccce admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:44.338839 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-cf8bf22c-8afa-4174-a089-df98aef9ccce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:44.353093 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bf22c-8afa-4174-a089-df98aef9ccce admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:44.421862 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454001d-937f-4a20-b9c1-998ddf245790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:44.422847 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454001d-937f-4a20-b9c1-998ddf245790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:44.423138 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454001d-937f-4a20-b9c1-998ddf245790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:44.423418 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454001d-937f-4a20-b9c1-998ddf245790 admin admin] PATH_INFO: `/v3/projects/a7996572f97149c6926d71541907c651` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:44.424628 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0454001d-937f-4a20-b9c1-998ddf245790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7996572f97149c6926d71541907c651)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:44.426599 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0454001d-937f-4a20-b9c1-998ddf245790 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:44.482876 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-0454001d-937f-4a20-b9c1-998ddf245790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7996572f97149c6926d71541907c651', 'request_id': 'req-0454001d-937f-4a20-b9c1-998ddf245790'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:44.490239 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-0454001d-937f-4a20-b9c1-998ddf245790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7996572f97149c6926d71541907c651', 'request_id': 'req-0454001d-937f-4a20-b9c1-998ddf245790'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:44.498747 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-0454001d-937f-4a20-b9c1-998ddf245790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7996572f97149c6926d71541907c651', 'request_id': 'req-0454001d-937f-4a20-b9c1-998ddf245790'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:44.500319 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18158862-4d04-4cc2-a5af-b67150842a20 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:44.501786 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-18158862-4d04-4cc2-a5af-b67150842a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:44.508600 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-0454001d-937f-4a20-b9c1-998ddf245790 admin admin] The token cache is being invalidate because project a7996572f97149c6926d71541907c651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:14:44.508782 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-0454001d-937f-4a20-b9c1-998ddf245790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:44.509467 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-0454001d-937f-4a20-b9c1-998ddf245790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:44.511025 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1222/2442] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:14:44 2021] DELETE /identity/v3/projects/a7996572f97149c6926d71541907c651 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:44.515643 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18158862-4d04-4cc2-a5af-b67150842a20 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:44.517948 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454001d-937f-4a20-b9c1-998ddf245790 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:44.519865 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-0454001d-937f-4a20-b9c1-998ddf245790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:44.574830 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934b9c2-9c0b-465a-9abe-5e0f289508ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:44.575711 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934b9c2-9c0b-465a-9abe-5e0f289508ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:44.575989 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934b9c2-9c0b-465a-9abe-5e0f289508ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:44.576259 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934b9c2-9c0b-465a-9abe-5e0f289508ff admin admin] PATH_INFO: `/v3/projects/c375d3d6935045fd9b4103df6a80da92` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:44.577476 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934b9c2-9c0b-465a-9abe-5e0f289508ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=c375d3d6935045fd9b4103df6a80da92)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:44.579380 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934b9c2-9c0b-465a-9abe-5e0f289508ff admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:44.583278 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454001d-937f-4a20-b9c1-998ddf245790 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:44.588991 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228a4e0-1161-48d1-a543-19ad5e86d523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:44.589881 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228a4e0-1161-48d1-a543-19ad5e86d523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:44.590160 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228a4e0-1161-48d1-a543-19ad5e86d523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:44.590557 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228a4e0-1161-48d1-a543-19ad5e86d523 admin admin] PATH_INFO: `/v3/users/98a3e2faa88a40f393cbcccc7f598252` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:44.591817 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228a4e0-1161-48d1-a543-19ad5e86d523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98a3e2faa88a40f393cbcccc7f598252)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:44.593813 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228a4e0-1161-48d1-a543-19ad5e86d523 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:44.627937 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-1934b9c2-9c0b-465a-9abe-5e0f289508ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c375d3d6935045fd9b4103df6a80da92', 'request_id': 'req-1934b9c2-9c0b-465a-9abe-5e0f289508ff'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:44.635697 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-1934b9c2-9c0b-465a-9abe-5e0f289508ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c375d3d6935045fd9b4103df6a80da92', 'request_id': 'req-1934b9c2-9c0b-465a-9abe-5e0f289508ff'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:44.641009 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-1934b9c2-9c0b-465a-9abe-5e0f289508ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c375d3d6935045fd9b4103df6a80da92', 'request_id': 'req-1934b9c2-9c0b-465a-9abe-5e0f289508ff'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:44.641616 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-6228a4e0-1161-48d1-a543-19ad5e86d523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98a3e2faa88a40f393cbcccc7f598252'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:44.642363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-6228a4e0-1161-48d1-a543-19ad5e86d523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98a3e2faa88a40f393cbcccc7f598252'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:44.643055 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-6228a4e0-1161-48d1-a543-19ad5e86d523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98a3e2faa88a40f393cbcccc7f598252'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:44.652798 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-1934b9c2-9c0b-465a-9abe-5e0f289508ff admin admin] The token cache is being invalidate because project c375d3d6935045fd9b4103df6a80da92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:14:44.653085 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-1934b9c2-9c0b-465a-9abe-5e0f289508ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:44.653722 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-1934b9c2-9c0b-465a-9abe-5e0f289508ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:44.655514 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1221/2443] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:14:44 2021] DELETE /identity/v3/projects/c375d3d6935045fd9b4103df6a80da92 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:44.655732 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-6228a4e0-1161-48d1-a543-19ad5e86d523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98a3e2faa88a40f393cbcccc7f598252'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:44.661318 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154af42f-48c1-4208-81e6-cb831a3392e0 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:44.661710 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154af42f-48c1-4208-81e6-cb831a3392e0 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:44.662009 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154af42f-48c1-4208-81e6-cb831a3392e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:44.663834 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-6228a4e0-1161-48d1-a543-19ad5e86d523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98a3e2faa88a40f393cbcccc7f598252'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:44.677064 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1223/2444] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:14:44 2021] DELETE /identity/v3/users/98a3e2faa88a40f393cbcccc7f598252 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:14:44.681866 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-154af42f-48c1-4208-81e6-cb831a3392e0 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:44.683107 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-154af42f-48c1-4208-81e6-cb831a3392e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:44.747933 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1222/2445] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:14:44.756361 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15586dc-1021-4706-958e-b33d0253e9ec None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:44.756905 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15586dc-1021-4706-958e-b33d0253e9ec None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:44.757481 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15586dc-1021-4706-958e-b33d0253e9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:44.777320 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-c15586dc-1021-4706-958e-b33d0253e9ec None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:44.778668 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c15586dc-1021-4706-958e-b33d0253e9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:44.788512 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1224/2446] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:44.792871 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154af42f-48c1-4208-81e6-cb831a3392e0 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:44.802438 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154af42f-48c1-4208-81e6-cb831a3392e0 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:44.807655 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2dd291-9e03-4d58-b7c8-30daa6a14e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:44.808305 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2dd291-9e03-4d58-b7c8-30daa6a14e75 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:44.808621 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2dd291-9e03-4d58-b7c8-30daa6a14e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:44.808860 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2dd291-9e03-4d58-b7c8-30daa6a14e75 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:44.809632 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2dd291-9e03-4d58-b7c8-30daa6a14e75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:14:44.809934 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2dd291-9e03-4d58-b7c8-30daa6a14e75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:44.811590 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2dd291-9e03-4d58-b7c8-30daa6a14e75 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:44.823311 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1223/2447] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:14:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:14:44.827383 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15586dc-1021-4706-958e-b33d0253e9ec None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:44.837471 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15586dc-1021-4706-958e-b33d0253e9ec None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:44.842312 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c7ac6-151c-46ad-ab13-02908b2bfe6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:44.842965 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c7ac6-151c-46ad-ab13-02908b2bfe6d admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:44.843251 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c7ac6-151c-46ad-ab13-02908b2bfe6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:44.843532 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c7ac6-151c-46ad-ab13-02908b2bfe6d admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:44.844257 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c7ac6-151c-46ad-ab13-02908b2bfe6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:44.846190 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c7ac6-151c-46ad-ab13-02908b2bfe6d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:44.873452 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1225/2448] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:14:44 2021] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:14:44.877847 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2dd291-9e03-4d58-b7c8-30daa6a14e75 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:44.888431 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2dd291-9e03-4d58-b7c8-30daa6a14e75 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:44.945483 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e84bb6-c45c-4b1e-adbc-ea5b13f17e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:44.946359 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e84bb6-c45c-4b1e-adbc-ea5b13f17e5d admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:44.946871 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e84bb6-c45c-4b1e-adbc-ea5b13f17e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:44.946993 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e84bb6-c45c-4b1e-adbc-ea5b13f17e5d admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:44.947708 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e84bb6-c45c-4b1e-adbc-ea5b13f17e5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:44.949986 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e84bb6-c45c-4b1e-adbc-ea5b13f17e5d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:44.955462 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c7ac6-151c-46ad-ab13-02908b2bfe6d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:44.957179 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-023c7ac6-151c-46ad-ab13-02908b2bfe6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:44.971259 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c7ac6-151c-46ad-ab13-02908b2bfe6d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:44.976415 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1224/2449] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:14:44 2021] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:14:44.977328 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e84bb6-c45c-4b1e-adbc-ea5b13f17e5d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:44.977827 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1244d45-1125-4b10-a0d3-0a27184c5a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:44.978779 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1244d45-1125-4b10-a0d3-0a27184c5a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:44.979129 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1244d45-1125-4b10-a0d3-0a27184c5a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:44.979471 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1244d45-1125-4b10-a0d3-0a27184c5a28 admin admin] PATH_INFO: `/v3/projects/367f1292448d44e4bb455fe6ae7c9b7a` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:44.980754 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1244d45-1125-4b10-a0d3-0a27184c5a28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=367f1292448d44e4bb455fe6ae7c9b7a)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:44.982770 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1244d45-1125-4b10-a0d3-0a27184c5a28 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:44.987346 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e84bb6-c45c-4b1e-adbc-ea5b13f17e5d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:44.993022 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb9aa2-b56f-40e2-9dc1-adfec4f38c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:44.993715 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb9aa2-b56f-40e2-9dc1-adfec4f38c9c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:44.993998 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb9aa2-b56f-40e2-9dc1-adfec4f38c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:44.994275 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb9aa2-b56f-40e2-9dc1-adfec4f38c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:44.995141 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb9aa2-b56f-40e2-9dc1-adfec4f38c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:44.996736 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb9aa2-b56f-40e2-9dc1-adfec4f38c9c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:45.006558 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1225/2450] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:44 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:14:45.010474 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb9aa2-b56f-40e2-9dc1-adfec4f38c9c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:45.019730 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb9aa2-b56f-40e2-9dc1-adfec4f38c9c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:45.030119 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b1244d45-1125-4b10-a0d3-0a27184c5a28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '367f1292448d44e4bb455fe6ae7c9b7a', 'request_id': 'req-b1244d45-1125-4b10-a0d3-0a27184c5a28'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:45.038722 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b1244d45-1125-4b10-a0d3-0a27184c5a28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '367f1292448d44e4bb455fe6ae7c9b7a', 'request_id': 'req-b1244d45-1125-4b10-a0d3-0a27184c5a28'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:45.044616 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b1244d45-1125-4b10-a0d3-0a27184c5a28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '367f1292448d44e4bb455fe6ae7c9b7a', 'request_id': 'req-b1244d45-1125-4b10-a0d3-0a27184c5a28'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:45.056365 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b1244d45-1125-4b10-a0d3-0a27184c5a28 admin admin] The token cache is being invalidate because project 367f1292448d44e4bb455fe6ae7c9b7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:14:45.056656 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b1244d45-1125-4b10-a0d3-0a27184c5a28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:45.057363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b1244d45-1125-4b10-a0d3-0a27184c5a28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:45.059238 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1226/2451] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:14:44 2021] DELETE /identity/v3/projects/367f1292448d44e4bb455fe6ae7c9b7a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:14:45.064479 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98e993-a6d9-4cbc-a31b-620d9414f1aa None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:45.064765 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98e993-a6d9-4cbc-a31b-620d9414f1aa None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:45.065041 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98e993-a6d9-4cbc-a31b-620d9414f1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:45.079050 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d8414-25ea-484a-b0ab-6d9be258571b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:45.080005 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d8414-25ea-484a-b0ab-6d9be258571b admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:45.080414 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d8414-25ea-484a-b0ab-6d9be258571b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:45.080698 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d8414-25ea-484a-b0ab-6d9be258571b admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:45.081473 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d8414-25ea-484a-b0ab-6d9be258571b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:45.083076 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d8414-25ea-484a-b0ab-6d9be258571b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:45.083178 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-5e98e993-a6d9-4cbc-a31b-620d9414f1aa None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:45.084339 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-5e98e993-a6d9-4cbc-a31b-620d9414f1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:45.093354 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1227/2452] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:14:45.093768 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1226/2453] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:45 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:14:45.097610 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98e993-a6d9-4cbc-a31b-620d9414f1aa None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:45.099004 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-5e98e993-a6d9-4cbc-a31b-620d9414f1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:45.101554 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be279b2-8f28-4968-ae94-4ca9001621dd None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:45.101853 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be279b2-8f28-4968-ae94-4ca9001621dd None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:45.102164 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be279b2-8f28-4968-ae94-4ca9001621dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:45.111819 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98e993-a6d9-4cbc-a31b-620d9414f1aa None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:45.116586 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e767ec-d177-44da-bae3-846d4d3322a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:45.117520 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e767ec-d177-44da-bae3-846d4d3322a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:45.117809 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e767ec-d177-44da-bae3-846d4d3322a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:45.118237 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e767ec-d177-44da-bae3-846d4d3322a0 admin admin] PATH_INFO: `/v3/projects/9449290fa7564062b7240e05b6ff7f89/users/24ad435ab0704f80ae3a62bffb72b7cd/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:45.122606 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-6be279b2-8f28-4968-ae94-4ca9001621dd None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:45.123810 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-6be279b2-8f28-4968-ae94-4ca9001621dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:45.132390 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1227/2454] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:14:45.134304 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e767ec-d177-44da-bae3-846d4d3322a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9449290fa7564062b7240e05b6ff7f89, user_id=24ad435ab0704f80ae3a62bffb72b7cd, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:45.136499 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be279b2-8f28-4968-ae94-4ca9001621dd None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:45.136963 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e767ec-d177-44da-bae3-846d4d3322a0 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:45.145884 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be279b2-8f28-4968-ae94-4ca9001621dd None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:45.151535 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1228/2455] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:14:45 2021] PUT /identity/v3/projects/9449290fa7564062b7240e05b6ff7f89/users/24ad435ab0704f80ae3a62bffb72b7cd/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:14:45.156355 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65f817-84ba-485f-83fe-53cb6084c522 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:45.156648 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65f817-84ba-485f-83fe-53cb6084c522 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:45.156924 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65f817-84ba-485f-83fe-53cb6084c522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:45.173890 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-4e65f817-84ba-485f-83fe-53cb6084c522 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:45.175087 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-4e65f817-84ba-485f-83fe-53cb6084c522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:45.202488 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426c5eb-49a4-4017-89c9-33a0e6619be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:45.203155 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426c5eb-49a4-4017-89c9-33a0e6619be4 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:45.203439 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426c5eb-49a4-4017-89c9-33a0e6619be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:45.203717 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426c5eb-49a4-4017-89c9-33a0e6619be4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:45.204448 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426c5eb-49a4-4017-89c9-33a0e6619be4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:14:45.204758 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426c5eb-49a4-4017-89c9-33a0e6619be4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:45.206438 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426c5eb-49a4-4017-89c9-33a0e6619be4 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:45.218485 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1228/2456] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:14:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:14:45.222746 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426c5eb-49a4-4017-89c9-33a0e6619be4 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:45.231509 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1229/2457] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:14:45.232863 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426c5eb-49a4-4017-89c9-33a0e6619be4 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:45.237628 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fae18d-7ff9-494b-8f23-ffae48d6848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:45.238337 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fae18d-7ff9-494b-8f23-ffae48d6848e admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:45.238627 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fae18d-7ff9-494b-8f23-ffae48d6848e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:45.238906 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fae18d-7ff9-494b-8f23-ffae48d6848e admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:45.239658 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fae18d-7ff9-494b-8f23-ffae48d6848e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:45.241502 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65f817-84ba-485f-83fe-53cb6084c522 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:45.241798 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fae18d-7ff9-494b-8f23-ffae48d6848e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:45.242970 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-4e65f817-84ba-485f-83fe-53cb6084c522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:45.273687 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1229/2458] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:14:45 2021] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:14:45.274628 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fae18d-7ff9-494b-8f23-ffae48d6848e admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:45.301116 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65f817-84ba-485f-83fe-53cb6084c522 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:45.340548 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fae18d-7ff9-494b-8f23-ffae48d6848e admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:45.345874 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220b318-03a7-4aab-b5e3-0dd33f1e3911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:45.346537 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220b318-03a7-4aab-b5e3-0dd33f1e3911 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:45.346814 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220b318-03a7-4aab-b5e3-0dd33f1e3911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:45.347094 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220b318-03a7-4aab-b5e3-0dd33f1e3911 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:45.347799 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6220b318-03a7-4aab-b5e3-0dd33f1e3911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:45.349751 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6220b318-03a7-4aab-b5e3-0dd33f1e3911 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:45.353993 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55155b37-4376-4b94-a805-521b041180ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:45.354650 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55155b37-4376-4b94-a805-521b041180ce service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:45.354938 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55155b37-4376-4b94-a805-521b041180ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:45.355215 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55155b37-4376-4b94-a805-521b041180ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:45.366305 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55155b37-4376-4b94-a805-521b041180ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:45.368018 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55155b37-4376-4b94-a805-521b041180ce service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:45.371133 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1230/2459] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:14:45 2021] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:14:45.375227 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220b318-03a7-4aab-b5e3-0dd33f1e3911 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:45.381310 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1230/2460] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:14:45.387800 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220b318-03a7-4aab-b5e3-0dd33f1e3911 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:45.392744 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbf5df-8bb6-4dec-93d1-fde2d7c97a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:45.393469 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbf5df-8bb6-4dec-93d1-fde2d7c97a41 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:45.393734 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbf5df-8bb6-4dec-93d1-fde2d7c97a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:45.394011 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbf5df-8bb6-4dec-93d1-fde2d7c97a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:45.394746 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbf5df-8bb6-4dec-93d1-fde2d7c97a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:45.396453 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbf5df-8bb6-4dec-93d1-fde2d7c97a41 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:45.408065 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1231/2461] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:45 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:14:45.412568 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55155b37-4376-4b94-a805-521b041180ce service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:45.423667 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55155b37-4376-4b94-a805-521b041180ce service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:45.436256 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82220f-be2c-45b2-a455-f9fda03c4f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:45.438036 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82220f-be2c-45b2-a455-f9fda03c4f60 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:45.438619 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82220f-be2c-45b2-a455-f9fda03c4f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:45.439408 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82220f-be2c-45b2-a455-f9fda03c4f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:45.440215 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be82220f-be2c-45b2-a455-f9fda03c4f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:45.441842 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be82220f-be2c-45b2-a455-f9fda03c4f60 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:45.456354 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1231/2462] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:45 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:14:45.457722 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbf5df-8bb6-4dec-93d1-fde2d7c97a41 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:45.470032 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbf5df-8bb6-4dec-93d1-fde2d7c97a41 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:45.485916 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614a432-40d6-46c7-8514-e817378e71f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:45.487159 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614a432-40d6-46c7-8514-e817378e71f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:45.487443 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614a432-40d6-46c7-8514-e817378e71f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:45.487718 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614a432-40d6-46c7-8514-e817378e71f1 admin admin] PATH_INFO: `/v3/projects/571091d68a324bb395f5c5ce33386bb2/users/840bca8b0ac34fc79104e7e8b2abf1ff/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:45.503734 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614a432-40d6-46c7-8514-e817378e71f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=571091d68a324bb395f5c5ce33386bb2, user_id=840bca8b0ac34fc79104e7e8b2abf1ff, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:45.507761 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614a432-40d6-46c7-8514-e817378e71f1 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:45.521271 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1232/2463] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:14:45 2021] PUT /identity/v3/projects/571091d68a324bb395f5c5ce33386bb2/users/840bca8b0ac34fc79104e7e8b2abf1ff/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:45.532369 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed707862-a2c4-425d-a92f-bb72dfb7d65b None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:45.532683 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed707862-a2c4-425d-a92f-bb72dfb7d65b None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:45.532954 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed707862-a2c4-425d-a92f-bb72dfb7d65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:45.563514 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-ed707862-a2c4-425d-a92f-bb72dfb7d65b None None] MFA Rules not processed for user `840bca8b0ac34fc79104e7e8b2abf1ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:45.564868 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-ed707862-a2c4-425d-a92f-bb72dfb7d65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:45.629759 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1232/2464] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:45 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:45.634914 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614a432-40d6-46c7-8514-e817378e71f1 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:45.707532 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614a432-40d6-46c7-8514-e817378e71f1 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:45.712726 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c4d95-acdf-474d-9030-ba8f9b42580c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:45.713405 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c4d95-acdf-474d-9030-ba8f9b42580c admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:45.713694 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c4d95-acdf-474d-9030-ba8f9b42580c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:45.713995 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c4d95-acdf-474d-9030-ba8f9b42580c admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:45.714717 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c4d95-acdf-474d-9030-ba8f9b42580c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:45.716618 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c4d95-acdf-474d-9030-ba8f9b42580c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:45.745219 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1233/2465] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:14:45 2021] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:14:45.749987 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed707862-a2c4-425d-a92f-bb72dfb7d65b None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:45.764341 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed707862-a2c4-425d-a92f-bb72dfb7d65b None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:45.830144 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8738283-d943-4430-9395-04e7e8a663cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:45.830833 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8738283-d943-4430-9395-04e7e8a663cc admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:45.831117 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8738283-d943-4430-9395-04e7e8a663cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:45.831393 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8738283-d943-4430-9395-04e7e8a663cc admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:45.832119 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8738283-d943-4430-9395-04e7e8a663cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:45.834065 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8738283-d943-4430-9395-04e7e8a663cc admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:45.857747 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1233/2466] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:14:45 2021] POST /identity/v3/users => generated 300 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:14:45.861899 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c4d95-acdf-474d-9030-ba8f9b42580c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:45.873476 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c4d95-acdf-474d-9030-ba8f9b42580c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:45.880283 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad49426-3144-4919-83d5-efe7be0c61d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:45.881169 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad49426-3144-4919-83d5-efe7be0c61d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:45.882022 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad49426-3144-4919-83d5-efe7be0c61d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:45.882448 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad49426-3144-4919-83d5-efe7be0c61d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:45.883695 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad49426-3144-4919-83d5-efe7be0c61d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:45.885438 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad49426-3144-4919-83d5-efe7be0c61d5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:45.900752 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1234/2467] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:45 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:14:45.905075 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8738283-d943-4430-9395-04e7e8a663cc admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:45.915947 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8738283-d943-4430-9395-04e7e8a663cc admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:45.920655 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050a94b-6758-49a1-95b3-023963826b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:45.921488 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050a94b-6758-49a1-95b3-023963826b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:45.922191 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050a94b-6758-49a1-95b3-023963826b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:45.922474 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050a94b-6758-49a1-95b3-023963826b35 admin admin] PATH_INFO: `/v3/projects/4e5332fb4f4440898a36175c677a8ed7/users/0df59340b9754f47af3c7af881c7cfe4/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:45.939044 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050a94b-6758-49a1-95b3-023963826b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e5332fb4f4440898a36175c677a8ed7, user_id=0df59340b9754f47af3c7af881c7cfe4, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:45.941715 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050a94b-6758-49a1-95b3-023963826b35 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:45.958406 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1234/2468] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:14:45 2021] PUT /identity/v3/projects/4e5332fb4f4440898a36175c677a8ed7/users/0df59340b9754f47af3c7af881c7cfe4/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:14:45.959631 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad49426-3144-4919-83d5-efe7be0c61d5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:45.970271 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad49426-3144-4919-83d5-efe7be0c61d5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:46.017831 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c4990-cd4d-4f21-bd04-088048cdec13 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:46.018261 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c4990-cd4d-4f21-bd04-088048cdec13 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:46.018676 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c4990-cd4d-4f21-bd04-088048cdec13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:46.035677 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8aa547-445c-4240-8801-d3ebb953971f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:46.036341 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aa547-445c-4240-8801-d3ebb953971f admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:46.036753 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aa547-445c-4240-8801-d3ebb953971f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:46.037023 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aa547-445c-4240-8801-d3ebb953971f admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:46.038242 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8aa547-445c-4240-8801-d3ebb953971f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:46.042164 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8aa547-445c-4240-8801-d3ebb953971f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:46.054437 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1235/2469] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:45 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:14:46.058597 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8aa547-445c-4240-8801-d3ebb953971f admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:46.062387 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-9e6c4990-cd4d-4f21-bd04-088048cdec13 None None] MFA Rules not processed for user `24ad435ab0704f80ae3a62bffb72b7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:46.064032 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-9e6c4990-cd4d-4f21-bd04-088048cdec13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:46.068640 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8aa547-445c-4240-8801-d3ebb953971f admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:46.074781 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75cd88-06b7-484c-b19a-ee8528bba656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:46.075678 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75cd88-06b7-484c-b19a-ee8528bba656 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:46.075957 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75cd88-06b7-484c-b19a-ee8528bba656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:46.076241 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75cd88-06b7-484c-b19a-ee8528bba656 admin admin] PATH_INFO: `/v3/projects/4e5332fb4f4440898a36175c677a8ed7/users/0df59340b9754f47af3c7af881c7cfe4/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:46.078434 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75cd88-06b7-484c-b19a-ee8528bba656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e5332fb4f4440898a36175c677a8ed7, user_id=0df59340b9754f47af3c7af881c7cfe4, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:46.081100 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75cd88-06b7-484c-b19a-ee8528bba656 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:46.093021 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1236/2470] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:14:46 2021] PUT /identity/v3/projects/4e5332fb4f4440898a36175c677a8ed7/users/0df59340b9754f47af3c7af881c7cfe4/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:14:46.104518 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fbbed-3f0b-4aa4-a06c-78627a7227c4 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:46.104810 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fbbed-3f0b-4aa4-a06c-78627a7227c4 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:46.105089 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fbbed-3f0b-4aa4-a06c-78627a7227c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:46.135074 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-0d9fbbed-3f0b-4aa4-a06c-78627a7227c4 None None] MFA Rules not processed for user `0df59340b9754f47af3c7af881c7cfe4`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:46.136351 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-0d9fbbed-3f0b-4aa4-a06c-78627a7227c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:46.148771 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1235/2471] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:46 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:46.152878 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c4990-cd4d-4f21-bd04-088048cdec13 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:46.165054 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c4990-cd4d-4f21-bd04-088048cdec13 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:46.216062 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1237/2472] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:46 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:14:46.222358 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86c2d3-760f-4eda-b846-cd43e20c2fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:46.223025 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86c2d3-760f-4eda-b846-cd43e20c2fcb admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:46.223311 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86c2d3-760f-4eda-b846-cd43e20c2fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:46.223590 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86c2d3-760f-4eda-b846-cd43e20c2fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:46.224296 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86c2d3-760f-4eda-b846-cd43e20c2fcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:46.226580 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9fbbed-3f0b-4aa4-a06c-78627a7227c4 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:46.227473 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86c2d3-760f-4eda-b846-cd43e20c2fcb admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:46.227927 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-0d9fbbed-3f0b-4aa4-a06c-78627a7227c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:46.257054 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1236/2473] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:14:46 2021] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:14:46.258263 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86c2d3-760f-4eda-b846-cd43e20c2fcb admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:46.283665 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9fbbed-3f0b-4aa4-a06c-78627a7227c4 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:46.320645 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86c2d3-760f-4eda-b846-cd43e20c2fcb admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:46.325356 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde1680-c2e4-408c-8f0b-4ca6aa9337f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:46.326044 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde1680-c2e4-408c-8f0b-4ca6aa9337f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:46.326335 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde1680-c2e4-408c-8f0b-4ca6aa9337f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:46.326613 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde1680-c2e4-408c-8f0b-4ca6aa9337f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:46.327335 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde1680-c2e4-408c-8f0b-4ca6aa9337f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:46.329241 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde1680-c2e4-408c-8f0b-4ca6aa9337f8 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:46.330181 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e81cc8-4f50-4d26-a084-d3887d6730f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:46.330832 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e81cc8-4f50-4d26-a084-d3887d6730f4 service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:46.331092 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e81cc8-4f50-4d26-a084-d3887d6730f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:46.331370 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e81cc8-4f50-4d26-a084-d3887d6730f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:46.354033 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1237/2474] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:14:46 2021] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:14:46.355080 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde1680-c2e4-408c-8f0b-4ca6aa9337f8 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:46.364395 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde1680-c2e4-408c-8f0b-4ca6aa9337f8 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:46.369588 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c92bd-95be-42fc-8545-418bd1e36887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:46.370269 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c92bd-95be-42fc-8545-418bd1e36887 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:46.370551 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c92bd-95be-42fc-8545-418bd1e36887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:46.370826 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c92bd-95be-42fc-8545-418bd1e36887 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:46.371573 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c92bd-95be-42fc-8545-418bd1e36887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:46.373143 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c92bd-95be-42fc-8545-418bd1e36887 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:46.383972 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1238/2475] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:46 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:14:46.387963 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c92bd-95be-42fc-8545-418bd1e36887 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:46.397027 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e81cc8-4f50-4d26-a084-d3887d6730f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:46.399056 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e81cc8-4f50-4d26-a084-d3887d6730f4 service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:46.402549 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c92bd-95be-42fc-8545-418bd1e36887 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:46.407950 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79d2a0-1796-48b3-ade1-3055ffcd1a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:46.408928 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1238/2476] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:46 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:14:46.409054 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79d2a0-1796-48b3-ade1-3055ffcd1a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:46.409259 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79d2a0-1796-48b3-ade1-3055ffcd1a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:46.409832 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79d2a0-1796-48b3-ade1-3055ffcd1a2e admin admin] PATH_INFO: `/v3/projects/a30f0a7c21bd406b8798e7486149c904/users/ab340f6749524fec8b05a2e85685a574/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:46.431207 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c79d2a0-1796-48b3-ade1-3055ffcd1a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a30f0a7c21bd406b8798e7486149c904, user_id=ab340f6749524fec8b05a2e85685a574, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:46.434239 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c79d2a0-1796-48b3-ade1-3055ffcd1a2e admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:46.450999 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1239/2477] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:14:46 2021] PUT /identity/v3/projects/a30f0a7c21bd406b8798e7486149c904/users/ab340f6749524fec8b05a2e85685a574/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:14:46.454807 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e81cc8-4f50-4d26-a084-d3887d6730f4 service cinder] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:46.467630 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e81cc8-4f50-4d26-a084-d3887d6730f4 service cinder] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:46.525557 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79acd35-4061-4ae5-b741-28592ff31eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:46.526236 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79acd35-4061-4ae5-b741-28592ff31eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:46.526519 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79acd35-4061-4ae5-b741-28592ff31eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:46.526789 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79acd35-4061-4ae5-b741-28592ff31eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:46.527532 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79acd35-4061-4ae5-b741-28592ff31eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:46.529124 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79acd35-4061-4ae5-b741-28592ff31eb5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:46.535739 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79d2a0-1796-48b3-ade1-3055ffcd1a2e admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:46.540844 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1239/2478] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:46 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:14:46.545121 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79acd35-4061-4ae5-b741-28592ff31eb5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:46.548499 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79d2a0-1796-48b3-ade1-3055ffcd1a2e admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:46.554950 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa336b-1f8b-4f4a-8683-dad985117c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:46.555821 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa336b-1f8b-4f4a-8683-dad985117c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:46.556068 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79acd35-4061-4ae5-b741-28592ff31eb5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:46.556201 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa336b-1f8b-4f4a-8683-dad985117c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:46.556361 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa336b-1f8b-4f4a-8683-dad985117c2d admin admin] PATH_INFO: `/v3/users/840bca8b0ac34fc79104e7e8b2abf1ff` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:46.557691 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa336b-1f8b-4f4a-8683-dad985117c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=840bca8b0ac34fc79104e7e8b2abf1ff)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:46.559734 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa336b-1f8b-4f4a-8683-dad985117c2d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:46.564061 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6019ae3-2e71-4ed5-aa11-faea412b658d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:46.565235 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6019ae3-2e71-4ed5-aa11-faea412b658d admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:46.566067 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6019ae3-2e71-4ed5-aa11-faea412b658d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:46.566459 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6019ae3-2e71-4ed5-aa11-faea412b658d admin admin] PATH_INFO: `/v3/projects/a30f0a7c21bd406b8798e7486149c904/users/ab340f6749524fec8b05a2e85685a574/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:46.569481 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6019ae3-2e71-4ed5-aa11-faea412b658d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a30f0a7c21bd406b8798e7486149c904, user_id=ab340f6749524fec8b05a2e85685a574, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:46.572123 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6019ae3-2e71-4ed5-aa11-faea412b658d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:46.583761 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1240/2479] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:14:46 2021] PUT /identity/v3/projects/a30f0a7c21bd406b8798e7486149c904/users/ab340f6749524fec8b05a2e85685a574/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:46.621599 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-77aa336b-1f8b-4f4a-8683-dad985117c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '840bca8b0ac34fc79104e7e8b2abf1ff'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:46.622787 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-77aa336b-1f8b-4f4a-8683-dad985117c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '840bca8b0ac34fc79104e7e8b2abf1ff'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:46.623405 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-77aa336b-1f8b-4f4a-8683-dad985117c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '840bca8b0ac34fc79104e7e8b2abf1ff'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:46.636642 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-77aa336b-1f8b-4f4a-8683-dad985117c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '840bca8b0ac34fc79104e7e8b2abf1ff'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:46.644972 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-77aa336b-1f8b-4f4a-8683-dad985117c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '840bca8b0ac34fc79104e7e8b2abf1ff'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:46.660401 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1240/2480] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:14:46 2021] DELETE /identity/v3/users/840bca8b0ac34fc79104e7e8b2abf1ff => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:14:46.666704 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878ae50-544e-406b-b566-8937c8a68eb6 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:46.667305 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878ae50-544e-406b-b566-8937c8a68eb6 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:46.668761 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878ae50-544e-406b-b566-8937c8a68eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:46.693616 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-6878ae50-544e-406b-b566-8937c8a68eb6 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:46.696104 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-6878ae50-544e-406b-b566-8937c8a68eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:46.756763 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1241/2481] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:46.768037 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa336b-1f8b-4f4a-8683-dad985117c2d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:46.769716 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-77aa336b-1f8b-4f4a-8683-dad985117c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:46.828813 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa336b-1f8b-4f4a-8683-dad985117c2d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:46.832603 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ee1eb-d8fd-4cea-8c88-293c5397caf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:46.833248 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ee1eb-d8fd-4cea-8c88-293c5397caf2 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:46.833570 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ee1eb-d8fd-4cea-8c88-293c5397caf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:46.833867 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ee1eb-d8fd-4cea-8c88-293c5397caf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:46.843760 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ee1eb-d8fd-4cea-8c88-293c5397caf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:46.845210 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ee1eb-d8fd-4cea-8c88-293c5397caf2 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:46.855256 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1241/2482] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:47.219739 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878ae50-544e-406b-b566-8937c8a68eb6 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:47.221194 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-6878ae50-544e-406b-b566-8937c8a68eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:47.252236 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878ae50-544e-406b-b566-8937c8a68eb6 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:47.257899 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33006051-46c2-42a4-9e89-ff5c33506109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:47.258889 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33006051-46c2-42a4-9e89-ff5c33506109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:47.259171 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33006051-46c2-42a4-9e89-ff5c33506109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:47.259445 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33006051-46c2-42a4-9e89-ff5c33506109 admin admin] PATH_INFO: `/v3/projects/571091d68a324bb395f5c5ce33386bb2` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:47.260675 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33006051-46c2-42a4-9e89-ff5c33506109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=571091d68a324bb395f5c5ce33386bb2)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:47.262852 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33006051-46c2-42a4-9e89-ff5c33506109 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:47.298278 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26793851-6e32-49b5-bc98-8c7263272a02 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:47.298671 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26793851-6e32-49b5-bc98-8c7263272a02 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:47.299001 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26793851-6e32-49b5-bc98-8c7263272a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:47.317613 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-33006051-46c2-42a4-9e89-ff5c33506109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '571091d68a324bb395f5c5ce33386bb2', 'request_id': 'req-33006051-46c2-42a4-9e89-ff5c33506109'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:47.329155 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-33006051-46c2-42a4-9e89-ff5c33506109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '571091d68a324bb395f5c5ce33386bb2', 'request_id': 'req-33006051-46c2-42a4-9e89-ff5c33506109'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:47.331787 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-26793851-6e32-49b5-bc98-8c7263272a02 None None] MFA Rules not processed for user `ab340f6749524fec8b05a2e85685a574`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:47.333138 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-26793851-6e32-49b5-bc98-8c7263272a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:47.335904 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-33006051-46c2-42a4-9e89-ff5c33506109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '571091d68a324bb395f5c5ce33386bb2', 'request_id': 'req-33006051-46c2-42a4-9e89-ff5c33506109'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:47.347642 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-33006051-46c2-42a4-9e89-ff5c33506109 admin admin] The token cache is being invalidate because project 571091d68a324bb395f5c5ce33386bb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:14:47.347929 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-33006051-46c2-42a4-9e89-ff5c33506109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:47.348689 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-33006051-46c2-42a4-9e89-ff5c33506109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:47.351220 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1242/2483] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:14:47 2021] DELETE /identity/v3/projects/571091d68a324bb395f5c5ce33386bb2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:47.355444 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33006051-46c2-42a4-9e89-ff5c33506109 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:47.356829 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-33006051-46c2-42a4-9e89-ff5c33506109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:47.412540 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1242/2484] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:47 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:14:47.423418 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26793851-6e32-49b5-bc98-8c7263272a02 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:47.424032 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33006051-46c2-42a4-9e89-ff5c33506109 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:47.425120 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-26793851-6e32-49b5-bc98-8c7263272a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:47.429861 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da03eba-ab25-45d0-81a1-3b1163a2ff12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:47.430759 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da03eba-ab25-45d0-81a1-3b1163a2ff12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:47.431047 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da03eba-ab25-45d0-81a1-3b1163a2ff12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:47.431325 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da03eba-ab25-45d0-81a1-3b1163a2ff12 admin admin] PATH_INFO: `/v3/users/0df59340b9754f47af3c7af881c7cfe4` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:47.432563 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da03eba-ab25-45d0-81a1-3b1163a2ff12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df59340b9754f47af3c7af881c7cfe4)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:47.434543 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da03eba-ab25-45d0-81a1-3b1163a2ff12 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:47.488942 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4da03eba-ab25-45d0-81a1-3b1163a2ff12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df59340b9754f47af3c7af881c7cfe4'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:47.489658 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4da03eba-ab25-45d0-81a1-3b1163a2ff12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df59340b9754f47af3c7af881c7cfe4'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:47.497620 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4da03eba-ab25-45d0-81a1-3b1163a2ff12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df59340b9754f47af3c7af881c7cfe4'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:47.498305 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4da03eba-ab25-45d0-81a1-3b1163a2ff12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df59340b9754f47af3c7af881c7cfe4'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:47.498949 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26793851-6e32-49b5-bc98-8c7263272a02 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:47.502739 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eba197-e089-440a-9445-0d7909fa3b53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:47.503384 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eba197-e089-440a-9445-0d7909fa3b53 service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:47.503673 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eba197-e089-440a-9445-0d7909fa3b53 service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:47.503949 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eba197-e089-440a-9445-0d7909fa3b53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:47.505774 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-81eba197-e089-440a-9445-0d7909fa3b53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:47.509841 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4da03eba-ab25-45d0-81a1-3b1163a2ff12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df59340b9754f47af3c7af881c7cfe4'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:47.523257 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1243/2485] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:14:47 2021] DELETE /identity/v3/users/0df59340b9754f47af3c7af881c7cfe4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:14:47.564970 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eba197-e089-440a-9445-0d7909fa3b53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:47.566450 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eba197-e089-440a-9445-0d7909fa3b53 service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:47.576008 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1243/2486] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:47 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:14:47.821950 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da03eba-ab25-45d0-81a1-3b1163a2ff12 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:47.823995 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-4da03eba-ab25-45d0-81a1-3b1163a2ff12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:47.923036 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da03eba-ab25-45d0-81a1-3b1163a2ff12 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:47.927746 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef76f3-9552-4a10-b02b-2e1ba22562ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:47.929250 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef76f3-9552-4a10-b02b-2e1ba22562ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:47.929634 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef76f3-9552-4a10-b02b-2e1ba22562ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:47.929996 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef76f3-9552-4a10-b02b-2e1ba22562ab admin admin] PATH_INFO: `/v3/projects/4e5332fb4f4440898a36175c677a8ed7` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:47.931282 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef76f3-9552-4a10-b02b-2e1ba22562ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e5332fb4f4440898a36175c677a8ed7)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:47.933268 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef76f3-9552-4a10-b02b-2e1ba22562ab admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:47.982116 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-eaef76f3-9552-4a10-b02b-2e1ba22562ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e5332fb4f4440898a36175c677a8ed7', 'request_id': 'req-eaef76f3-9552-4a10-b02b-2e1ba22562ab'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:47.992374 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-eaef76f3-9552-4a10-b02b-2e1ba22562ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e5332fb4f4440898a36175c677a8ed7', 'request_id': 'req-eaef76f3-9552-4a10-b02b-2e1ba22562ab'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:47.997843 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-eaef76f3-9552-4a10-b02b-2e1ba22562ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e5332fb4f4440898a36175c677a8ed7', 'request_id': 'req-eaef76f3-9552-4a10-b02b-2e1ba22562ab'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:48.008694 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-eaef76f3-9552-4a10-b02b-2e1ba22562ab admin admin] The token cache is being invalidate because project 4e5332fb4f4440898a36175c677a8ed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:14:48.008916 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-eaef76f3-9552-4a10-b02b-2e1ba22562ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:48.009597 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-eaef76f3-9552-4a10-b02b-2e1ba22562ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:48.011112 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1244/2487] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:14:47 2021] DELETE /identity/v3/projects/4e5332fb4f4440898a36175c677a8ed7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:48.017133 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de05943-3dce-44f3-90d4-d88169c144f9 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:48.017452 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de05943-3dce-44f3-90d4-d88169c144f9 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:48.017725 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de05943-3dce-44f3-90d4-d88169c144f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:48.035288 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-4de05943-3dce-44f3-90d4-d88169c144f9 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:48.036469 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-4de05943-3dce-44f3-90d4-d88169c144f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:48.092536 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1244/2488] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:48.100013 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9eb25-c6ea-4a37-a04a-93d6327b2fd6 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:48.100832 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9eb25-c6ea-4a37-a04a-93d6327b2fd6 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:48.101106 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9eb25-c6ea-4a37-a04a-93d6327b2fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:48.120347 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-6ce9eb25-c6ea-4a37-a04a-93d6327b2fd6 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:48.121610 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-6ce9eb25-c6ea-4a37-a04a-93d6327b2fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:48.129304 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1245/2489] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:48.133666 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de05943-3dce-44f3-90d4-d88169c144f9 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:48.143962 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de05943-3dce-44f3-90d4-d88169c144f9 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:48.148559 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453f95f-373b-488b-937e-9d3544233e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:48.149208 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453f95f-373b-488b-937e-9d3544233e02 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:48.149529 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453f95f-373b-488b-937e-9d3544233e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:48.149836 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453f95f-373b-488b-937e-9d3544233e02 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:48.150611 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453f95f-373b-488b-937e-9d3544233e02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:14:48.150916 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453f95f-373b-488b-937e-9d3544233e02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:48.152564 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453f95f-373b-488b-937e-9d3544233e02 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:48.166514 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1245/2490] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:14:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:14:48.170772 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9eb25-c6ea-4a37-a04a-93d6327b2fd6 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:48.180829 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9eb25-c6ea-4a37-a04a-93d6327b2fd6 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:48.185479 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef8c95-6b50-4170-ad78-26be6c53ef5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:48.186232 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef8c95-6b50-4170-ad78-26be6c53ef5e admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:48.186512 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef8c95-6b50-4170-ad78-26be6c53ef5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:48.186782 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef8c95-6b50-4170-ad78-26be6c53ef5e admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:48.187527 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef8c95-6b50-4170-ad78-26be6c53ef5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:48.189448 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef8c95-6b50-4170-ad78-26be6c53ef5e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:48.213774 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1246/2491] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:14:48 2021] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:14:48.217790 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453f95f-373b-488b-937e-9d3544233e02 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:48.228062 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453f95f-373b-488b-937e-9d3544233e02 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:48.281936 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffe70c-66a7-47cb-a394-d3475398b1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:48.282514 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffe70c-66a7-47cb-a394-d3475398b1d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:48.282794 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffe70c-66a7-47cb-a394-d3475398b1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:48.283067 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffe70c-66a7-47cb-a394-d3475398b1d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:48.283988 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffe70c-66a7-47cb-a394-d3475398b1d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:48.286203 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffe70c-66a7-47cb-a394-d3475398b1d5 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:48.304572 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1246/2492] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:14:48 2021] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:14:48.308660 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef8c95-6b50-4170-ad78-26be6c53ef5e admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:48.319462 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef8c95-6b50-4170-ad78-26be6c53ef5e admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:48.324266 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef77cb-6a92-43c1-ad02-add5080cdbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:48.324914 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef77cb-6a92-43c1-ad02-add5080cdbdd admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:48.325218 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef77cb-6a92-43c1-ad02-add5080cdbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:48.325523 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef77cb-6a92-43c1-ad02-add5080cdbdd admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:48.326260 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef77cb-6a92-43c1-ad02-add5080cdbdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:48.327872 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef77cb-6a92-43c1-ad02-add5080cdbdd admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:48.338651 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1247/2493] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:48 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:14:48.342551 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffe70c-66a7-47cb-a394-d3475398b1d5 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:48.352388 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffe70c-66a7-47cb-a394-d3475398b1d5 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:48.357114 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea87665-b3b8-48ce-bc6e-89296de1a694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:48.357794 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea87665-b3b8-48ce-bc6e-89296de1a694 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:48.358082 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea87665-b3b8-48ce-bc6e-89296de1a694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:48.358356 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea87665-b3b8-48ce-bc6e-89296de1a694 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:48.359093 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea87665-b3b8-48ce-bc6e-89296de1a694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:48.360692 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea87665-b3b8-48ce-bc6e-89296de1a694 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:48.371406 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1247/2494] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:48 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:14:48.375534 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef77cb-6a92-43c1-ad02-add5080cdbdd admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:48.386445 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef77cb-6a92-43c1-ad02-add5080cdbdd admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:48.391071 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf5698-ebb9-402f-bb52-53c853134735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:48.391948 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf5698-ebb9-402f-bb52-53c853134735 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:48.392216 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf5698-ebb9-402f-bb52-53c853134735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:48.392488 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf5698-ebb9-402f-bb52-53c853134735 admin admin] PATH_INFO: `/v3/projects/33752336deb448bb833de022549168d4/users/c9601fb8e7ba4924ac03a48af367ae15/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:48.406657 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf5698-ebb9-402f-bb52-53c853134735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33752336deb448bb833de022549168d4, user_id=c9601fb8e7ba4924ac03a48af367ae15, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:48.409297 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf5698-ebb9-402f-bb52-53c853134735 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:48.421953 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1248/2495] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:14:48 2021] PUT /identity/v3/projects/33752336deb448bb833de022549168d4/users/c9601fb8e7ba4924ac03a48af367ae15/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:48.432428 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fd854-8d03-4563-80b8-b02e03f089f8 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:48.432790 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fd854-8d03-4563-80b8-b02e03f089f8 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:48.433138 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fd854-8d03-4563-80b8-b02e03f089f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:48.459162 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-c22fd854-8d03-4563-80b8-b02e03f089f8 None None] MFA Rules not processed for user `c9601fb8e7ba4924ac03a48af367ae15`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:48.460419 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c22fd854-8d03-4563-80b8-b02e03f089f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:48.524005 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1248/2496] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:48 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:48.529085 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf5698-ebb9-402f-bb52-53c853134735 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:48.590783 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf5698-ebb9-402f-bb52-53c853134735 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:48.595438 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b737a-d313-4e96-af71-dae03d0755c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:48.596087 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b737a-d313-4e96-af71-dae03d0755c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:48.596366 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b737a-d313-4e96-af71-dae03d0755c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:48.596637 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b737a-d313-4e96-af71-dae03d0755c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:48.597327 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b737a-d313-4e96-af71-dae03d0755c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:48.599523 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b737a-d313-4e96-af71-dae03d0755c5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:48.628082 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1249/2497] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:14:48 2021] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:14:48.629108 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fd854-8d03-4563-80b8-b02e03f089f8 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:48.640499 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fd854-8d03-4563-80b8-b02e03f089f8 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:48.698531 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b9733-9682-4634-9fce-15e85c0050cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:48.700182 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b9733-9682-4634-9fce-15e85c0050cd admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:48.700294 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b9733-9682-4634-9fce-15e85c0050cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:48.700596 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b9733-9682-4634-9fce-15e85c0050cd admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:48.701421 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b9733-9682-4634-9fce-15e85c0050cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:48.703408 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b9733-9682-4634-9fce-15e85c0050cd admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:48.727945 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1249/2498] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:14:48 2021] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:14:48.729513 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b737a-d313-4e96-af71-dae03d0755c5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:48.739593 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b737a-d313-4e96-af71-dae03d0755c5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:48.744398 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e7688-8297-453c-a141-e77a916812c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:48.745075 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e7688-8297-453c-a141-e77a916812c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:48.745359 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e7688-8297-453c-a141-e77a916812c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:48.745689 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e7688-8297-453c-a141-e77a916812c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:48.746422 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e7688-8297-453c-a141-e77a916812c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:48.748027 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e7688-8297-453c-a141-e77a916812c5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:48.758580 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1250/2499] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:48 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:14:48.762828 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b9733-9682-4634-9fce-15e85c0050cd admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:48.773533 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b9733-9682-4634-9fce-15e85c0050cd admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:48.778351 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ad516-1533-4724-8d66-156e29f97ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:48.779278 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ad516-1533-4724-8d66-156e29f97ad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:48.779621 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ad516-1533-4724-8d66-156e29f97ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:48.779997 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ad516-1533-4724-8d66-156e29f97ad4 admin admin] PATH_INFO: `/v3/projects/19f89b8b616e4be0b6b2856ab66ce922/users/860c7af8f5354a2f9ba2eee0813fdd5a/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:48.795980 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ad516-1533-4724-8d66-156e29f97ad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f89b8b616e4be0b6b2856ab66ce922, user_id=860c7af8f5354a2f9ba2eee0813fdd5a, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:48.798650 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ad516-1533-4724-8d66-156e29f97ad4 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:48.814936 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1250/2500] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:14:48 2021] PUT /identity/v3/projects/19f89b8b616e4be0b6b2856ab66ce922/users/860c7af8f5354a2f9ba2eee0813fdd5a/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:48.820229 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e7688-8297-453c-a141-e77a916812c5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:48.831489 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e7688-8297-453c-a141-e77a916812c5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:48.889705 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938adc0-f652-485c-8c47-f77d76d0c702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:48.890380 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938adc0-f652-485c-8c47-f77d76d0c702 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:48.890667 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938adc0-f652-485c-8c47-f77d76d0c702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:48.890949 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938adc0-f652-485c-8c47-f77d76d0c702 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:48.891718 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938adc0-f652-485c-8c47-f77d76d0c702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:48.893499 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938adc0-f652-485c-8c47-f77d76d0c702 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:48.907001 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1251/2501] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:48 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:14:48.911967 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ad516-1533-4724-8d66-156e29f97ad4 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:48.922345 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ad516-1533-4724-8d66-156e29f97ad4 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:48.927138 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15145199-b55f-4c09-b8f9-c8612ef702ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:48.928012 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15145199-b55f-4c09-b8f9-c8612ef702ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:48.928352 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15145199-b55f-4c09-b8f9-c8612ef702ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:48.928628 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15145199-b55f-4c09-b8f9-c8612ef702ed admin admin] PATH_INFO: `/v3/projects/19f89b8b616e4be0b6b2856ab66ce922/users/860c7af8f5354a2f9ba2eee0813fdd5a/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:48.930862 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15145199-b55f-4c09-b8f9-c8612ef702ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f89b8b616e4be0b6b2856ab66ce922, user_id=860c7af8f5354a2f9ba2eee0813fdd5a, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:48.933693 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15145199-b55f-4c09-b8f9-c8612ef702ed admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:48.944998 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1251/2502] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:14:48 2021] PUT /identity/v3/projects/19f89b8b616e4be0b6b2856ab66ce922/users/860c7af8f5354a2f9ba2eee0813fdd5a/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:48.955978 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92820ad7-7d5a-4ef8-93c7-9e047841b28b None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:48.956338 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92820ad7-7d5a-4ef8-93c7-9e047841b28b None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:48.956692 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92820ad7-7d5a-4ef8-93c7-9e047841b28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:48.980544 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15145199-b55f-4c09-b8f9-c8612ef702ed admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:48.982567 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-15145199-b55f-4c09-b8f9-c8612ef702ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:48.985305 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-92820ad7-7d5a-4ef8-93c7-9e047841b28b None None] MFA Rules not processed for user `860c7af8f5354a2f9ba2eee0813fdd5a`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:48.986621 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-92820ad7-7d5a-4ef8-93c7-9e047841b28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:49.068099 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1252/2503] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:48 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:49.073183 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15145199-b55f-4c09-b8f9-c8612ef702ed admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:49.077000 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d32cd-87c2-443f-80b6-65a3d0bec945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:49.077676 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d32cd-87c2-443f-80b6-65a3d0bec945 service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:49.077958 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d32cd-87c2-443f-80b6-65a3d0bec945 service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:49.078229 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d32cd-87c2-443f-80b6-65a3d0bec945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:49.079792 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92820ad7-7d5a-4ef8-93c7-9e047841b28b None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:49.080543 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-a41d32cd-87c2-443f-80b6-65a3d0bec945 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:49.081138 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-92820ad7-7d5a-4ef8-93c7-9e047841b28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:49.094792 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92820ad7-7d5a-4ef8-93c7-9e047841b28b None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:49.099382 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2fae6-326d-461b-8e05-55956276f8e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:49.100033 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2fae6-326d-461b-8e05-55956276f8e2 service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:49.100511 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2fae6-326d-461b-8e05-55956276f8e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:49.100792 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2fae6-326d-461b-8e05-55956276f8e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:49.111229 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2fae6-326d-461b-8e05-55956276f8e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:49.112838 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2fae6-326d-461b-8e05-55956276f8e2 service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:49.124433 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1253/2504] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:49 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:14:49.157114 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d32cd-87c2-443f-80b6-65a3d0bec945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:49.158614 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d32cd-87c2-443f-80b6-65a3d0bec945 service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:49.170429 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1252/2505] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:48 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:14:49.211757 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2fae6-326d-461b-8e05-55956276f8e2 service cinder] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:49.222309 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2fae6-326d-461b-8e05-55956276f8e2 service cinder] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:49.227870 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f28012-9967-44a9-aee9-190b8da0e746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:49.228647 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f28012-9967-44a9-aee9-190b8da0e746 service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:49.229061 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f28012-9967-44a9-aee9-190b8da0e746 service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:49.229515 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f28012-9967-44a9-aee9-190b8da0e746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:49.309622 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f28012-9967-44a9-aee9-190b8da0e746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:49.312010 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f28012-9967-44a9-aee9-190b8da0e746 service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:49.328576 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1254/2506] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:49 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:49.629681 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d32cd-87c2-443f-80b6-65a3d0bec945 service cinder] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:49.707676 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d32cd-87c2-443f-80b6-65a3d0bec945 service cinder] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:49.713879 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbfecd-f2fe-4551-b5bc-89b91aa340c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:49.714744 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbfecd-f2fe-4551-b5bc-89b91aa340c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:49.715065 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbfecd-f2fe-4551-b5bc-89b91aa340c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:49.715320 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbfecd-f2fe-4551-b5bc-89b91aa340c4 admin admin] PATH_INFO: `/v3/users/c9601fb8e7ba4924ac03a48af367ae15` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:49.716536 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbfecd-f2fe-4551-b5bc-89b91aa340c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9601fb8e7ba4924ac03a48af367ae15)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:49.718510 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbfecd-f2fe-4551-b5bc-89b91aa340c4 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:49.764837 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-bcfbfecd-f2fe-4551-b5bc-89b91aa340c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9601fb8e7ba4924ac03a48af367ae15'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:49.765622 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-bcfbfecd-f2fe-4551-b5bc-89b91aa340c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9601fb8e7ba4924ac03a48af367ae15'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:49.766235 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-bcfbfecd-f2fe-4551-b5bc-89b91aa340c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9601fb8e7ba4924ac03a48af367ae15'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:49.777892 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-bcfbfecd-f2fe-4551-b5bc-89b91aa340c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9601fb8e7ba4924ac03a48af367ae15'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:49.785764 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-bcfbfecd-f2fe-4551-b5bc-89b91aa340c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9601fb8e7ba4924ac03a48af367ae15'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:49.798896 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1253/2507] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:14:49 2021] DELETE /identity/v3/users/c9601fb8e7ba4924ac03a48af367ae15 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:49.803113 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422549c-7b23-4e26-b293-2f932b42cb34 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:49.803505 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422549c-7b23-4e26-b293-2f932b42cb34 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:49.803978 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422549c-7b23-4e26-b293-2f932b42cb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:49.824284 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-7422549c-7b23-4e26-b293-2f932b42cb34 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:49.825535 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-7422549c-7b23-4e26-b293-2f932b42cb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:49.888319 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1255/2508] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:14:49.899181 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbfecd-f2fe-4551-b5bc-89b91aa340c4 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:49.901285 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-bcfbfecd-f2fe-4551-b5bc-89b91aa340c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:49.966637 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbfecd-f2fe-4551-b5bc-89b91aa340c4 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:49.970677 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a72a60-cc26-42dd-8fdb-ccd6f7c94297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:49.971336 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a72a60-cc26-42dd-8fdb-ccd6f7c94297 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:49.971642 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a72a60-cc26-42dd-8fdb-ccd6f7c94297 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:49.971915 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a72a60-cc26-42dd-8fdb-ccd6f7c94297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:49.981663 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a72a60-cc26-42dd-8fdb-ccd6f7c94297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:49.983081 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a72a60-cc26-42dd-8fdb-ccd6f7c94297 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:49.993173 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1254/2509] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:50.266622 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422549c-7b23-4e26-b293-2f932b42cb34 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:50.268030 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-7422549c-7b23-4e26-b293-2f932b42cb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:50.283355 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422549c-7b23-4e26-b293-2f932b42cb34 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:50.290814 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae07ee-e985-42c5-b738-48bdae17dcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:50.291676 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae07ee-e985-42c5-b738-48bdae17dcd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:50.291965 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae07ee-e985-42c5-b738-48bdae17dcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:50.292239 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae07ee-e985-42c5-b738-48bdae17dcd9 admin admin] PATH_INFO: `/v3/projects/33752336deb448bb833de022549168d4` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:50.293465 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae07ee-e985-42c5-b738-48bdae17dcd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33752336deb448bb833de022549168d4)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:50.295439 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae07ee-e985-42c5-b738-48bdae17dcd9 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:50.341332 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-9fae07ee-e985-42c5-b738-48bdae17dcd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33752336deb448bb833de022549168d4', 'request_id': 'req-9fae07ee-e985-42c5-b738-48bdae17dcd9'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:50.348610 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-9fae07ee-e985-42c5-b738-48bdae17dcd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33752336deb448bb833de022549168d4', 'request_id': 'req-9fae07ee-e985-42c5-b738-48bdae17dcd9'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:50.354118 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-9fae07ee-e985-42c5-b738-48bdae17dcd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33752336deb448bb833de022549168d4', 'request_id': 'req-9fae07ee-e985-42c5-b738-48bdae17dcd9'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:50.364775 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-9fae07ee-e985-42c5-b738-48bdae17dcd9 admin admin] The token cache is being invalidate because project 33752336deb448bb833de022549168d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:14:50.365065 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-9fae07ee-e985-42c5-b738-48bdae17dcd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:50.365697 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-9fae07ee-e985-42c5-b738-48bdae17dcd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:50.367503 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1256/2510] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:14:50 2021] DELETE /identity/v3/projects/33752336deb448bb833de022549168d4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:50.371400 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a72a60-cc26-42dd-8fdb-ccd6f7c94297 service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:50.380942 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a72a60-cc26-42dd-8fdb-ccd6f7c94297 service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:50.447200 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7cac9a-9355-47a0-b38f-28a728e73497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:50.447970 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cac9a-9355-47a0-b38f-28a728e73497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:50.448246 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cac9a-9355-47a0-b38f-28a728e73497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:50.448521 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cac9a-9355-47a0-b38f-28a728e73497 admin admin] PATH_INFO: `/v3/users/860c7af8f5354a2f9ba2eee0813fdd5a` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:50.449752 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7cac9a-9355-47a0-b38f-28a728e73497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=860c7af8f5354a2f9ba2eee0813fdd5a)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:50.451659 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7cac9a-9355-47a0-b38f-28a728e73497 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:50.502579 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-9b7cac9a-9355-47a0-b38f-28a728e73497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '860c7af8f5354a2f9ba2eee0813fdd5a'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:50.503395 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-9b7cac9a-9355-47a0-b38f-28a728e73497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '860c7af8f5354a2f9ba2eee0813fdd5a'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:50.504064 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-9b7cac9a-9355-47a0-b38f-28a728e73497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '860c7af8f5354a2f9ba2eee0813fdd5a'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:50.516513 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-9b7cac9a-9355-47a0-b38f-28a728e73497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '860c7af8f5354a2f9ba2eee0813fdd5a'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:50.525295 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-9b7cac9a-9355-47a0-b38f-28a728e73497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '860c7af8f5354a2f9ba2eee0813fdd5a'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:50.540428 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1255/2511] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:14:50 2021] DELETE /identity/v3/users/860c7af8f5354a2f9ba2eee0813fdd5a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:50.845268 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae07ee-e985-42c5-b738-48bdae17dcd9 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:50.847092 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-9fae07ee-e985-42c5-b738-48bdae17dcd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:50.862853 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae07ee-e985-42c5-b738-48bdae17dcd9 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:50.921206 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553345c-cdcb-484d-8410-aa181cc7b032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:50.922092 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553345c-cdcb-484d-8410-aa181cc7b032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:50.922378 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553345c-cdcb-484d-8410-aa181cc7b032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:50.922656 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553345c-cdcb-484d-8410-aa181cc7b032 admin admin] PATH_INFO: `/v3/projects/19f89b8b616e4be0b6b2856ab66ce922` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:50.923851 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4553345c-cdcb-484d-8410-aa181cc7b032 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f89b8b616e4be0b6b2856ab66ce922)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:50.925848 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4553345c-cdcb-484d-8410-aa181cc7b032 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:50.970681 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4553345c-cdcb-484d-8410-aa181cc7b032 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f89b8b616e4be0b6b2856ab66ce922', 'request_id': 'req-4553345c-cdcb-484d-8410-aa181cc7b032'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:50.978180 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4553345c-cdcb-484d-8410-aa181cc7b032 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f89b8b616e4be0b6b2856ab66ce922', 'request_id': 'req-4553345c-cdcb-484d-8410-aa181cc7b032'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:50.983733 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4553345c-cdcb-484d-8410-aa181cc7b032 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f89b8b616e4be0b6b2856ab66ce922', 'request_id': 'req-4553345c-cdcb-484d-8410-aa181cc7b032'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:50.995023 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4553345c-cdcb-484d-8410-aa181cc7b032 admin admin] The token cache is being invalidate because project 19f89b8b616e4be0b6b2856ab66ce922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:14:50.995305 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4553345c-cdcb-484d-8410-aa181cc7b032 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:50.995925 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4553345c-cdcb-484d-8410-aa181cc7b032 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:14:50.997458 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1257/2512] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:14:50 2021] DELETE /identity/v3/projects/19f89b8b616e4be0b6b2856ab66ce922 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:51.003196 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb736d0e-de50-486c-855b-842177aa9f71 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:51.003652 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb736d0e-de50-486c-855b-842177aa9f71 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:51.003759 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb736d0e-de50-486c-855b-842177aa9f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:51.021435 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-cb736d0e-de50-486c-855b-842177aa9f71 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:51.022847 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-cb736d0e-de50-486c-855b-842177aa9f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:51.084213 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1256/2513] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:51.092142 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc33f5-24fc-4240-a612-8ffb9e31c1a6 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:51.092432 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc33f5-24fc-4240-a612-8ffb9e31c1a6 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:51.092715 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc33f5-24fc-4240-a612-8ffb9e31c1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:51.111234 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-e8dc33f5-24fc-4240-a612-8ffb9e31c1a6 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:51.112427 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-e8dc33f5-24fc-4240-a612-8ffb9e31c1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:51.121117 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1258/2514] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:51.125206 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb736d0e-de50-486c-855b-842177aa9f71 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:51.135122 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb736d0e-de50-486c-855b-842177aa9f71 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:51.139640 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bae907-160e-4dae-93ae-16dabc57372c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:51.140278 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bae907-160e-4dae-93ae-16dabc57372c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:51.140563 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bae907-160e-4dae-93ae-16dabc57372c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:51.140836 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bae907-160e-4dae-93ae-16dabc57372c admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:51.141592 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bae907-160e-4dae-93ae-16dabc57372c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:14:51.141910 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bae907-160e-4dae-93ae-16dabc57372c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:51.143468 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bae907-160e-4dae-93ae-16dabc57372c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:51.154363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1257/2515] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:14:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:14:51.158412 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc33f5-24fc-4240-a612-8ffb9e31c1a6 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:51.168286 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc33f5-24fc-4240-a612-8ffb9e31c1a6 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:51.172931 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459a58b-e0b6-434c-8eb2-a7e990066a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:51.173646 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459a58b-e0b6-434c-8eb2-a7e990066a2e admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:51.173924 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459a58b-e0b6-434c-8eb2-a7e990066a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:51.174196 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459a58b-e0b6-434c-8eb2-a7e990066a2e admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:51.174895 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459a58b-e0b6-434c-8eb2-a7e990066a2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:51.176795 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459a58b-e0b6-434c-8eb2-a7e990066a2e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:51.201844 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1259/2516] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:14:51 2021] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:14:51.205966 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bae907-160e-4dae-93ae-16dabc57372c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:51.215562 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bae907-160e-4dae-93ae-16dabc57372c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:51.270725 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7842c-9956-4374-8c2a-f84896382c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:51.271317 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7842c-9956-4374-8c2a-f84896382c47 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:51.271599 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7842c-9956-4374-8c2a-f84896382c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:51.271879 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7842c-9956-4374-8c2a-f84896382c47 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:51.272613 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7842c-9956-4374-8c2a-f84896382c47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:51.274554 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7842c-9956-4374-8c2a-f84896382c47 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:51.295432 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1258/2517] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:14:51 2021] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:14:51.299657 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459a58b-e0b6-434c-8eb2-a7e990066a2e admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:51.310213 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459a58b-e0b6-434c-8eb2-a7e990066a2e admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:51.315319 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10192ea-12ed-4a40-b38b-1c34f56e3dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:51.316055 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10192ea-12ed-4a40-b38b-1c34f56e3dba admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:51.316347 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10192ea-12ed-4a40-b38b-1c34f56e3dba admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:51.316623 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10192ea-12ed-4a40-b38b-1c34f56e3dba admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:51.317717 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10192ea-12ed-4a40-b38b-1c34f56e3dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:51.319527 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10192ea-12ed-4a40-b38b-1c34f56e3dba admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:51.330393 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1260/2518] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:51 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:14:51.334445 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7842c-9956-4374-8c2a-f84896382c47 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:51.344921 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7842c-9956-4374-8c2a-f84896382c47 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:51.349650 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d4357-9ded-4f49-b0bc-fa9b0e598108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:51.350929 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d4357-9ded-4f49-b0bc-fa9b0e598108 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:51.351214 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d4357-9ded-4f49-b0bc-fa9b0e598108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:51.351524 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d4357-9ded-4f49-b0bc-fa9b0e598108 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:51.352330 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d4357-9ded-4f49-b0bc-fa9b0e598108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:51.353981 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d4357-9ded-4f49-b0bc-fa9b0e598108 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:51.363792 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1259/2519] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:14:51 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:14:51.369170 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10192ea-12ed-4a40-b38b-1c34f56e3dba admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:51.384404 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10192ea-12ed-4a40-b38b-1c34f56e3dba admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:51.391306 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f79edb-5d6b-46a4-8fa5-8af9b0fb3ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:51.392666 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f79edb-5d6b-46a4-8fa5-8af9b0fb3ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:51.393088 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f79edb-5d6b-46a4-8fa5-8af9b0fb3ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:51.393538 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f79edb-5d6b-46a4-8fa5-8af9b0fb3ab6 admin admin] PATH_INFO: `/v3/projects/0ca560754a9c4530ba707aef9b98cff8/users/ffd7b536c17849f0b4b790e589c4cef0/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:51.412360 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f79edb-5d6b-46a4-8fa5-8af9b0fb3ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca560754a9c4530ba707aef9b98cff8, user_id=ffd7b536c17849f0b4b790e589c4cef0, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:51.417164 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f79edb-5d6b-46a4-8fa5-8af9b0fb3ab6 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:51.434634 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1261/2520] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:14:51 2021] PUT /identity/v3/projects/0ca560754a9c4530ba707aef9b98cff8/users/ffd7b536c17849f0b4b790e589c4cef0/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:14:51.445339 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e8b7b-e971-4067-99d9-81239b58e6d3 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:51.445687 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e8b7b-e971-4067-99d9-81239b58e6d3 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:51.445961 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e8b7b-e971-4067-99d9-81239b58e6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:51.464056 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-713e8b7b-e971-4067-99d9-81239b58e6d3 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:51.465263 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-713e8b7b-e971-4067-99d9-81239b58e6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:51.523673 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1260/2521] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:51.533297 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f79edb-5d6b-46a4-8fa5-8af9b0fb3ab6 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:51.535330 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-23f79edb-5d6b-46a4-8fa5-8af9b0fb3ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:51.596899 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f79edb-5d6b-46a4-8fa5-8af9b0fb3ab6 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:51.601434 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a037e-c81c-4f87-b33e-0aa7989e1956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:51.602084 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a037e-c81c-4f87-b33e-0aa7989e1956 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:51.602368 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a037e-c81c-4f87-b33e-0aa7989e1956 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:51.602640 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a037e-c81c-4f87-b33e-0aa7989e1956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:51.611539 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a037e-c81c-4f87-b33e-0aa7989e1956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:51.612997 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a037e-c81c-4f87-b33e-0aa7989e1956 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:51.622546 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1262/2522] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:52.559587 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7523095-1688-4c6e-8ac0-e7395211d41f None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:52.560653 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7523095-1688-4c6e-8ac0-e7395211d41f None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:52.561260 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7523095-1688-4c6e-8ac0-e7395211d41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:52.594452 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-b7523095-1688-4c6e-8ac0-e7395211d41f None None] MFA Rules not processed for user `ffd7b536c17849f0b4b790e589c4cef0`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:52.596045 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-b7523095-1688-4c6e-8ac0-e7395211d41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:52.675275 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1261/2523] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:52 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:14:52.685947 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a037e-c81c-4f87-b33e-0aa7989e1956 service neutron] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:14:52.687360 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-512a037e-c81c-4f87-b33e-0aa7989e1956 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:52.747759 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a037e-c81c-4f87-b33e-0aa7989e1956 service neutron] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:14:52.751899 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e64a6-97c2-4aa5-ad69-fd9823127e1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:14:52.752571 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e64a6-97c2-4aa5-ad69-fd9823127e1b service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:52.752852 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e64a6-97c2-4aa5-ad69-fd9823127e1b service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:52.753122 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e64a6-97c2-4aa5-ad69-fd9823127e1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:52.761787 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e64a6-97c2-4aa5-ad69-fd9823127e1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:14:52.763142 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e64a6-97c2-4aa5-ad69-fd9823127e1b service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:14:52.773243 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1263/2524] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:14:52 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:54.198948 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99563f51-24a9-4591-8466-e53202a1eb49 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:54.199833 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99563f51-24a9-4591-8466-e53202a1eb49 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:54.200065 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99563f51-24a9-4591-8466-e53202a1eb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:54.227779 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-99563f51-24a9-4591-8466-e53202a1eb49 None None] MFA Rules not processed for user `ffd7b536c17849f0b4b790e589c4cef0`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:54.230315 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-99563f51-24a9-4591-8466-e53202a1eb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:54.245420 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1262/2525] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:54 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:14:59.057740 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c29ceb-acfe-495d-9bc6-2de3f1496f36 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:14:59.058278 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c29ceb-acfe-495d-9bc6-2de3f1496f36 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:14:59.058449 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c29ceb-acfe-495d-9bc6-2de3f1496f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:14:59.079461 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-d0c29ceb-acfe-495d-9bc6-2de3f1496f36 None None] MFA Rules not processed for user `2b01ba54246a4e8482417367b6329c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:14:59.081125 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-d0c29ceb-acfe-495d-9bc6-2de3f1496f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:14:59.138911 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1264/2526] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:14:59 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:02.271762 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336da8c-873c-454a-a37b-d613a583ad32 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:02.272338 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336da8c-873c-454a-a37b-d613a583ad32 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:02.272487 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336da8c-873c-454a-a37b-d613a583ad32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:02.345539 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-4336da8c-873c-454a-a37b-d613a583ad32 None None] MFA Rules not processed for user `b2f47cbf62d44a6ba7e6a6f0f2305630`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:02.347026 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-4336da8c-873c-454a-a37b-d613a583ad32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:02.437225 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1263/2527] 10.222.0.36 () {58 vars in 967 bytes} [Wed Dec 15 16:15:02 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:02.486876 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c29ceb-acfe-495d-9bc6-2de3f1496f36 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:02.488321 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-d0c29ceb-acfe-495d-9bc6-2de3f1496f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:02.604950 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c29ceb-acfe-495d-9bc6-2de3f1496f36 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:02.612192 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced24ca9-8bb1-435e-a38a-0637b9b6d8c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e3f652f76424e27a1d4329212d9b66d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:02.613075 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced24ca9-8bb1-435e-a38a-0637b9b6d8c4 service swift] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:02.613430 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced24ca9-8bb1-435e-a38a-0637b9b6d8c4 service swift] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:02.613799 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced24ca9-8bb1-435e-a38a-0637b9b6d8c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:02.624016 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced24ca9-8bb1-435e-a38a-0637b9b6d8c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:02.626055 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced24ca9-8bb1-435e-a38a-0637b9b6d8c4 service swift] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:02.635379 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1265/2528] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Dec 15 16:15:02 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:15:03.733214 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336da8c-873c-454a-a37b-d613a583ad32 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:03.734765 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-4336da8c-873c-454a-a37b-d613a583ad32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:03.749662 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336da8c-873c-454a-a37b-d613a583ad32 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:03.754389 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5a7fe-c6e9-4f60-bfd9-cad0b06aa6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:03.755258 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5a7fe-c6e9-4f60-bfd9-cad0b06aa6d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:03.755772 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5a7fe-c6e9-4f60-bfd9-cad0b06aa6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:03.756260 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5a7fe-c6e9-4f60-bfd9-cad0b06aa6d7 admin admin] PATH_INFO: `/v3/users/24ad435ab0704f80ae3a62bffb72b7cd` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:03.758575 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5a7fe-c6e9-4f60-bfd9-cad0b06aa6d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24ad435ab0704f80ae3a62bffb72b7cd)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:03.760449 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5a7fe-c6e9-4f60-bfd9-cad0b06aa6d7 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:03.814896 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-8da5a7fe-c6e9-4f60-bfd9-cad0b06aa6d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24ad435ab0704f80ae3a62bffb72b7cd'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:03.815611 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-8da5a7fe-c6e9-4f60-bfd9-cad0b06aa6d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24ad435ab0704f80ae3a62bffb72b7cd'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:03.816358 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-8da5a7fe-c6e9-4f60-bfd9-cad0b06aa6d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24ad435ab0704f80ae3a62bffb72b7cd'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:03.831164 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-8da5a7fe-c6e9-4f60-bfd9-cad0b06aa6d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24ad435ab0704f80ae3a62bffb72b7cd'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:03.838358 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-8da5a7fe-c6e9-4f60-bfd9-cad0b06aa6d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24ad435ab0704f80ae3a62bffb72b7cd'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:03.854416 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1264/2529] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:15:03 2021] DELETE /identity/v3/users/24ad435ab0704f80ae3a62bffb72b7cd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:15:04.125757 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced24ca9-8bb1-435e-a38a-0637b9b6d8c4 service swift] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:04.137379 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced24ca9-8bb1-435e-a38a-0637b9b6d8c4 service swift] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:04.218821 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e33d5-4b50-43cb-8225-7155e1d74dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:04.221188 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e33d5-4b50-43cb-8225-7155e1d74dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:04.222270 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e33d5-4b50-43cb-8225-7155e1d74dae admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:04.222567 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e33d5-4b50-43cb-8225-7155e1d74dae admin admin] PATH_INFO: `/v3/projects/9449290fa7564062b7240e05b6ff7f89` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:04.226660 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e33d5-4b50-43cb-8225-7155e1d74dae admin admin] RBAC: Authorizing `identity:delete_project(project_id=9449290fa7564062b7240e05b6ff7f89)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:04.229325 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e33d5-4b50-43cb-8225-7155e1d74dae admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:04.285711 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-c99e33d5-4b50-43cb-8225-7155e1d74dae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9449290fa7564062b7240e05b6ff7f89', 'request_id': 'req-c99e33d5-4b50-43cb-8225-7155e1d74dae'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:04.296517 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-c99e33d5-4b50-43cb-8225-7155e1d74dae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9449290fa7564062b7240e05b6ff7f89', 'request_id': 'req-c99e33d5-4b50-43cb-8225-7155e1d74dae'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:04.302628 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-c99e33d5-4b50-43cb-8225-7155e1d74dae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9449290fa7564062b7240e05b6ff7f89', 'request_id': 'req-c99e33d5-4b50-43cb-8225-7155e1d74dae'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:04.316602 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-c99e33d5-4b50-43cb-8225-7155e1d74dae admin admin] The token cache is being invalidate because project 9449290fa7564062b7240e05b6ff7f89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:15:04.316899 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-c99e33d5-4b50-43cb-8225-7155e1d74dae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:04.317573 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-c99e33d5-4b50-43cb-8225-7155e1d74dae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:04.319863 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1266/2530] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:15:04 2021] DELETE /identity/v3/projects/9449290fa7564062b7240e05b6ff7f89 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:15:04.323721 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5a7fe-c6e9-4f60-bfd9-cad0b06aa6d7 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:04.325139 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-8da5a7fe-c6e9-4f60-bfd9-cad0b06aa6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:04.338872 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5a7fe-c6e9-4f60-bfd9-cad0b06aa6d7 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:04.412443 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010d15f-c831-49a5-b21d-dd64e7ab61d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:04.413631 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010d15f-c831-49a5-b21d-dd64e7ab61d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:04.413914 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010d15f-c831-49a5-b21d-dd64e7ab61d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:04.414282 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010d15f-c831-49a5-b21d-dd64e7ab61d5 admin admin] PATH_INFO: `/v3/users/ab340f6749524fec8b05a2e85685a574` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:04.415635 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010d15f-c831-49a5-b21d-dd64e7ab61d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab340f6749524fec8b05a2e85685a574)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:04.418347 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010d15f-c831-49a5-b21d-dd64e7ab61d5 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:04.483729 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2010d15f-c831-49a5-b21d-dd64e7ab61d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab340f6749524fec8b05a2e85685a574'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:04.485017 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2010d15f-c831-49a5-b21d-dd64e7ab61d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab340f6749524fec8b05a2e85685a574'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:04.485884 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2010d15f-c831-49a5-b21d-dd64e7ab61d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab340f6749524fec8b05a2e85685a574'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:04.501590 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2010d15f-c831-49a5-b21d-dd64e7ab61d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab340f6749524fec8b05a2e85685a574'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:04.512475 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-2010d15f-c831-49a5-b21d-dd64e7ab61d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab340f6749524fec8b05a2e85685a574'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:04.532023 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1265/2531] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:15:04 2021] DELETE /identity/v3/users/ab340f6749524fec8b05a2e85685a574 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:15:05.260364 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e33d5-4b50-43cb-8225-7155e1d74dae admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:05.261878 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-c99e33d5-4b50-43cb-8225-7155e1d74dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:05.274380 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e33d5-4b50-43cb-8225-7155e1d74dae admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:05.330768 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11c850-5ae7-465a-a526-e0bee1e039d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:05.331650 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11c850-5ae7-465a-a526-e0bee1e039d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:05.331925 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11c850-5ae7-465a-a526-e0bee1e039d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:05.332198 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11c850-5ae7-465a-a526-e0bee1e039d7 admin admin] PATH_INFO: `/v3/projects/a30f0a7c21bd406b8798e7486149c904` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:05.333433 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11c850-5ae7-465a-a526-e0bee1e039d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a30f0a7c21bd406b8798e7486149c904)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:05.335598 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11c850-5ae7-465a-a526-e0bee1e039d7 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:05.382006 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-3b11c850-5ae7-465a-a526-e0bee1e039d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a30f0a7c21bd406b8798e7486149c904', 'request_id': 'req-3b11c850-5ae7-465a-a526-e0bee1e039d7'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:05.390099 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-3b11c850-5ae7-465a-a526-e0bee1e039d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a30f0a7c21bd406b8798e7486149c904', 'request_id': 'req-3b11c850-5ae7-465a-a526-e0bee1e039d7'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:05.395688 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-3b11c850-5ae7-465a-a526-e0bee1e039d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a30f0a7c21bd406b8798e7486149c904', 'request_id': 'req-3b11c850-5ae7-465a-a526-e0bee1e039d7'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:05.426033 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-3b11c850-5ae7-465a-a526-e0bee1e039d7 admin admin] The token cache is being invalidate because project a30f0a7c21bd406b8798e7486149c904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:15:05.426332 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-3b11c850-5ae7-465a-a526-e0bee1e039d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:05.427011 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-3b11c850-5ae7-465a-a526-e0bee1e039d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:05.434002 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1267/2532] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:15:05 2021] DELETE /identity/v3/projects/a30f0a7c21bd406b8798e7486149c904 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:15:05.435763 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27fc17-c2b5-4754-81ee-58c3e1e1d26f None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:05.436233 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27fc17-c2b5-4754-81ee-58c3e1e1d26f None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:05.436319 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27fc17-c2b5-4754-81ee-58c3e1e1d26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:05.459016 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-7a27fc17-c2b5-4754-81ee-58c3e1e1d26f None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:05.461171 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-7a27fc17-c2b5-4754-81ee-58c3e1e1d26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:05.546118 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1266/2533] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:15:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:05.553557 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e4e51-44c4-47b1-8415-0b68ae1885f6 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:05.554062 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e4e51-44c4-47b1-8415-0b68ae1885f6 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:05.554490 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e4e51-44c4-47b1-8415-0b68ae1885f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:05.574504 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-c21e4e51-44c4-47b1-8415-0b68ae1885f6 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:05.576022 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-c21e4e51-44c4-47b1-8415-0b68ae1885f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:05.587082 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1268/2534] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:15:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:05.591311 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27fc17-c2b5-4754-81ee-58c3e1e1d26f None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:05.601816 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27fc17-c2b5-4754-81ee-58c3e1e1d26f None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:05.608783 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999185de-224b-4b52-8162-24a37a53e08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:05.609520 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999185de-224b-4b52-8162-24a37a53e08c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:05.609801 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999185de-224b-4b52-8162-24a37a53e08c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:05.610076 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999185de-224b-4b52-8162-24a37a53e08c admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:05.610886 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999185de-224b-4b52-8162-24a37a53e08c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:15:05.611194 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999185de-224b-4b52-8162-24a37a53e08c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:05.612794 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999185de-224b-4b52-8162-24a37a53e08c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:05.626292 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1267/2535] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:15:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:15:05.630654 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e4e51-44c4-47b1-8415-0b68ae1885f6 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:05.641044 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e4e51-44c4-47b1-8415-0b68ae1885f6 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:05.645744 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881c812-7ae1-47df-8cde-802087b305a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:05.646402 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881c812-7ae1-47df-8cde-802087b305a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:05.646674 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881c812-7ae1-47df-8cde-802087b305a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:05.647294 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881c812-7ae1-47df-8cde-802087b305a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:05.647823 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881c812-7ae1-47df-8cde-802087b305a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:05.649772 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881c812-7ae1-47df-8cde-802087b305a8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:05.680955 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1269/2536] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:15:05 2021] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:15:05.682924 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999185de-224b-4b52-8162-24a37a53e08c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:05.694507 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999185de-224b-4b52-8162-24a37a53e08c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:05.752259 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2204df-4e16-405c-8a34-e748290bd188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:05.752934 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2204df-4e16-405c-8a34-e748290bd188 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:05.753216 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2204df-4e16-405c-8a34-e748290bd188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:05.753516 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2204df-4e16-405c-8a34-e748290bd188 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:05.754223 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2204df-4e16-405c-8a34-e748290bd188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:05.756137 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2204df-4e16-405c-8a34-e748290bd188 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:05.781288 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1268/2537] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:15:05 2021] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:15:05.785367 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881c812-7ae1-47df-8cde-802087b305a8 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:05.796629 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881c812-7ae1-47df-8cde-802087b305a8 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:05.801678 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6e46f-10c7-4753-90e2-4908fc78b9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:05.802556 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6e46f-10c7-4753-90e2-4908fc78b9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:05.802773 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6e46f-10c7-4753-90e2-4908fc78b9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:05.803244 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6e46f-10c7-4753-90e2-4908fc78b9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:05.804903 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6e46f-10c7-4753-90e2-4908fc78b9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:05.806652 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6e46f-10c7-4753-90e2-4908fc78b9e7 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:05.819375 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1270/2538] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:15:05 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:15:05.823220 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2204df-4e16-405c-8a34-e748290bd188 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:05.833210 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2204df-4e16-405c-8a34-e748290bd188 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:05.839141 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9b367-bf61-4e90-8961-718c962eff86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:05.840108 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9b367-bf61-4e90-8961-718c962eff86 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:05.840487 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9b367-bf61-4e90-8961-718c962eff86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:05.840860 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9b367-bf61-4e90-8961-718c962eff86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:05.842492 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9b367-bf61-4e90-8961-718c962eff86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:05.843632 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9b367-bf61-4e90-8961-718c962eff86 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:05.855150 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1269/2539] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:15:05 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:15:05.859298 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6e46f-10c7-4753-90e2-4908fc78b9e7 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:05.873696 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6e46f-10c7-4753-90e2-4908fc78b9e7 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:05.878768 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390ac2c-1f0f-4299-abfd-eab0438bfe45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:05.879780 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390ac2c-1f0f-4299-abfd-eab0438bfe45 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:05.880157 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390ac2c-1f0f-4299-abfd-eab0438bfe45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:05.880526 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390ac2c-1f0f-4299-abfd-eab0438bfe45 admin admin] PATH_INFO: `/v3/projects/d95aabd442144c049cd05653a7498d38/users/1e3c3214f4004fcf9cc4f06458269601/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:05.896129 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390ac2c-1f0f-4299-abfd-eab0438bfe45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d95aabd442144c049cd05653a7498d38, user_id=1e3c3214f4004fcf9cc4f06458269601, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:05.899292 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390ac2c-1f0f-4299-abfd-eab0438bfe45 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:05.915136 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1271/2540] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:15:05 2021] PUT /identity/v3/projects/d95aabd442144c049cd05653a7498d38/users/1e3c3214f4004fcf9cc4f06458269601/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:15:05.926688 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8297731-f200-45bc-a842-efd6d5c4546b None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:05.927914 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8297731-f200-45bc-a842-efd6d5c4546b None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:05.928968 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8297731-f200-45bc-a842-efd6d5c4546b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:05.962755 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-b8297731-f200-45bc-a842-efd6d5c4546b None None] MFA Rules not processed for user `1e3c3214f4004fcf9cc4f06458269601`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:05.964070 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-b8297731-f200-45bc-a842-efd6d5c4546b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:06.041534 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1270/2541] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:15:05 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:06.050472 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390ac2c-1f0f-4299-abfd-eab0438bfe45 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:06.052331 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-4390ac2c-1f0f-4299-abfd-eab0438bfe45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:06.157372 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390ac2c-1f0f-4299-abfd-eab0438bfe45 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:06.161478 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4f2f3-8e56-4917-9f9a-ce627d186f4e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9072bd35fdf046669c196133f485d334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:06.162128 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4f2f3-8e56-4917-9f9a-ce627d186f4e service glance] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:06.162412 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4f2f3-8e56-4917-9f9a-ce627d186f4e service glance] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:06.162691 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4f2f3-8e56-4917-9f9a-ce627d186f4e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:06.172398 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4f2f3-8e56-4917-9f9a-ce627d186f4e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:06.173878 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4f2f3-8e56-4917-9f9a-ce627d186f4e service glance] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:06.196000 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1272/2542] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:06 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:15:11.210488 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8297731-f200-45bc-a842-efd6d5c4546b None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:11.212119 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-b8297731-f200-45bc-a842-efd6d5c4546b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:11.286370 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8297731-f200-45bc-a842-efd6d5c4546b None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:11.291132 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33a428-40d0-4b7f-b92b-a07e0dd32ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:11.291999 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33a428-40d0-4b7f-b92b-a07e0dd32ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:11.292283 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33a428-40d0-4b7f-b92b-a07e0dd32ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:11.292561 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33a428-40d0-4b7f-b92b-a07e0dd32ab9 admin admin] PATH_INFO: `/v3/users/0a15ca0a8cc74415815f5613f72b8105` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:11.293801 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33a428-40d0-4b7f-b92b-a07e0dd32ab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a15ca0a8cc74415815f5613f72b8105)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:11.295729 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33a428-40d0-4b7f-b92b-a07e0dd32ab9 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:11.343789 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-8f33a428-40d0-4b7f-b92b-a07e0dd32ab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a15ca0a8cc74415815f5613f72b8105'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:11.344455 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-8f33a428-40d0-4b7f-b92b-a07e0dd32ab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a15ca0a8cc74415815f5613f72b8105'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:11.345087 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-8f33a428-40d0-4b7f-b92b-a07e0dd32ab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a15ca0a8cc74415815f5613f72b8105'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:11.356568 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-8f33a428-40d0-4b7f-b92b-a07e0dd32ab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a15ca0a8cc74415815f5613f72b8105'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:11.363818 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-8f33a428-40d0-4b7f-b92b-a07e0dd32ab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a15ca0a8cc74415815f5613f72b8105'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:11.375490 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1271/2543] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:15:11 2021] DELETE /identity/v3/users/0a15ca0a8cc74415815f5613f72b8105 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:15:11.551644 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4f2f3-8e56-4917-9f9a-ce627d186f4e service glance] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:11.570658 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4f2f3-8e56-4917-9f9a-ce627d186f4e service glance] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:11.636819 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578289df-9644-4994-b5d9-8761b47840ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:11.637809 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578289df-9644-4994-b5d9-8761b47840ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:11.638097 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578289df-9644-4994-b5d9-8761b47840ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:11.638377 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578289df-9644-4994-b5d9-8761b47840ca admin admin] PATH_INFO: `/v3/projects/174453a286344e0fa34d91d3ebcb8436` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:11.639742 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578289df-9644-4994-b5d9-8761b47840ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=174453a286344e0fa34d91d3ebcb8436)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:11.641930 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578289df-9644-4994-b5d9-8761b47840ca admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:11.695153 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-578289df-9644-4994-b5d9-8761b47840ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '174453a286344e0fa34d91d3ebcb8436', 'request_id': 'req-578289df-9644-4994-b5d9-8761b47840ca'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:11.702133 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-578289df-9644-4994-b5d9-8761b47840ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '174453a286344e0fa34d91d3ebcb8436', 'request_id': 'req-578289df-9644-4994-b5d9-8761b47840ca'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:11.707559 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-578289df-9644-4994-b5d9-8761b47840ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '174453a286344e0fa34d91d3ebcb8436', 'request_id': 'req-578289df-9644-4994-b5d9-8761b47840ca'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:11.720585 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-578289df-9644-4994-b5d9-8761b47840ca admin admin] The token cache is being invalidate because project 174453a286344e0fa34d91d3ebcb8436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:15:11.721063 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-578289df-9644-4994-b5d9-8761b47840ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:11.721796 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-578289df-9644-4994-b5d9-8761b47840ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:11.723338 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1273/2544] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:15:11 2021] DELETE /identity/v3/projects/174453a286344e0fa34d91d3ebcb8436 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:15:11.727832 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33a428-40d0-4b7f-b92b-a07e0dd32ab9 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:11.729257 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-8f33a428-40d0-4b7f-b92b-a07e0dd32ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:11.743028 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33a428-40d0-4b7f-b92b-a07e0dd32ab9 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:11.811250 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02ea5f-8fa9-443d-80f1-eb2f9be96632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:11.812137 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02ea5f-8fa9-443d-80f1-eb2f9be96632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:11.812420 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02ea5f-8fa9-443d-80f1-eb2f9be96632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:11.812696 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02ea5f-8fa9-443d-80f1-eb2f9be96632 admin admin] PATH_INFO: `/v3/users/ebc99962f1494b4ab39ccedced417d4e` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:11.813940 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02ea5f-8fa9-443d-80f1-eb2f9be96632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebc99962f1494b4ab39ccedced417d4e)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:11.815914 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02ea5f-8fa9-443d-80f1-eb2f9be96632 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:11.863918 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-5a02ea5f-8fa9-443d-80f1-eb2f9be96632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebc99962f1494b4ab39ccedced417d4e'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:11.864670 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-5a02ea5f-8fa9-443d-80f1-eb2f9be96632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebc99962f1494b4ab39ccedced417d4e'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:11.865276 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-5a02ea5f-8fa9-443d-80f1-eb2f9be96632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebc99962f1494b4ab39ccedced417d4e'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:11.878042 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-5a02ea5f-8fa9-443d-80f1-eb2f9be96632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebc99962f1494b4ab39ccedced417d4e'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:11.890292 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-5a02ea5f-8fa9-443d-80f1-eb2f9be96632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebc99962f1494b4ab39ccedced417d4e'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:11.903266 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1272/2545] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:15:11 2021] DELETE /identity/v3/users/ebc99962f1494b4ab39ccedced417d4e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:15:12.105291 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578289df-9644-4994-b5d9-8761b47840ca admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:12.106790 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-578289df-9644-4994-b5d9-8761b47840ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:12.129097 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c890c30-8811-46bd-adce-3b188025a028 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:12.129478 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c890c30-8811-46bd-adce-3b188025a028 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:12.129789 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c890c30-8811-46bd-adce-3b188025a028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:12.147709 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578289df-9644-4994-b5d9-8761b47840ca admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:12.150001 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-7c890c30-8811-46bd-adce-3b188025a028 None None] MFA Rules not processed for user `ffd7b536c17849f0b4b790e589c4cef0`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:12.151289 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-7c890c30-8811-46bd-adce-3b188025a028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:12.213102 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1273/2546] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:15:12 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:12.217957 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad068f4-8f57-421d-8605-bb65413111fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:12.218819 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad068f4-8f57-421d-8605-bb65413111fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:12.219104 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad068f4-8f57-421d-8605-bb65413111fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:12.219385 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad068f4-8f57-421d-8605-bb65413111fa admin admin] PATH_INFO: `/v3/projects/73d03ff8f09641ccbcc93172836636f2` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:12.220595 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad068f4-8f57-421d-8605-bb65413111fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=73d03ff8f09641ccbcc93172836636f2)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:12.222741 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad068f4-8f57-421d-8605-bb65413111fa admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:12.285320 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-bad068f4-8f57-421d-8605-bb65413111fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73d03ff8f09641ccbcc93172836636f2', 'request_id': 'req-bad068f4-8f57-421d-8605-bb65413111fa'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:12.293268 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-bad068f4-8f57-421d-8605-bb65413111fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73d03ff8f09641ccbcc93172836636f2', 'request_id': 'req-bad068f4-8f57-421d-8605-bb65413111fa'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:12.298705 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-bad068f4-8f57-421d-8605-bb65413111fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73d03ff8f09641ccbcc93172836636f2', 'request_id': 'req-bad068f4-8f57-421d-8605-bb65413111fa'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:12.310356 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-bad068f4-8f57-421d-8605-bb65413111fa admin admin] The token cache is being invalidate because project 73d03ff8f09641ccbcc93172836636f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:15:12.310672 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-bad068f4-8f57-421d-8605-bb65413111fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:12.311381 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-bad068f4-8f57-421d-8605-bb65413111fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:12.312957 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1274/2547] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:15:12 2021] DELETE /identity/v3/projects/73d03ff8f09641ccbcc93172836636f2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:15:26.009893 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c890c30-8811-46bd-adce-3b188025a028 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:26.011323 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-7c890c30-8811-46bd-adce-3b188025a028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:26.026573 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c890c30-8811-46bd-adce-3b188025a028 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:26.082523 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49f9d8-d1b8-4dea-8ca3-d81b0e3d7d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:26.083379 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49f9d8-d1b8-4dea-8ca3-d81b0e3d7d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:26.083664 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49f9d8-d1b8-4dea-8ca3-d81b0e3d7d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:26.083939 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49f9d8-d1b8-4dea-8ca3-d81b0e3d7d6a admin admin] PATH_INFO: `/v3/users/1e3c3214f4004fcf9cc4f06458269601` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:26.085137 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49f9d8-d1b8-4dea-8ca3-d81b0e3d7d6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e3c3214f4004fcf9cc4f06458269601)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:26.087136 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49f9d8-d1b8-4dea-8ca3-d81b0e3d7d6a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:26.135706 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4b49f9d8-d1b8-4dea-8ca3-d81b0e3d7d6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e3c3214f4004fcf9cc4f06458269601'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:26.136355 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4b49f9d8-d1b8-4dea-8ca3-d81b0e3d7d6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e3c3214f4004fcf9cc4f06458269601'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:26.136968 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4b49f9d8-d1b8-4dea-8ca3-d81b0e3d7d6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e3c3214f4004fcf9cc4f06458269601'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:26.148691 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4b49f9d8-d1b8-4dea-8ca3-d81b0e3d7d6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e3c3214f4004fcf9cc4f06458269601'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:26.155812 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-4b49f9d8-d1b8-4dea-8ca3-d81b0e3d7d6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e3c3214f4004fcf9cc4f06458269601'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:26.168853 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1274/2548] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:15:26 2021] DELETE /identity/v3/users/1e3c3214f4004fcf9cc4f06458269601 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:15:26.173350 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e678e4-d769-47fc-9390-a320ccb826a0 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:26.173849 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e678e4-d769-47fc-9390-a320ccb826a0 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:26.173953 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e678e4-d769-47fc-9390-a320ccb826a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:26.191558 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-e8e678e4-d769-47fc-9390-a320ccb826a0 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:26.192747 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-e8e678e4-d769-47fc-9390-a320ccb826a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:26.249774 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1275/2549] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:15:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:26.260508 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49f9d8-d1b8-4dea-8ca3-d81b0e3d7d6a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:26.261958 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-4b49f9d8-d1b8-4dea-8ca3-d81b0e3d7d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:26.326742 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49f9d8-d1b8-4dea-8ca3-d81b0e3d7d6a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:26.330461 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612215a-974c-4dfb-abd1-7b605bf60ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:26.331108 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612215a-974c-4dfb-abd1-7b605bf60ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:26.331394 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612215a-974c-4dfb-abd1-7b605bf60ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:26.331673 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612215a-974c-4dfb-abd1-7b605bf60ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:26.341841 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612215a-974c-4dfb-abd1-7b605bf60ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:26.343277 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612215a-974c-4dfb-abd1-7b605bf60ba4 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:26.353424 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1275/2550] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:15:26.611249 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e678e4-d769-47fc-9390-a320ccb826a0 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:26.612709 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-e8e678e4-d769-47fc-9390-a320ccb826a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:26.626262 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e678e4-d769-47fc-9390-a320ccb826a0 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:26.631052 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353c25e-6130-478d-8da0-13a9d7b7e35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:26.631905 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353c25e-6130-478d-8da0-13a9d7b7e35e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:26.632189 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353c25e-6130-478d-8da0-13a9d7b7e35e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:26.632467 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353c25e-6130-478d-8da0-13a9d7b7e35e admin admin] PATH_INFO: `/v3/projects/d95aabd442144c049cd05653a7498d38` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:26.634792 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353c25e-6130-478d-8da0-13a9d7b7e35e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d95aabd442144c049cd05653a7498d38)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:26.636726 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353c25e-6130-478d-8da0-13a9d7b7e35e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:26.683875 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-2353c25e-6130-478d-8da0-13a9d7b7e35e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd95aabd442144c049cd05653a7498d38', 'request_id': 'req-2353c25e-6130-478d-8da0-13a9d7b7e35e'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:26.691008 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-2353c25e-6130-478d-8da0-13a9d7b7e35e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd95aabd442144c049cd05653a7498d38', 'request_id': 'req-2353c25e-6130-478d-8da0-13a9d7b7e35e'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:26.697046 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-2353c25e-6130-478d-8da0-13a9d7b7e35e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd95aabd442144c049cd05653a7498d38', 'request_id': 'req-2353c25e-6130-478d-8da0-13a9d7b7e35e'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:26.711039 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-2353c25e-6130-478d-8da0-13a9d7b7e35e admin admin] The token cache is being invalidate because project d95aabd442144c049cd05653a7498d38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:15:26.711322 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-2353c25e-6130-478d-8da0-13a9d7b7e35e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:26.712017 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-2353c25e-6130-478d-8da0-13a9d7b7e35e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:26.713549 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1276/2551] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:15:26 2021] DELETE /identity/v3/projects/d95aabd442144c049cd05653a7498d38 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:15:26.719875 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19b6ec-1053-46d7-838d-9c7a92c0d2d0 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:26.720168 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19b6ec-1053-46d7-838d-9c7a92c0d2d0 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:26.720450 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19b6ec-1053-46d7-838d-9c7a92c0d2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:26.738265 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-6b19b6ec-1053-46d7-838d-9c7a92c0d2d0 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:26.739461 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-6b19b6ec-1053-46d7-838d-9c7a92c0d2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:26.801789 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1276/2552] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:15:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:15:26.816480 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40904de-e484-4612-85d0-0d4d02da7646 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:26.816480 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40904de-e484-4612-85d0-0d4d02da7646 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:26.816480 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40904de-e484-4612-85d0-0d4d02da7646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:26.839077 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-f40904de-e484-4612-85d0-0d4d02da7646 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:26.839077 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-f40904de-e484-4612-85d0-0d4d02da7646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:26.848459 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1277/2553] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:15:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:26.853796 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b19b6ec-1053-46d7-838d-9c7a92c0d2d0 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:26.863938 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b19b6ec-1053-46d7-838d-9c7a92c0d2d0 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:26.870508 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef693bf-82ad-4b11-b37c-96efff964e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:26.870915 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef693bf-82ad-4b11-b37c-96efff964e99 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:26.871198 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef693bf-82ad-4b11-b37c-96efff964e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:26.871473 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef693bf-82ad-4b11-b37c-96efff964e99 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:26.872313 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef693bf-82ad-4b11-b37c-96efff964e99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:15:26.872596 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef693bf-82ad-4b11-b37c-96efff964e99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:26.874342 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef693bf-82ad-4b11-b37c-96efff964e99 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:26.895744 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1277/2554] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:15:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:15:26.895849 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40904de-e484-4612-85d0-0d4d02da7646 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:26.909022 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40904de-e484-4612-85d0-0d4d02da7646 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:26.917153 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f918e7-3fd6-4cc7-8077-41f00dd87c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:26.917879 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f918e7-3fd6-4cc7-8077-41f00dd87c4e admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:26.918122 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f918e7-3fd6-4cc7-8077-41f00dd87c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:26.918409 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f918e7-3fd6-4cc7-8077-41f00dd87c4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:26.920183 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f918e7-3fd6-4cc7-8077-41f00dd87c4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:26.922152 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f918e7-3fd6-4cc7-8077-41f00dd87c4e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:26.956286 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1278/2555] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:15:26 2021] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:15:26.957434 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef693bf-82ad-4b11-b37c-96efff964e99 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:26.969332 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef693bf-82ad-4b11-b37c-96efff964e99 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:27.025889 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301c1e3-6937-4562-9e0f-df764fb0545f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:27.026583 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301c1e3-6937-4562-9e0f-df764fb0545f admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:27.026849 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301c1e3-6937-4562-9e0f-df764fb0545f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:27.027126 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301c1e3-6937-4562-9e0f-df764fb0545f admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:27.027827 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301c1e3-6937-4562-9e0f-df764fb0545f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:27.029792 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301c1e3-6937-4562-9e0f-df764fb0545f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:27.051515 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1278/2556] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:15:26 2021] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:15:27.063292 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f918e7-3fd6-4cc7-8077-41f00dd87c4e admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:27.073620 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f918e7-3fd6-4cc7-8077-41f00dd87c4e admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:27.078248 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de6a52-d970-4023-988a-1160ef20ed49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:27.081576 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de6a52-d970-4023-988a-1160ef20ed49 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:27.081576 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de6a52-d970-4023-988a-1160ef20ed49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:27.081576 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de6a52-d970-4023-988a-1160ef20ed49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:27.081576 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de6a52-d970-4023-988a-1160ef20ed49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:27.081944 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de6a52-d970-4023-988a-1160ef20ed49 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:27.095314 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1279/2557] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:15:27 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:15:27.097227 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301c1e3-6937-4562-9e0f-df764fb0545f admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:27.108195 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301c1e3-6937-4562-9e0f-df764fb0545f admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:27.112893 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffbe53-c421-49c1-9638-4df498c1e825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:27.113585 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffbe53-c421-49c1-9638-4df498c1e825 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:27.113867 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffbe53-c421-49c1-9638-4df498c1e825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:27.114141 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffbe53-c421-49c1-9638-4df498c1e825 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:27.120662 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffbe53-c421-49c1-9638-4df498c1e825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:27.120662 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffbe53-c421-49c1-9638-4df498c1e825 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:27.128586 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1279/2558] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:15:27 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:15:27.134866 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de6a52-d970-4023-988a-1160ef20ed49 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:27.143052 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de6a52-d970-4023-988a-1160ef20ed49 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:27.147912 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa4521-8af4-40d6-854b-dfea7457482f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:27.149255 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa4521-8af4-40d6-854b-dfea7457482f admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:27.149574 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa4521-8af4-40d6-854b-dfea7457482f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:27.149879 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa4521-8af4-40d6-854b-dfea7457482f admin admin] PATH_INFO: `/v3/projects/331b5dc972d544d18f33eac32331096f/users/f17646df5f3547eb9445edce093ec1ba/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:27.168518 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa4521-8af4-40d6-854b-dfea7457482f admin admin] RBAC: Authorizing `identity:create_grant(project_id=331b5dc972d544d18f33eac32331096f, user_id=f17646df5f3547eb9445edce093ec1ba, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:27.173620 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa4521-8af4-40d6-854b-dfea7457482f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:27.188861 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1280/2559] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:15:27 2021] PUT /identity/v3/projects/331b5dc972d544d18f33eac32331096f/users/f17646df5f3547eb9445edce093ec1ba/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:15:27.199805 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a13a1-52af-4a6e-961f-12c72741573f None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:27.200117 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a13a1-52af-4a6e-961f-12c72741573f None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:27.200398 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a13a1-52af-4a6e-961f-12c72741573f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:27.228611 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-f91a13a1-52af-4a6e-961f-12c72741573f None None] MFA Rules not processed for user `f17646df5f3547eb9445edce093ec1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:27.230054 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f91a13a1-52af-4a6e-961f-12c72741573f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:27.295623 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1280/2560] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:15:27 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:27.300286 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa4521-8af4-40d6-854b-dfea7457482f admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:27.375979 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa4521-8af4-40d6-854b-dfea7457482f admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:27.380669 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6caf4a-1cab-45d3-9283-08a9e01288a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:27.381428 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6caf4a-1cab-45d3-9283-08a9e01288a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:27.381737 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6caf4a-1cab-45d3-9283-08a9e01288a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:27.382076 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6caf4a-1cab-45d3-9283-08a9e01288a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:27.383431 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6caf4a-1cab-45d3-9283-08a9e01288a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:27.385413 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6caf4a-1cab-45d3-9283-08a9e01288a3 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:27.411020 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1281/2561] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:15:27 2021] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:15:27.415068 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a13a1-52af-4a6e-961f-12c72741573f None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:27.425469 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a13a1-52af-4a6e-961f-12c72741573f None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:27.483552 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537c177-fa26-4c17-a4b7-429285ecb763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:27.484400 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537c177-fa26-4c17-a4b7-429285ecb763 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:27.484785 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537c177-fa26-4c17-a4b7-429285ecb763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:27.485163 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537c177-fa26-4c17-a4b7-429285ecb763 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:27.486013 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537c177-fa26-4c17-a4b7-429285ecb763 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:27.487965 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537c177-fa26-4c17-a4b7-429285ecb763 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:27.508369 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1281/2562] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:15:27 2021] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:15:27.512573 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6caf4a-1cab-45d3-9283-08a9e01288a3 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:27.525581 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6caf4a-1cab-45d3-9283-08a9e01288a3 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:27.530825 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2c455-765f-4fae-b513-948191268d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:27.531548 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2c455-765f-4fae-b513-948191268d23 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:27.531833 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2c455-765f-4fae-b513-948191268d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:27.532105 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2c455-765f-4fae-b513-948191268d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:27.532837 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2c455-765f-4fae-b513-948191268d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:27.534472 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2c455-765f-4fae-b513-948191268d23 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:27.545809 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1282/2563] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:15:27 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:15:27.549877 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537c177-fa26-4c17-a4b7-429285ecb763 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:27.561160 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537c177-fa26-4c17-a4b7-429285ecb763 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:27.565826 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4ab4c-3fb0-4909-bf0d-6c91393a5d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:27.566482 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4ab4c-3fb0-4909-bf0d-6c91393a5d1f admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:27.566767 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4ab4c-3fb0-4909-bf0d-6c91393a5d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:27.567043 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4ab4c-3fb0-4909-bf0d-6c91393a5d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:27.567780 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4ab4c-3fb0-4909-bf0d-6c91393a5d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:27.569371 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4ab4c-3fb0-4909-bf0d-6c91393a5d1f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:27.580577 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1282/2564] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:15:27 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:15:27.584972 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2c455-765f-4fae-b513-948191268d23 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:27.595030 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2c455-765f-4fae-b513-948191268d23 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:27.599708 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afd166-f6cd-43a2-8a7a-735610b7a60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:27.600618 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afd166-f6cd-43a2-8a7a-735610b7a60b admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:27.600896 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afd166-f6cd-43a2-8a7a-735610b7a60b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:27.601193 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afd166-f6cd-43a2-8a7a-735610b7a60b admin admin] PATH_INFO: `/v3/projects/a58d4249ba0a4f4489dd84f7c3fc0583/users/ce2fc28910de4b1e9a5a027ced80324f/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:27.617502 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70afd166-f6cd-43a2-8a7a-735610b7a60b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58d4249ba0a4f4489dd84f7c3fc0583, user_id=ce2fc28910de4b1e9a5a027ced80324f, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:27.620245 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70afd166-f6cd-43a2-8a7a-735610b7a60b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:27.633344 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1283/2565] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:15:27 2021] PUT /identity/v3/projects/a58d4249ba0a4f4489dd84f7c3fc0583/users/ce2fc28910de4b1e9a5a027ced80324f/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:15:27.644296 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014a86b-e6c3-4e5e-b5a1-3ed443df95d1 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:27.644593 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014a86b-e6c3-4e5e-b5a1-3ed443df95d1 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:27.644876 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014a86b-e6c3-4e5e-b5a1-3ed443df95d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:27.672776 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-3014a86b-e6c3-4e5e-b5a1-3ed443df95d1 None None] MFA Rules not processed for user `ce2fc28910de4b1e9a5a027ced80324f`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:27.674023 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-3014a86b-e6c3-4e5e-b5a1-3ed443df95d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:27.744734 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1283/2566] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:15:27 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:27.749200 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afd166-f6cd-43a2-8a7a-735610b7a60b admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:27.807979 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afd166-f6cd-43a2-8a7a-735610b7a60b admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:27.812473 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b98bc-f780-4714-abab-222d450713a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:27.813124 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b98bc-f780-4714-abab-222d450713a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:27.813424 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b98bc-f780-4714-abab-222d450713a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:27.813706 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b98bc-f780-4714-abab-222d450713a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:27.814409 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b98bc-f780-4714-abab-222d450713a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:27.816319 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b98bc-f780-4714-abab-222d450713a6 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:27.842088 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1284/2567] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:15:27 2021] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:15:27.846330 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014a86b-e6c3-4e5e-b5a1-3ed443df95d1 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:27.858580 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014a86b-e6c3-4e5e-b5a1-3ed443df95d1 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:27.915448 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ec64d-d0f9-410a-bce9-4e19a3128db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:27.916119 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ec64d-d0f9-410a-bce9-4e19a3128db1 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:27.916403 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ec64d-d0f9-410a-bce9-4e19a3128db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:27.916681 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ec64d-d0f9-410a-bce9-4e19a3128db1 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:27.917447 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ec64d-d0f9-410a-bce9-4e19a3128db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:27.919363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ec64d-d0f9-410a-bce9-4e19a3128db1 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:27.941695 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1284/2568] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:15:27 2021] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:15:27.945078 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b98bc-f780-4714-abab-222d450713a6 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:27.955521 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b98bc-f780-4714-abab-222d450713a6 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:27.960057 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809adde-aba9-405d-b7a0-e90393e03b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:27.960722 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809adde-aba9-405d-b7a0-e90393e03b7d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:27.961110 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809adde-aba9-405d-b7a0-e90393e03b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:27.961432 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809adde-aba9-405d-b7a0-e90393e03b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:27.962230 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809adde-aba9-405d-b7a0-e90393e03b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:27.963833 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809adde-aba9-405d-b7a0-e90393e03b7d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:27.974514 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1285/2569] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:15:27 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:15:27.979320 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ec64d-d0f9-410a-bce9-4e19a3128db1 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:27.989261 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ec64d-d0f9-410a-bce9-4e19a3128db1 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:27.994985 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fafa7f-9d47-45d2-a6de-f9cf9792f678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:27.995872 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fafa7f-9d47-45d2-a6de-f9cf9792f678 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:27.996153 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fafa7f-9d47-45d2-a6de-f9cf9792f678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:27.996556 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fafa7f-9d47-45d2-a6de-f9cf9792f678 admin admin] PATH_INFO: `/v3/projects/2d6c2cf97738462ba5c0c7a330afb247/users/874b281365ed4858886fffda5917fadc/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:28.014687 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fafa7f-9d47-45d2-a6de-f9cf9792f678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d6c2cf97738462ba5c0c7a330afb247, user_id=874b281365ed4858886fffda5917fadc, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:28.017784 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fafa7f-9d47-45d2-a6de-f9cf9792f678 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:28.032628 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1285/2570] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:15:27 2021] PUT /identity/v3/projects/2d6c2cf97738462ba5c0c7a330afb247/users/874b281365ed4858886fffda5917fadc/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:15:28.036906 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809adde-aba9-405d-b7a0-e90393e03b7d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:28.048694 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809adde-aba9-405d-b7a0-e90393e03b7d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:28.104571 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13ea9b-9624-4340-9094-97c2aed12fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:28.105233 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13ea9b-9624-4340-9094-97c2aed12fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:28.105549 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13ea9b-9624-4340-9094-97c2aed12fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:28.105827 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13ea9b-9624-4340-9094-97c2aed12fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:28.106554 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13ea9b-9624-4340-9094-97c2aed12fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:28.108152 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13ea9b-9624-4340-9094-97c2aed12fe7 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:28.117786 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1286/2571] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:15:28 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:15:28.122000 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fafa7f-9d47-45d2-a6de-f9cf9792f678 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:28.131873 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fafa7f-9d47-45d2-a6de-f9cf9792f678 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:28.136403 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eefc93f-607c-440b-bb4b-14cfe6e5dfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:28.137257 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefc93f-607c-440b-bb4b-14cfe6e5dfa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:28.137570 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefc93f-607c-440b-bb4b-14cfe6e5dfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:28.137842 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefc93f-607c-440b-bb4b-14cfe6e5dfa4 admin admin] PATH_INFO: `/v3/projects/2d6c2cf97738462ba5c0c7a330afb247/users/874b281365ed4858886fffda5917fadc/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:28.139776 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eefc93f-607c-440b-bb4b-14cfe6e5dfa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d6c2cf97738462ba5c0c7a330afb247, user_id=874b281365ed4858886fffda5917fadc, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:28.142708 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eefc93f-607c-440b-bb4b-14cfe6e5dfa4 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:28.152971 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1286/2572] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:15:28 2021] PUT /identity/v3/projects/2d6c2cf97738462ba5c0c7a330afb247/users/874b281365ed4858886fffda5917fadc/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:15:28.162933 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdac24-0589-4349-82b9-156234747c6f None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:28.163316 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdac24-0589-4349-82b9-156234747c6f None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:28.163691 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdac24-0589-4349-82b9-156234747c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:28.193050 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-f9cdac24-0589-4349-82b9-156234747c6f None None] MFA Rules not processed for user `874b281365ed4858886fffda5917fadc`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:28.194319 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-f9cdac24-0589-4349-82b9-156234747c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:28.259219 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1287/2573] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:15:28 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:28.269789 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eefc93f-607c-440b-bb4b-14cfe6e5dfa4 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:28.271510 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-7eefc93f-607c-440b-bb4b-14cfe6e5dfa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:28.329623 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eefc93f-607c-440b-bb4b-14cfe6e5dfa4 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:28.333274 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de345743-c01f-4aa0-a826-323d5f725508 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:28.333948 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de345743-c01f-4aa0-a826-323d5f725508 service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:28.334235 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de345743-c01f-4aa0-a826-323d5f725508 service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:28.334645 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de345743-c01f-4aa0-a826-323d5f725508 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:28.394213 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de345743-c01f-4aa0-a826-323d5f725508 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:28.395563 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de345743-c01f-4aa0-a826-323d5f725508 service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:28.404729 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1287/2574] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:28 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:15:31.770194 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d694e-f202-4e3d-bd95-323dabb80ed4 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:31.770574 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d694e-f202-4e3d-bd95-323dabb80ed4 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:31.770946 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d694e-f202-4e3d-bd95-323dabb80ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:31.788405 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-ae2d694e-f202-4e3d-bd95-323dabb80ed4 None None] MFA Rules not processed for user `b2f47cbf62d44a6ba7e6a6f0f2305630`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:31.790438 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-ae2d694e-f202-4e3d-bd95-323dabb80ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:31.850285 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1288/2575] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Dec 15 16:15:31 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:31.864279 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de345743-c01f-4aa0-a826-323d5f725508 service cinder] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:31.865826 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-de345743-c01f-4aa0-a826-323d5f725508 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:31.935629 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de345743-c01f-4aa0-a826-323d5f725508 service cinder] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:31.942370 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa5148-f114-4d8d-95d5-3e5d6f521912 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e3f652f76424e27a1d4329212d9b66d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:31.943078 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa5148-f114-4d8d-95d5-3e5d6f521912 service swift] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:31.943371 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa5148-f114-4d8d-95d5-3e5d6f521912 service swift] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:31.943706 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa5148-f114-4d8d-95d5-3e5d6f521912 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:31.952754 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa5148-f114-4d8d-95d5-3e5d6f521912 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:31.954467 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa5148-f114-4d8d-95d5-3e5d6f521912 service swift] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:31.954846 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d694e-f202-4e3d-bd95-323dabb80ed4 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:31.956220 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-ae2d694e-f202-4e3d-bd95-323dabb80ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:31.963451 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1288/2576] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Dec 15 16:15:31 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:15:31.969570 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d694e-f202-4e3d-bd95-323dabb80ed4 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:31.973153 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17652f-622d-4dad-8681-f381eff6b1ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:31.973854 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17652f-622d-4dad-8681-f381eff6b1ad service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:31.974135 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17652f-622d-4dad-8681-f381eff6b1ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:31.974415 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17652f-622d-4dad-8681-f381eff6b1ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:32.042736 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17652f-622d-4dad-8681-f381eff6b1ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:32.044163 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17652f-622d-4dad-8681-f381eff6b1ad service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:32.056415 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1289/2577] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:31 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:15:32.690548 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa5148-f114-4d8d-95d5-3e5d6f521912 service swift] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:32.702727 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa5148-f114-4d8d-95d5-3e5d6f521912 service swift] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:32.707323 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7b7af-c1d3-4da8-a825-b0dd0ab74f30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:32.708063 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7b7af-c1d3-4da8-a825-b0dd0ab74f30 service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:32.708562 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7b7af-c1d3-4da8-a825-b0dd0ab74f30 service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:32.708888 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7b7af-c1d3-4da8-a825-b0dd0ab74f30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:32.722802 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7b7af-c1d3-4da8-a825-b0dd0ab74f30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:32.724798 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7b7af-c1d3-4da8-a825-b0dd0ab74f30 service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:32.737417 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1289/2578] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:32 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:15:36.613731 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17652f-622d-4dad-8681-f381eff6b1ad service cinder] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:36.616240 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-7a17652f-622d-4dad-8681-f381eff6b1ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:36.706343 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17652f-622d-4dad-8681-f381eff6b1ad service cinder] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:36.710853 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ae391-8c24-4f28-8a77-83d3c106877b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:36.711899 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ae391-8c24-4f28-8a77-83d3c106877b service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:36.712429 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ae391-8c24-4f28-8a77-83d3c106877b service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:36.712926 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ae391-8c24-4f28-8a77-83d3c106877b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:36.715463 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-3c5ae391-8c24-4f28-8a77-83d3c106877b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:36.894716 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ae391-8c24-4f28-8a77-83d3c106877b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:36.896277 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ae391-8c24-4f28-8a77-83d3c106877b service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:36.930312 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1290/2579] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:36 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:15:36.938818 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7b7af-c1d3-4da8-a825-b0dd0ab74f30 service cinder] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:37.016586 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7b7af-c1d3-4da8-a825-b0dd0ab74f30 service cinder] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:37.023448 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed36bf6-020a-4c2d-8855-28c0da870b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:37.024374 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed36bf6-020a-4c2d-8855-28c0da870b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:37.024880 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed36bf6-020a-4c2d-8855-28c0da870b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:37.025140 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed36bf6-020a-4c2d-8855-28c0da870b33 admin admin] PATH_INFO: `/v3/users/f17646df5f3547eb9445edce093ec1ba` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:37.026489 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed36bf6-020a-4c2d-8855-28c0da870b33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f17646df5f3547eb9445edce093ec1ba)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:37.028382 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed36bf6-020a-4c2d-8855-28c0da870b33 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:37.110489 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-7ed36bf6-020a-4c2d-8855-28c0da870b33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f17646df5f3547eb9445edce093ec1ba'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:37.111735 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-7ed36bf6-020a-4c2d-8855-28c0da870b33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f17646df5f3547eb9445edce093ec1ba'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:37.112897 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-7ed36bf6-020a-4c2d-8855-28c0da870b33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f17646df5f3547eb9445edce093ec1ba'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:37.126700 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-7ed36bf6-020a-4c2d-8855-28c0da870b33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f17646df5f3547eb9445edce093ec1ba'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:37.137495 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-7ed36bf6-020a-4c2d-8855-28c0da870b33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f17646df5f3547eb9445edce093ec1ba'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:37.153334 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1290/2580] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:15:36 2021] DELETE /identity/v3/users/f17646df5f3547eb9445edce093ec1ba => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:15:37.158176 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1e4dc-879f-481a-8f0d-c6abeea5e3d2 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:37.158536 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1e4dc-879f-481a-8f0d-c6abeea5e3d2 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:37.159142 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1e4dc-879f-481a-8f0d-c6abeea5e3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:37.185137 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-b6d1e4dc-879f-481a-8f0d-c6abeea5e3d2 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:37.186688 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-b6d1e4dc-879f-481a-8f0d-c6abeea5e3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:37.263781 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1291/2581] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:15:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:37.274314 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed36bf6-020a-4c2d-8855-28c0da870b33 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:37.275845 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-7ed36bf6-020a-4c2d-8855-28c0da870b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:37.361407 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed36bf6-020a-4c2d-8855-28c0da870b33 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:37.365651 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f96ee-54ca-4f76-b934-ec67d7655d30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:37.366366 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f96ee-54ca-4f76-b934-ec67d7655d30 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:37.366744 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f96ee-54ca-4f76-b934-ec67d7655d30 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:37.367358 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f96ee-54ca-4f76-b934-ec67d7655d30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:37.383675 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f96ee-54ca-4f76-b934-ec67d7655d30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:37.385288 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f96ee-54ca-4f76-b934-ec67d7655d30 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:37.397909 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1291/2582] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:15:37.734591 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1e4dc-879f-481a-8f0d-c6abeea5e3d2 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:37.736599 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-b6d1e4dc-879f-481a-8f0d-c6abeea5e3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:37.755599 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1e4dc-879f-481a-8f0d-c6abeea5e3d2 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:37.760474 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95947dcc-a3ad-408b-a21e-9e24de80cde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:37.762111 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95947dcc-a3ad-408b-a21e-9e24de80cde8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:37.762111 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95947dcc-a3ad-408b-a21e-9e24de80cde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:37.762111 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95947dcc-a3ad-408b-a21e-9e24de80cde8 admin admin] PATH_INFO: `/v3/projects/331b5dc972d544d18f33eac32331096f` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:37.763517 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95947dcc-a3ad-408b-a21e-9e24de80cde8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=331b5dc972d544d18f33eac32331096f)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:37.767102 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95947dcc-a3ad-408b-a21e-9e24de80cde8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:37.829846 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-95947dcc-a3ad-408b-a21e-9e24de80cde8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '331b5dc972d544d18f33eac32331096f', 'request_id': 'req-95947dcc-a3ad-408b-a21e-9e24de80cde8'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:37.842561 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-95947dcc-a3ad-408b-a21e-9e24de80cde8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '331b5dc972d544d18f33eac32331096f', 'request_id': 'req-95947dcc-a3ad-408b-a21e-9e24de80cde8'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:37.848774 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-95947dcc-a3ad-408b-a21e-9e24de80cde8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '331b5dc972d544d18f33eac32331096f', 'request_id': 'req-95947dcc-a3ad-408b-a21e-9e24de80cde8'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:37.862427 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-95947dcc-a3ad-408b-a21e-9e24de80cde8 admin admin] The token cache is being invalidate because project 331b5dc972d544d18f33eac32331096f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:15:37.862766 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-95947dcc-a3ad-408b-a21e-9e24de80cde8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:37.865582 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-95947dcc-a3ad-408b-a21e-9e24de80cde8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:37.865582 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1292/2583] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:15:37 2021] DELETE /identity/v3/projects/331b5dc972d544d18f33eac32331096f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:15:37.870230 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f96ee-54ca-4f76-b934-ec67d7655d30 service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:37.880301 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f96ee-54ca-4f76-b934-ec67d7655d30 service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:37.951217 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342726c5-ba74-4713-a964-a0ad6e702b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:37.952157 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342726c5-ba74-4713-a964-a0ad6e702b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:37.952502 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342726c5-ba74-4713-a964-a0ad6e702b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:37.952848 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342726c5-ba74-4713-a964-a0ad6e702b28 admin admin] PATH_INFO: `/v3/users/ce2fc28910de4b1e9a5a027ced80324f` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:37.954353 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342726c5-ba74-4713-a964-a0ad6e702b28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce2fc28910de4b1e9a5a027ced80324f)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:37.956371 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342726c5-ba74-4713-a964-a0ad6e702b28 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:38.015208 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-342726c5-ba74-4713-a964-a0ad6e702b28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce2fc28910de4b1e9a5a027ced80324f'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:38.016004 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-342726c5-ba74-4713-a964-a0ad6e702b28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce2fc28910de4b1e9a5a027ced80324f'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:38.016578 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-342726c5-ba74-4713-a964-a0ad6e702b28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce2fc28910de4b1e9a5a027ced80324f'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:38.033443 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-342726c5-ba74-4713-a964-a0ad6e702b28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce2fc28910de4b1e9a5a027ced80324f'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:38.044529 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-342726c5-ba74-4713-a964-a0ad6e702b28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce2fc28910de4b1e9a5a027ced80324f'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:38.063951 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1292/2584] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:15:37 2021] DELETE /identity/v3/users/ce2fc28910de4b1e9a5a027ced80324f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:15:38.428239 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95947dcc-a3ad-408b-a21e-9e24de80cde8 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:38.429759 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-95947dcc-a3ad-408b-a21e-9e24de80cde8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:38.487726 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95947dcc-a3ad-408b-a21e-9e24de80cde8 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:38.560104 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c30611-25c9-493d-bb8d-5081b6a8e902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:38.561247 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c30611-25c9-493d-bb8d-5081b6a8e902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:38.561630 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c30611-25c9-493d-bb8d-5081b6a8e902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:38.561982 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c30611-25c9-493d-bb8d-5081b6a8e902 admin admin] PATH_INFO: `/v3/projects/a58d4249ba0a4f4489dd84f7c3fc0583` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:38.563304 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c30611-25c9-493d-bb8d-5081b6a8e902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58d4249ba0a4f4489dd84f7c3fc0583)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:38.565819 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c30611-25c9-493d-bb8d-5081b6a8e902 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:38.631102 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-70c30611-25c9-493d-bb8d-5081b6a8e902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58d4249ba0a4f4489dd84f7c3fc0583', 'request_id': 'req-70c30611-25c9-493d-bb8d-5081b6a8e902'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:38.640250 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-70c30611-25c9-493d-bb8d-5081b6a8e902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58d4249ba0a4f4489dd84f7c3fc0583', 'request_id': 'req-70c30611-25c9-493d-bb8d-5081b6a8e902'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:38.646966 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-70c30611-25c9-493d-bb8d-5081b6a8e902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58d4249ba0a4f4489dd84f7c3fc0583', 'request_id': 'req-70c30611-25c9-493d-bb8d-5081b6a8e902'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:38.662363 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-70c30611-25c9-493d-bb8d-5081b6a8e902 admin admin] The token cache is being invalidate because project a58d4249ba0a4f4489dd84f7c3fc0583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:15:38.662752 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-70c30611-25c9-493d-bb8d-5081b6a8e902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:38.663555 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-70c30611-25c9-493d-bb8d-5081b6a8e902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:38.669948 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1293/2585] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:15:38 2021] DELETE /identity/v3/projects/a58d4249ba0a4f4489dd84f7c3fc0583 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:15:38.671460 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342726c5-ba74-4713-a964-a0ad6e702b28 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:38.673096 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-342726c5-ba74-4713-a964-a0ad6e702b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:38.691705 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342726c5-ba74-4713-a964-a0ad6e702b28 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:38.771497 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201e36f-81de-40aa-97a7-d13f678d9afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:38.772290 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201e36f-81de-40aa-97a7-d13f678d9afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:38.772572 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201e36f-81de-40aa-97a7-d13f678d9afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:38.772852 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201e36f-81de-40aa-97a7-d13f678d9afb admin admin] PATH_INFO: `/v3/users/874b281365ed4858886fffda5917fadc` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:38.774757 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201e36f-81de-40aa-97a7-d13f678d9afb admin admin] RBAC: Authorizing `identity:delete_user(user_id=874b281365ed4858886fffda5917fadc)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:38.776691 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201e36f-81de-40aa-97a7-d13f678d9afb admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:38.829617 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-d201e36f-81de-40aa-97a7-d13f678d9afb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '874b281365ed4858886fffda5917fadc'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:38.830329 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-d201e36f-81de-40aa-97a7-d13f678d9afb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '874b281365ed4858886fffda5917fadc'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:38.832810 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-d201e36f-81de-40aa-97a7-d13f678d9afb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '874b281365ed4858886fffda5917fadc'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:38.844350 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-d201e36f-81de-40aa-97a7-d13f678d9afb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '874b281365ed4858886fffda5917fadc'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:38.854228 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-d201e36f-81de-40aa-97a7-d13f678d9afb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '874b281365ed4858886fffda5917fadc'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:38.868679 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1293/2586] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:15:38 2021] DELETE /identity/v3/users/874b281365ed4858886fffda5917fadc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:15:39.201291 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c30611-25c9-493d-bb8d-5081b6a8e902 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:39.203700 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-70c30611-25c9-493d-bb8d-5081b6a8e902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:39.220183 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c30611-25c9-493d-bb8d-5081b6a8e902 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:39.301797 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d6761-c984-4566-93ea-46bf51ad5453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:39.302604 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d6761-c984-4566-93ea-46bf51ad5453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:39.302888 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d6761-c984-4566-93ea-46bf51ad5453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:39.303165 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d6761-c984-4566-93ea-46bf51ad5453 admin admin] PATH_INFO: `/v3/projects/2d6c2cf97738462ba5c0c7a330afb247` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:39.307734 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d6761-c984-4566-93ea-46bf51ad5453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d6c2cf97738462ba5c0c7a330afb247)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:39.310088 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d6761-c984-4566-93ea-46bf51ad5453 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:39.366166 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-990d6761-c984-4566-93ea-46bf51ad5453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d6c2cf97738462ba5c0c7a330afb247', 'request_id': 'req-990d6761-c984-4566-93ea-46bf51ad5453'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:39.378798 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-990d6761-c984-4566-93ea-46bf51ad5453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d6c2cf97738462ba5c0c7a330afb247', 'request_id': 'req-990d6761-c984-4566-93ea-46bf51ad5453'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:39.385885 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-990d6761-c984-4566-93ea-46bf51ad5453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d6c2cf97738462ba5c0c7a330afb247', 'request_id': 'req-990d6761-c984-4566-93ea-46bf51ad5453'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:39.398883 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-990d6761-c984-4566-93ea-46bf51ad5453 admin admin] The token cache is being invalidate because project 2d6c2cf97738462ba5c0c7a330afb247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:15:39.399144 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-990d6761-c984-4566-93ea-46bf51ad5453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:39.399936 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-990d6761-c984-4566-93ea-46bf51ad5453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:39.413549 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1294/2587] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:15:39 2021] DELETE /identity/v3/projects/2d6c2cf97738462ba5c0c7a330afb247 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:15:45.198311 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201e36f-81de-40aa-97a7-d13f678d9afb admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:45.200183 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-d201e36f-81de-40aa-97a7-d13f678d9afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:45.292118 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201e36f-81de-40aa-97a7-d13f678d9afb admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:45.361100 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b4c2a-a186-4258-9095-5835e1619619 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:45.361804 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b4c2a-a186-4258-9095-5835e1619619 service nova] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:45.362092 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b4c2a-a186-4258-9095-5835e1619619 service nova] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:45.362373 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b4c2a-a186-4258-9095-5835e1619619 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:45.364504 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f26b4c2a-a186-4258-9095-5835e1619619 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:45.432194 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b4c2a-a186-4258-9095-5835e1619619 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:45.434117 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b4c2a-a186-4258-9095-5835e1619619 service nova] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:45.443847 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1294/2588] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:45 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:15:48.172191 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abc875-2803-427c-827f-c279bc1ad21d None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:48.172726 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abc875-2803-427c-827f-c279bc1ad21d None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:48.172822 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abc875-2803-427c-827f-c279bc1ad21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:48.181811 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b4c2a-a186-4258-9095-5835e1619619 service nova] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:48.183294 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f26b4c2a-a186-4258-9095-5835e1619619 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:48.191484 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-f8abc875-2803-427c-827f-c279bc1ad21d None None] MFA Rules not processed for user `b2f47cbf62d44a6ba7e6a6f0f2305630`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:48.194024 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-f8abc875-2803-427c-827f-c279bc1ad21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:48.245364 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b4c2a-a186-4258-9095-5835e1619619 service nova] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:48.252740 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1295/2589] 10.222.0.36 () {58 vars in 967 bytes} [Wed Dec 15 16:15:48 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:48.253067 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30508e-15d0-4c10-b1d1-71a5a9859ac9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:48.253817 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30508e-15d0-4c10-b1d1-71a5a9859ac9 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:48.254102 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30508e-15d0-4c10-b1d1-71a5a9859ac9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:48.254539 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30508e-15d0-4c10-b1d1-71a5a9859ac9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:48.256387 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-ff30508e-15d0-4c10-b1d1-71a5a9859ac9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:48.270466 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abc875-2803-427c-827f-c279bc1ad21d None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:48.274232 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-f8abc875-2803-427c-827f-c279bc1ad21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:48.276703 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30508e-15d0-4c10-b1d1-71a5a9859ac9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:48.278419 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30508e-15d0-4c10-b1d1-71a5a9859ac9 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:48.293158 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1295/2590] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:48 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:15:48.353365 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abc875-2803-427c-827f-c279bc1ad21d None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:48.358856 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb02e1-5ad3-4ea1-87bd-c8cdafca8e0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e3f652f76424e27a1d4329212d9b66d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:48.360151 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb02e1-5ad3-4ea1-87bd-c8cdafca8e0d service swift] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:48.360434 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb02e1-5ad3-4ea1-87bd-c8cdafca8e0d service swift] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:48.360739 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb02e1-5ad3-4ea1-87bd-c8cdafca8e0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:48.370595 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb02e1-5ad3-4ea1-87bd-c8cdafca8e0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:48.372220 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb02e1-5ad3-4ea1-87bd-c8cdafca8e0d service swift] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:48.381095 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1296/2591] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Dec 15 16:15:48 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:15:50.316189 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30508e-15d0-4c10-b1d1-71a5a9859ac9 service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:50.317749 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-ff30508e-15d0-4c10-b1d1-71a5a9859ac9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:50.379319 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30508e-15d0-4c10-b1d1-71a5a9859ac9 service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:50.384373 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64e504-cef2-4bf0-99c5-acdf691d544f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:50.385257 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64e504-cef2-4bf0-99c5-acdf691d544f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:50.385566 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64e504-cef2-4bf0-99c5-acdf691d544f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:50.385840 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64e504-cef2-4bf0-99c5-acdf691d544f admin admin] PATH_INFO: `/v3/users/ffd7b536c17849f0b4b790e589c4cef0` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:50.387025 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64e504-cef2-4bf0-99c5-acdf691d544f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffd7b536c17849f0b4b790e589c4cef0)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:50.388971 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64e504-cef2-4bf0-99c5-acdf691d544f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:50.433627 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-0b64e504-cef2-4bf0-99c5-acdf691d544f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffd7b536c17849f0b4b790e589c4cef0'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:50.434279 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-0b64e504-cef2-4bf0-99c5-acdf691d544f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffd7b536c17849f0b4b790e589c4cef0'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:50.434891 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-0b64e504-cef2-4bf0-99c5-acdf691d544f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffd7b536c17849f0b4b790e589c4cef0'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:50.446656 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-0b64e504-cef2-4bf0-99c5-acdf691d544f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffd7b536c17849f0b4b790e589c4cef0'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:50.454581 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-0b64e504-cef2-4bf0-99c5-acdf691d544f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffd7b536c17849f0b4b790e589c4cef0'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:50.466877 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1296/2592] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:15:50 2021] DELETE /identity/v3/users/ffd7b536c17849f0b4b790e589c4cef0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:15:50.636289 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb02e1-5ad3-4ea1-87bd-c8cdafca8e0d service swift] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:50.647756 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb02e1-5ad3-4ea1-87bd-c8cdafca8e0d service swift] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:50.710527 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef6a6a-7f7b-4468-88e6-f9f02500a5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:50.711475 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef6a6a-7f7b-4468-88e6-f9f02500a5e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:50.711843 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef6a6a-7f7b-4468-88e6-f9f02500a5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:50.712122 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef6a6a-7f7b-4468-88e6-f9f02500a5e5 admin admin] PATH_INFO: `/v3/projects/0ca560754a9c4530ba707aef9b98cff8` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:50.713328 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef6a6a-7f7b-4468-88e6-f9f02500a5e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ca560754a9c4530ba707aef9b98cff8)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:50.715311 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef6a6a-7f7b-4468-88e6-f9f02500a5e5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:50.762306 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-75ef6a6a-7f7b-4468-88e6-f9f02500a5e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ca560754a9c4530ba707aef9b98cff8', 'request_id': 'req-75ef6a6a-7f7b-4468-88e6-f9f02500a5e5'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:50.769259 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-75ef6a6a-7f7b-4468-88e6-f9f02500a5e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ca560754a9c4530ba707aef9b98cff8', 'request_id': 'req-75ef6a6a-7f7b-4468-88e6-f9f02500a5e5'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:50.774576 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-75ef6a6a-7f7b-4468-88e6-f9f02500a5e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ca560754a9c4530ba707aef9b98cff8', 'request_id': 'req-75ef6a6a-7f7b-4468-88e6-f9f02500a5e5'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:50.785098 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-75ef6a6a-7f7b-4468-88e6-f9f02500a5e5 admin admin] The token cache is being invalidate because project 0ca560754a9c4530ba707aef9b98cff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:15:50.785378 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-75ef6a6a-7f7b-4468-88e6-f9f02500a5e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:50.786282 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-75ef6a6a-7f7b-4468-88e6-f9f02500a5e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:15:50.787801 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1297/2593] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:15:50 2021] DELETE /identity/v3/projects/0ca560754a9c4530ba707aef9b98cff8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:15:50.795740 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09282fdd-b2b1-4b4e-a586-f919be0188f0 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:50.796025 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09282fdd-b2b1-4b4e-a586-f919be0188f0 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:50.796298 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09282fdd-b2b1-4b4e-a586-f919be0188f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:50.815065 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-09282fdd-b2b1-4b4e-a586-f919be0188f0 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:50.816255 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-09282fdd-b2b1-4b4e-a586-f919be0188f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:50.874391 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1297/2594] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:15:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:15:50.882110 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafcdde-85f5-42be-95c3-8f3701c7208f None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:50.882340 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafcdde-85f5-42be-95c3-8f3701c7208f None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:50.882617 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafcdde-85f5-42be-95c3-8f3701c7208f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:50.901579 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-8bafcdde-85f5-42be-95c3-8f3701c7208f None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:50.902786 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-8bafcdde-85f5-42be-95c3-8f3701c7208f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:50.910770 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1298/2595] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:15:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:50.915675 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09282fdd-b2b1-4b4e-a586-f919be0188f0 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:50.925133 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09282fdd-b2b1-4b4e-a586-f919be0188f0 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:50.929678 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4076af-c558-44c6-a51c-ca0e84b2393c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:50.931058 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4076af-c558-44c6-a51c-ca0e84b2393c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:50.931337 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4076af-c558-44c6-a51c-ca0e84b2393c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:50.931637 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4076af-c558-44c6-a51c-ca0e84b2393c admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:50.932361 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4076af-c558-44c6-a51c-ca0e84b2393c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:15:50.932664 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4076af-c558-44c6-a51c-ca0e84b2393c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:50.934293 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4076af-c558-44c6-a51c-ca0e84b2393c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:50.945354 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1298/2596] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:15:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:15:50.949521 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafcdde-85f5-42be-95c3-8f3701c7208f None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:50.958708 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafcdde-85f5-42be-95c3-8f3701c7208f None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:50.963384 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cefcd-8991-43e4-afac-571cbbeb4be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:50.964027 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cefcd-8991-43e4-afac-571cbbeb4be9 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:50.964615 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cefcd-8991-43e4-afac-571cbbeb4be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:50.964615 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cefcd-8991-43e4-afac-571cbbeb4be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:50.965267 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cefcd-8991-43e4-afac-571cbbeb4be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:50.967215 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cefcd-8991-43e4-afac-571cbbeb4be9 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:50.993594 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1299/2597] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:15:50 2021] POST /identity/v3/projects => generated 361 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:15:50.997758 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4076af-c558-44c6-a51c-ca0e84b2393c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:51.007551 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4076af-c558-44c6-a51c-ca0e84b2393c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:51.062904 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f012028-8279-4e91-a1cd-af03fdb7175e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:51.063568 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f012028-8279-4e91-a1cd-af03fdb7175e admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:51.063847 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f012028-8279-4e91-a1cd-af03fdb7175e admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:51.064119 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f012028-8279-4e91-a1cd-af03fdb7175e admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:51.064808 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f012028-8279-4e91-a1cd-af03fdb7175e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:51.066914 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f012028-8279-4e91-a1cd-af03fdb7175e admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:51.086340 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1299/2598] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:15:50 2021] POST /identity/v3/users => generated 281 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:15:51.090438 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cefcd-8991-43e4-afac-571cbbeb4be9 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:51.100409 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cefcd-8991-43e4-afac-571cbbeb4be9 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:51.105755 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7dadf3-4955-4a64-bf86-0349a0467d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:51.106425 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dadf3-4955-4a64-bf86-0349a0467d0f admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:51.106702 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dadf3-4955-4a64-bf86-0349a0467d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:51.106968 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dadf3-4955-4a64-bf86-0349a0467d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:51.107690 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7dadf3-4955-4a64-bf86-0349a0467d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:51.109270 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7dadf3-4955-4a64-bf86-0349a0467d0f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:51.121584 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1300/2599] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:15:51 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:15:51.125483 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f012028-8279-4e91-a1cd-af03fdb7175e admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:51.135178 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f012028-8279-4e91-a1cd-af03fdb7175e admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:51.139708 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d680193-77a6-4470-b3f1-6dd2d5790c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:51.140350 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d680193-77a6-4470-b3f1-6dd2d5790c66 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:51.140633 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d680193-77a6-4470-b3f1-6dd2d5790c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:51.140906 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d680193-77a6-4470-b3f1-6dd2d5790c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:51.141672 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d680193-77a6-4470-b3f1-6dd2d5790c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:51.143247 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d680193-77a6-4470-b3f1-6dd2d5790c66 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:51.152712 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1300/2600] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:15:51 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:15:51.156488 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7dadf3-4955-4a64-bf86-0349a0467d0f admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:51.167105 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7dadf3-4955-4a64-bf86-0349a0467d0f admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:51.171699 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6316f-531f-44d3-8bba-587681d3a333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:51.172556 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6316f-531f-44d3-8bba-587681d3a333 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:51.172836 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6316f-531f-44d3-8bba-587681d3a333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:51.173107 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6316f-531f-44d3-8bba-587681d3a333 admin admin] PATH_INFO: `/v3/projects/79c6ec26cbf943e0b7fab9be8713342b/users/ce0c23f8257a4780a1c4f629097dcd2c/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:51.187430 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6316f-531f-44d3-8bba-587681d3a333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c6ec26cbf943e0b7fab9be8713342b, user_id=ce0c23f8257a4780a1c4f629097dcd2c, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:51.190132 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6316f-531f-44d3-8bba-587681d3a333 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:51.202695 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1301/2601] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:15:51 2021] PUT /identity/v3/projects/79c6ec26cbf943e0b7fab9be8713342b/users/ce0c23f8257a4780a1c4f629097dcd2c/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:15:51.212709 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15531e-f4a2-4f25-ae01-68ffd6df32fc None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:51.212995 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15531e-f4a2-4f25-ae01-68ffd6df32fc None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:51.213320 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15531e-f4a2-4f25-ae01-68ffd6df32fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:51.239576 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-8f15531e-f4a2-4f25-ae01-68ffd6df32fc None None] MFA Rules not processed for user `ce0c23f8257a4780a1c4f629097dcd2c`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:15:51.240764 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-8f15531e-f4a2-4f25-ae01-68ffd6df32fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:51.302162 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1301/2602] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:15:51 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:15:51.312888 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6316f-531f-44d3-8bba-587681d3a333 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:15:51.314647 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-afd6316f-531f-44d3-8bba-587681d3a333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:15:51.369745 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6316f-531f-44d3-8bba-587681d3a333 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:15:51.373301 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9e308-8a78-4242-bc53-488089ad740b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:15:51.373962 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9e308-8a78-4242-bc53-488089ad740b service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:15:51.374241 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9e308-8a78-4242-bc53-488089ad740b service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:15:51.374515 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9e308-8a78-4242-bc53-488089ad740b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:15:51.382623 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9e308-8a78-4242-bc53-488089ad740b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:15:51.384185 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9e308-8a78-4242-bc53-488089ad740b service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:15:51.392763 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1302/2603] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:15:51 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:16:01.219230 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15531e-f4a2-4f25-ae01-68ffd6df32fc None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:16:01.221297 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-8f15531e-f4a2-4f25-ae01-68ffd6df32fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:01.288887 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15531e-f4a2-4f25-ae01-68ffd6df32fc None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:16:01.292898 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c52be-2890-4b81-975c-763511a8b4a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:16:01.293574 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c52be-2890-4b81-975c-763511a8b4a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:01.293856 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c52be-2890-4b81-975c-763511a8b4a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:01.294129 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c52be-2890-4b81-975c-763511a8b4a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:01.295890 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-2d7c52be-2890-4b81-975c-763511a8b4a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:01.307140 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c52be-2890-4b81-975c-763511a8b4a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:16:01.308471 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c52be-2890-4b81-975c-763511a8b4a1 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:16:01.317369 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1302/2604] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:16:01 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:16:05.057637 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9e308-8a78-4242-bc53-488089ad740b service cinder] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:16:05.059179 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-1ac9e308-8a78-4242-bc53-488089ad740b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:05.136917 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9e308-8a78-4242-bc53-488089ad740b service cinder] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:16:05.142190 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f3724-6574-47c5-8c10-28e5e507633b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e186d6728a2341399252238c559002f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:16:05.142832 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f3724-6574-47c5-8c10-28e5e507633b service placement] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:05.143113 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f3724-6574-47c5-8c10-28e5e507633b service placement] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:05.143384 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f3724-6574-47c5-8c10-28e5e507633b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:05.145136 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-1b0f3724-6574-47c5-8c10-28e5e507633b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:05.157814 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f3724-6574-47c5-8c10-28e5e507633b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:16:05.159659 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f3724-6574-47c5-8c10-28e5e507633b service placement] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:16:05.171411 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1303/2605] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:16:05 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:16:17.110207 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c52be-2890-4b81-975c-763511a8b4a1 service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:16:17.111683 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-2d7c52be-2890-4b81-975c-763511a8b4a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:17.187831 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c52be-2890-4b81-975c-763511a8b4a1 service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:16:17.193283 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e02f5-9bac-4ee9-b4bb-064216ea815f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:16:17.193954 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e02f5-9bac-4ee9-b4bb-064216ea815f service nova] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:17.194232 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e02f5-9bac-4ee9-b4bb-064216ea815f service nova] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:17.194501 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e02f5-9bac-4ee9-b4bb-064216ea815f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:17.196899 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-e63e02f5-9bac-4ee9-b4bb-064216ea815f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:17.210187 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e02f5-9bac-4ee9-b4bb-064216ea815f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:16:17.212478 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e02f5-9bac-4ee9-b4bb-064216ea815f service nova] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:16:17.223327 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1303/2606] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:16:17 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:16:23.161673 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09b94e-9952-42d9-874e-6e9d3da8ccfb None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:23.162565 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09b94e-9952-42d9-874e-6e9d3da8ccfb None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:23.163062 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09b94e-9952-42d9-874e-6e9d3da8ccfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:23.182750 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-1c09b94e-9952-42d9-874e-6e9d3da8ccfb None None] MFA Rules not processed for user `b2f47cbf62d44a6ba7e6a6f0f2305630`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:16:23.183961 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-1c09b94e-9952-42d9-874e-6e9d3da8ccfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:23.242042 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1304/2607] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Dec 15 16:16:23 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:16:23.265774 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e02f5-9bac-4ee9-b4bb-064216ea815f service nova] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:16:23.267256 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-e63e02f5-9bac-4ee9-b4bb-064216ea815f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:23.360776 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e02f5-9bac-4ee9-b4bb-064216ea815f service nova] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:16:23.366838 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c8ad9-2392-432c-a4cf-622f7f1d89b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e3f652f76424e27a1d4329212d9b66d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:16:23.368278 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c8ad9-2392-432c-a4cf-622f7f1d89b8 service swift] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:23.368725 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c8ad9-2392-432c-a4cf-622f7f1d89b8 service swift] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:23.369175 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c8ad9-2392-432c-a4cf-622f7f1d89b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:23.379591 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c8ad9-2392-432c-a4cf-622f7f1d89b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:16:23.381888 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c8ad9-2392-432c-a4cf-622f7f1d89b8 service swift] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:16:23.391953 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1304/2608] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Dec 15 16:16:23 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 16:16:29.337287 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09b94e-9952-42d9-874e-6e9d3da8ccfb None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:16:29.419793 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09b94e-9952-42d9-874e-6e9d3da8ccfb None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:16:29.425271 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873bd52-4280-4bbb-8cf3-0145cb26aa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:16:29.426465 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873bd52-4280-4bbb-8cf3-0145cb26aa9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:29.426755 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873bd52-4280-4bbb-8cf3-0145cb26aa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:29.427036 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873bd52-4280-4bbb-8cf3-0145cb26aa9d admin admin] PATH_INFO: `/v3/users/ce0c23f8257a4780a1c4f629097dcd2c` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:29.428328 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873bd52-4280-4bbb-8cf3-0145cb26aa9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce0c23f8257a4780a1c4f629097dcd2c)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:16:29.431063 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873bd52-4280-4bbb-8cf3-0145cb26aa9d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:16:29.492305 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-1873bd52-4280-4bbb-8cf3-0145cb26aa9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce0c23f8257a4780a1c4f629097dcd2c'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:16:29.494198 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-1873bd52-4280-4bbb-8cf3-0145cb26aa9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce0c23f8257a4780a1c4f629097dcd2c'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:16:29.501452 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-1873bd52-4280-4bbb-8cf3-0145cb26aa9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce0c23f8257a4780a1c4f629097dcd2c'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:16:29.502311 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-1873bd52-4280-4bbb-8cf3-0145cb26aa9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce0c23f8257a4780a1c4f629097dcd2c'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:16:29.520476 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-1873bd52-4280-4bbb-8cf3-0145cb26aa9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce0c23f8257a4780a1c4f629097dcd2c'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:16:29.541079 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1305/2609] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:16:29 2021] DELETE /identity/v3/users/ce0c23f8257a4780a1c4f629097dcd2c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:16:29.547068 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176a65a-2ba9-4f3d-96ad-545f8ff18595 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:29.547619 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176a65a-2ba9-4f3d-96ad-545f8ff18595 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:29.547890 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176a65a-2ba9-4f3d-96ad-545f8ff18595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:29.573159 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-0176a65a-2ba9-4f3d-96ad-545f8ff18595 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:16:29.575264 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-0176a65a-2ba9-4f3d-96ad-545f8ff18595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:29.651171 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1305/2610] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:16:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:16:29.661444 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873bd52-4280-4bbb-8cf3-0145cb26aa9d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:16:29.666731 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-1873bd52-4280-4bbb-8cf3-0145cb26aa9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:29.742787 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873bd52-4280-4bbb-8cf3-0145cb26aa9d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:16:29.748272 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cdca8-ee6a-4244-90f1-23daab6f5e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:16:29.749121 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cdca8-ee6a-4244-90f1-23daab6f5e0d service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:29.749616 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cdca8-ee6a-4244-90f1-23daab6f5e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:29.750095 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cdca8-ee6a-4244-90f1-23daab6f5e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:29.762967 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cdca8-ee6a-4244-90f1-23daab6f5e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:16:29.764930 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cdca8-ee6a-4244-90f1-23daab6f5e0d service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:16:29.777229 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1306/2611] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:16:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:16:30.137571 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176a65a-2ba9-4f3d-96ad-545f8ff18595 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:16:30.139211 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-0176a65a-2ba9-4f3d-96ad-545f8ff18595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:30.157888 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176a65a-2ba9-4f3d-96ad-545f8ff18595 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:16:30.168296 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b7718-6d84-485f-b896-2fc3396b7ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:16:30.169410 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b7718-6d84-485f-b896-2fc3396b7ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:30.169881 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b7718-6d84-485f-b896-2fc3396b7ced admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:30.172100 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b7718-6d84-485f-b896-2fc3396b7ced admin admin] PATH_INFO: `/v3/projects/79c6ec26cbf943e0b7fab9be8713342b` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:30.173616 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b7718-6d84-485f-b896-2fc3396b7ced admin admin] RBAC: Authorizing `identity:delete_project(project_id=79c6ec26cbf943e0b7fab9be8713342b)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:16:30.176005 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b7718-6d84-485f-b896-2fc3396b7ced admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:16:30.246964 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-5b1b7718-6d84-485f-b896-2fc3396b7ced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79c6ec26cbf943e0b7fab9be8713342b', 'request_id': 'req-5b1b7718-6d84-485f-b896-2fc3396b7ced'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:16:30.256075 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-5b1b7718-6d84-485f-b896-2fc3396b7ced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79c6ec26cbf943e0b7fab9be8713342b', 'request_id': 'req-5b1b7718-6d84-485f-b896-2fc3396b7ced'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:16:30.263689 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-5b1b7718-6d84-485f-b896-2fc3396b7ced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79c6ec26cbf943e0b7fab9be8713342b', 'request_id': 'req-5b1b7718-6d84-485f-b896-2fc3396b7ced'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:16:30.286785 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-5b1b7718-6d84-485f-b896-2fc3396b7ced admin admin] The token cache is being invalidate because project 79c6ec26cbf943e0b7fab9be8713342b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:16:30.287333 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-5b1b7718-6d84-485f-b896-2fc3396b7ced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:16:30.289640 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-5b1b7718-6d84-485f-b896-2fc3396b7ced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:16:30.293441 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1306/2612] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:16:30 2021] DELETE /identity/v3/projects/79c6ec26cbf943e0b7fab9be8713342b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:16:30.298070 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9e056-9050-4fd6-9993-1e69b08e6ead None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:30.298747 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9e056-9050-4fd6-9993-1e69b08e6ead None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:30.299243 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9e056-9050-4fd6-9993-1e69b08e6ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:30.327730 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-fde9e056-9050-4fd6-9993-1e69b08e6ead None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:16:30.328947 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-fde9e056-9050-4fd6-9993-1e69b08e6ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:30.420683 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1307/2613] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:16:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:16:30.428447 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a599e-03d4-400a-9790-d6a489e1860d None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:30.428832 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a599e-03d4-400a-9790-d6a489e1860d None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:30.429183 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a599e-03d4-400a-9790-d6a489e1860d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:30.459948 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-451a599e-03d4-400a-9790-d6a489e1860d None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:16:30.461269 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-451a599e-03d4-400a-9790-d6a489e1860d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:30.470749 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1307/2614] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:16:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:16:30.475190 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9e056-9050-4fd6-9993-1e69b08e6ead None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:16:30.492104 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9e056-9050-4fd6-9993-1e69b08e6ead None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:16:30.499570 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc0d54-94b3-4872-96fb-7ce0788df85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:16:30.500749 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc0d54-94b3-4872-96fb-7ce0788df85f admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:30.501249 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc0d54-94b3-4872-96fb-7ce0788df85f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:30.501556 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc0d54-94b3-4872-96fb-7ce0788df85f admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:30.502294 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc0d54-94b3-4872-96fb-7ce0788df85f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:16:30.502607 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc0d54-94b3-4872-96fb-7ce0788df85f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:16:30.504223 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc0d54-94b3-4872-96fb-7ce0788df85f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:16:30.518089 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1308/2615] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:16:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:16:30.522482 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a599e-03d4-400a-9790-d6a489e1860d None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:16:30.532914 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a599e-03d4-400a-9790-d6a489e1860d None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:16:30.538346 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb3dc3-f62c-4f3d-9b34-da20b0d1e94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:16:30.539128 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb3dc3-f62c-4f3d-9b34-da20b0d1e94c admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:30.539485 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb3dc3-f62c-4f3d-9b34-da20b0d1e94c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:30.540535 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb3dc3-f62c-4f3d-9b34-da20b0d1e94c admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:30.541370 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb3dc3-f62c-4f3d-9b34-da20b0d1e94c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:16:30.543432 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb3dc3-f62c-4f3d-9b34-da20b0d1e94c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:16:30.577826 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1308/2616] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:16:30 2021] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:16:30.581822 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc0d54-94b3-4872-96fb-7ce0788df85f admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:16:30.593995 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc0d54-94b3-4872-96fb-7ce0788df85f admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:16:30.685109 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77e86b-169b-4407-a284-095f028996ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:16:30.686191 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77e86b-169b-4407-a284-095f028996ac admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:30.686729 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77e86b-169b-4407-a284-095f028996ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:30.687219 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77e86b-169b-4407-a284-095f028996ac admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:30.688328 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77e86b-169b-4407-a284-095f028996ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:16:30.690582 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77e86b-169b-4407-a284-095f028996ac admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:16:30.718448 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1309/2617] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:16:30 2021] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:16:30.722380 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb3dc3-f62c-4f3d-9b34-da20b0d1e94c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:16:30.736854 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb3dc3-f62c-4f3d-9b34-da20b0d1e94c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:16:30.742101 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7122f-9213-4b10-be51-474397b41184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:16:30.743457 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7122f-9213-4b10-be51-474397b41184 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:30.743843 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7122f-9213-4b10-be51-474397b41184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:30.744168 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7122f-9213-4b10-be51-474397b41184 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:30.744997 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7122f-9213-4b10-be51-474397b41184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:16:30.746785 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7122f-9213-4b10-be51-474397b41184 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:16:30.760197 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1309/2618] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:16:30 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:16:30.763950 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77e86b-169b-4407-a284-095f028996ac admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:16:30.777209 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77e86b-169b-4407-a284-095f028996ac admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:16:30.790492 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c9e92-11e8-4d43-b169-922aeaa1e5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:16:30.792541 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c9e92-11e8-4d43-b169-922aeaa1e5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:30.793836 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c9e92-11e8-4d43-b169-922aeaa1e5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:30.794852 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c9e92-11e8-4d43-b169-922aeaa1e5f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:30.795867 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c9e92-11e8-4d43-b169-922aeaa1e5f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:16:30.799184 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c9e92-11e8-4d43-b169-922aeaa1e5f5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:16:30.821469 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1310/2619] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:16:30 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:16:30.825982 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7122f-9213-4b10-be51-474397b41184 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:16:30.840257 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7122f-9213-4b10-be51-474397b41184 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:16:30.845680 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ee45f-70e3-497b-9616-3938c0d71f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:16:30.846591 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ee45f-70e3-497b-9616-3938c0d71f50 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:30.846878 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ee45f-70e3-497b-9616-3938c0d71f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:30.847160 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ee45f-70e3-497b-9616-3938c0d71f50 admin admin] PATH_INFO: `/v3/projects/767457cee9584e02afc690428a89a898/users/f4de2a2126b2414896bcf84605ec5760/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:30.873158 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ee45f-70e3-497b-9616-3938c0d71f50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=767457cee9584e02afc690428a89a898, user_id=f4de2a2126b2414896bcf84605ec5760, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:16:30.879492 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ee45f-70e3-497b-9616-3938c0d71f50 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:16:30.900356 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1310/2620] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:16:30 2021] PUT /identity/v3/projects/767457cee9584e02afc690428a89a898/users/f4de2a2126b2414896bcf84605ec5760/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:16:30.910523 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d822df-9811-4b8b-a411-73286b630574 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:30.910816 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d822df-9811-4b8b-a411-73286b630574 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:30.911091 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d822df-9811-4b8b-a411-73286b630574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:30.941213 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-45d822df-9811-4b8b-a411-73286b630574 None None] MFA Rules not processed for user `f4de2a2126b2414896bcf84605ec5760`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:16:30.942400 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-45d822df-9811-4b8b-a411-73286b630574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:31.019221 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1311/2621] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:16:30 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:16:31.029498 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ee45f-70e3-497b-9616-3938c0d71f50 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:16:31.031676 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-926ee45f-70e3-497b-9616-3938c0d71f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:31.101357 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ee45f-70e3-497b-9616-3938c0d71f50 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:16:31.106490 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e615e01-be6f-490d-bcc0-7e8625c9d80b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:16:31.107267 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e615e01-be6f-490d-bcc0-7e8625c9d80b service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:31.107604 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e615e01-be6f-490d-bcc0-7e8625c9d80b service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:31.107952 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e615e01-be6f-490d-bcc0-7e8625c9d80b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:31.116905 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e615e01-be6f-490d-bcc0-7e8625c9d80b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:16:31.118642 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e615e01-be6f-490d-bcc0-7e8625c9d80b service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:16:31.129000 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1311/2622] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:16:31 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:16:32.600028 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d55c7a-1ea3-4709-8750-9a04680d509a None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:32.600971 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d55c7a-1ea3-4709-8750-9a04680d509a None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:32.600971 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d55c7a-1ea3-4709-8750-9a04680d509a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:32.621333 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-a0d55c7a-1ea3-4709-8750-9a04680d509a None None] MFA Rules not processed for user `f4de2a2126b2414896bcf84605ec5760`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:16:32.622673 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-a0d55c7a-1ea3-4709-8750-9a04680d509a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:32.630440 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1312/2623] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:16:32 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:16:34.163103 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e615e01-be6f-490d-bcc0-7e8625c9d80b service cinder] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:16:34.165879 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-7e615e01-be6f-490d-bcc0-7e8625c9d80b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:34.394321 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e615e01-be6f-490d-bcc0-7e8625c9d80b service cinder] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:16:34.405782 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756242e-a3be-41a5-a5b2-c2718e9b7380 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:16:34.406832 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756242e-a3be-41a5-a5b2-c2718e9b7380 service nova] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:34.407297 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756242e-a3be-41a5-a5b2-c2718e9b7380 service nova] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:34.407884 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756242e-a3be-41a5-a5b2-c2718e9b7380 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:34.410329 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-9756242e-a3be-41a5-a5b2-c2718e9b7380 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:34.437269 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756242e-a3be-41a5-a5b2-c2718e9b7380 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:16:34.439003 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756242e-a3be-41a5-a5b2-c2718e9b7380 service nova] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:16:34.452688 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1312/2624] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:16:34 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:16:38.520916 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab1d7f-630b-4307-b76a-ea5a4968e928 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:38.521963 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab1d7f-630b-4307-b76a-ea5a4968e928 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:38.522400 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab1d7f-630b-4307-b76a-ea5a4968e928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:38.546897 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-a7ab1d7f-630b-4307-b76a-ea5a4968e928 None None] MFA Rules not processed for user `ff251ac504444235af8055f7a9c8e0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:16:38.548684 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-a7ab1d7f-630b-4307-b76a-ea5a4968e928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:38.625057 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1313/2625] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:16:38 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:16:38.955911 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756242e-a3be-41a5-a5b2-c2718e9b7380 service nova] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:16:38.957516 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-9756242e-a3be-41a5-a5b2-c2718e9b7380 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:39.015621 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756242e-a3be-41a5-a5b2-c2718e9b7380 service nova] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:16:39.019440 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e209765-fcca-4d91-ad0e-a50a941de90f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:16:39.020095 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e209765-fcca-4d91-ad0e-a50a941de90f service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:39.020388 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e209765-fcca-4d91-ad0e-a50a941de90f service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:39.020660 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e209765-fcca-4d91-ad0e-a50a941de90f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:39.022491 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-5e209765-fcca-4d91-ad0e-a50a941de90f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:39.032396 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e209765-fcca-4d91-ad0e-a50a941de90f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:16:39.033880 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e209765-fcca-4d91-ad0e-a50a941de90f service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:16:39.047116 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1313/2626] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:16:38 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:16:40.533318 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1513053-397e-4cef-84ea-5c3781bdd518 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:40.533799 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1513053-397e-4cef-84ea-5c3781bdd518 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:40.534098 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1513053-397e-4cef-84ea-5c3781bdd518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:40.553328 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-d1513053-397e-4cef-84ea-5c3781bdd518 None None] MFA Rules not processed for user `b2f47cbf62d44a6ba7e6a6f0f2305630`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:16:40.554639 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-d1513053-397e-4cef-84ea-5c3781bdd518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:40.610375 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1314/2627] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Dec 15 16:16:40 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:16:40.625041 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e209765-fcca-4d91-ad0e-a50a941de90f service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:16:40.626505 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-5e209765-fcca-4d91-ad0e-a50a941de90f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:40.700154 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e209765-fcca-4d91-ad0e-a50a941de90f service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:16:40.705807 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b5831-9d25-405c-9db1-6e3c9145b336 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e3f652f76424e27a1d4329212d9b66d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:16:40.706448 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b5831-9d25-405c-9db1-6e3c9145b336 service swift] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:40.706729 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b5831-9d25-405c-9db1-6e3c9145b336 service swift] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:40.706999 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b5831-9d25-405c-9db1-6e3c9145b336 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:40.715364 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b5831-9d25-405c-9db1-6e3c9145b336 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:16:40.716944 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b5831-9d25-405c-9db1-6e3c9145b336 service swift] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:16:40.724891 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1314/2628] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Dec 15 16:16:40 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:16:57.420416 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eded3c-1858-43df-8fb2-8e1ff98201dc None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:57.420941 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eded3c-1858-43df-8fb2-8e1ff98201dc None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:57.421135 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eded3c-1858-43df-8fb2-8e1ff98201dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:57.440043 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-82eded3c-1858-43df-8fb2-8e1ff98201dc None None] MFA Rules not processed for user `b2f47cbf62d44a6ba7e6a6f0f2305630`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:16:57.441430 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-82eded3c-1858-43df-8fb2-8e1ff98201dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:57.450525 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1315/2629] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Dec 15 16:16:57 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:16:57.465769 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b5831-9d25-405c-9db1-6e3c9145b336 service swift] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:16:57.476109 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b5831-9d25-405c-9db1-6e3c9145b336 service swift] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:16:57.482325 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693092c-e12a-41ec-8846-7e44fcb52a54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e3f652f76424e27a1d4329212d9b66d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:16:57.483287 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693092c-e12a-41ec-8846-7e44fcb52a54 service swift] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:57.483654 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693092c-e12a-41ec-8846-7e44fcb52a54 service swift] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:57.484028 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693092c-e12a-41ec-8846-7e44fcb52a54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:57.494110 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693092c-e12a-41ec-8846-7e44fcb52a54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:16:57.496086 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693092c-e12a-41ec-8846-7e44fcb52a54 service swift] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:16:57.505361 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1315/2630] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Dec 15 16:16:57 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:16:58.037186 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e058f62-94f7-483e-8dc4-6f55a5986923 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:58.037515 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e058f62-94f7-483e-8dc4-6f55a5986923 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:58.037800 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e058f62-94f7-483e-8dc4-6f55a5986923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:58.056702 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-2e058f62-94f7-483e-8dc4-6f55a5986923 None None] MFA Rules not processed for user `b2f47cbf62d44a6ba7e6a6f0f2305630`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:16:58.058044 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-2e058f62-94f7-483e-8dc4-6f55a5986923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:58.065157 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1316/2631] 10.222.0.36 () {58 vars in 967 bytes} [Wed Dec 15 16:16:58 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:16:58.079218 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693092c-e12a-41ec-8846-7e44fcb52a54 service swift] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:16:58.090240 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693092c-e12a-41ec-8846-7e44fcb52a54 service swift] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:16:58.095408 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396b7e7-8f9c-4969-b795-bf3bde48fa55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e3f652f76424e27a1d4329212d9b66d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:16:58.096097 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396b7e7-8f9c-4969-b795-bf3bde48fa55 service swift] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:58.096377 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396b7e7-8f9c-4969-b795-bf3bde48fa55 service swift] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:58.096842 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396b7e7-8f9c-4969-b795-bf3bde48fa55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:58.105712 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396b7e7-8f9c-4969-b795-bf3bde48fa55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:16:58.107318 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396b7e7-8f9c-4969-b795-bf3bde48fa55 service swift] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:16:58.115306 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1316/2632] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Dec 15 16:16:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 16:16:58.321520 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a1e3f-6c97-473c-97f1-22bc56ef0503 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:58.321859 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a1e3f-6c97-473c-97f1-22bc56ef0503 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:58.322256 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a1e3f-6c97-473c-97f1-22bc56ef0503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:58.340165 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-9a0a1e3f-6c97-473c-97f1-22bc56ef0503 None None] MFA Rules not processed for user `b2f47cbf62d44a6ba7e6a6f0f2305630`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:16:58.341394 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-9a0a1e3f-6c97-473c-97f1-22bc56ef0503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:58.348562 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1317/2633] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Dec 15 16:16:58 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:16:58.362137 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396b7e7-8f9c-4969-b795-bf3bde48fa55 service swift] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:16:58.373405 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396b7e7-8f9c-4969-b795-bf3bde48fa55 service swift] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:16:58.378471 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276fec4-e5d2-4639-a777-403fcb94bb25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e3f652f76424e27a1d4329212d9b66d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:16:58.379107 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276fec4-e5d2-4639-a777-403fcb94bb25 service swift] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:58.379395 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276fec4-e5d2-4639-a777-403fcb94bb25 service swift] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:58.379672 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276fec4-e5d2-4639-a777-403fcb94bb25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:58.388613 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276fec4-e5d2-4639-a777-403fcb94bb25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:16:58.390422 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276fec4-e5d2-4639-a777-403fcb94bb25 service swift] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:16:58.398629 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1317/2634] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Dec 15 16:16:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:16:58.715958 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fba36-1939-4003-82c3-a447b7d77dc1 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:58.716456 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fba36-1939-4003-82c3-a447b7d77dc1 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:58.716562 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fba36-1939-4003-82c3-a447b7d77dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:58.735690 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-2a9fba36-1939-4003-82c3-a447b7d77dc1 None None] MFA Rules not processed for user `b2f47cbf62d44a6ba7e6a6f0f2305630`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:16:58.736925 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-2a9fba36-1939-4003-82c3-a447b7d77dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:58.743997 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1318/2635] 10.222.0.36 () {58 vars in 967 bytes} [Wed Dec 15 16:16:58 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:16:58.756779 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276fec4-e5d2-4639-a777-403fcb94bb25 service swift] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:16:58.767306 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276fec4-e5d2-4639-a777-403fcb94bb25 service swift] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:16:58.772272 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0bd6a-939c-4720-bdf8-f23b56392bfa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e3f652f76424e27a1d4329212d9b66d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:16:58.772831 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0bd6a-939c-4720-bdf8-f23b56392bfa service swift] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:58.773111 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0bd6a-939c-4720-bdf8-f23b56392bfa service swift] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:58.773406 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0bd6a-939c-4720-bdf8-f23b56392bfa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:58.781788 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0bd6a-939c-4720-bdf8-f23b56392bfa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:16:58.783343 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0bd6a-939c-4720-bdf8-f23b56392bfa service swift] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:16:58.792057 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1318/2636] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Dec 15 16:16:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 16:16:58.920578 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37116bb-7178-4bfd-9d7d-1fe772f8f30b None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:58.920870 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37116bb-7178-4bfd-9d7d-1fe772f8f30b None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:58.921209 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37116bb-7178-4bfd-9d7d-1fe772f8f30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:58.939633 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-f37116bb-7178-4bfd-9d7d-1fe772f8f30b None None] MFA Rules not processed for user `b2f47cbf62d44a6ba7e6a6f0f2305630`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:16:58.941160 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-f37116bb-7178-4bfd-9d7d-1fe772f8f30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:16:58.948861 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1319/2637] 10.222.0.36 () {58 vars in 967 bytes} [Wed Dec 15 16:16:58 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:16:58.962395 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0bd6a-939c-4720-bdf8-f23b56392bfa service swift] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:16:58.976822 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0bd6a-939c-4720-bdf8-f23b56392bfa service swift] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:16:58.986865 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fd7a2-a30b-4359-9ece-e0060c4c63ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e3f652f76424e27a1d4329212d9b66d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:16:58.987566 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fd7a2-a30b-4359-9ece-e0060c4c63ca service swift] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:16:58.987864 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fd7a2-a30b-4359-9ece-e0060c4c63ca service swift] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:16:58.988144 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fd7a2-a30b-4359-9ece-e0060c4c63ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:16:58.997830 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fd7a2-a30b-4359-9ece-e0060c4c63ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:16:58.999737 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fd7a2-a30b-4359-9ece-e0060c4c63ca service swift] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:16:59.008286 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1319/2638] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Dec 15 16:16:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 16:17:00.877218 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37116bb-7178-4bfd-9d7d-1fe772f8f30b None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:00.939016 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37116bb-7178-4bfd-9d7d-1fe772f8f30b None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:00.943435 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793aab8-228d-4733-a14f-6608f9a7f1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:00.944325 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793aab8-228d-4733-a14f-6608f9a7f1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:00.944601 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793aab8-228d-4733-a14f-6608f9a7f1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:00.944873 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793aab8-228d-4733-a14f-6608f9a7f1d0 admin admin] PATH_INFO: `/v3/users/f4de2a2126b2414896bcf84605ec5760` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:00.946083 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793aab8-228d-4733-a14f-6608f9a7f1d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4de2a2126b2414896bcf84605ec5760)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:00.948301 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793aab8-228d-4733-a14f-6608f9a7f1d0 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:00.993732 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4793aab8-228d-4733-a14f-6608f9a7f1d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4de2a2126b2414896bcf84605ec5760'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:00.994392 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4793aab8-228d-4733-a14f-6608f9a7f1d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4de2a2126b2414896bcf84605ec5760'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:01.001720 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4793aab8-228d-4733-a14f-6608f9a7f1d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4de2a2126b2414896bcf84605ec5760'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:01.002294 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4793aab8-228d-4733-a14f-6608f9a7f1d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4de2a2126b2414896bcf84605ec5760'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:01.014267 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-4793aab8-228d-4733-a14f-6608f9a7f1d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4de2a2126b2414896bcf84605ec5760'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:01.028830 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1320/2639] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:17:00 2021] DELETE /identity/v3/users/f4de2a2126b2414896bcf84605ec5760 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:17:01.033319 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a734b37-325d-4bdd-9892-2036a11d2238 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:01.033829 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a734b37-325d-4bdd-9892-2036a11d2238 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:01.033928 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a734b37-325d-4bdd-9892-2036a11d2238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:01.052336 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-2a734b37-325d-4bdd-9892-2036a11d2238 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:17:01.053553 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-2a734b37-325d-4bdd-9892-2036a11d2238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:01.115616 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1320/2640] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:17:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:17:01.125679 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793aab8-228d-4733-a14f-6608f9a7f1d0 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:01.127069 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-4793aab8-228d-4733-a14f-6608f9a7f1d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:01.183481 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793aab8-228d-4733-a14f-6608f9a7f1d0 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:01.187102 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341ca88-535f-418d-92b8-43c7215c9891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:01.187719 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341ca88-535f-418d-92b8-43c7215c9891 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:01.187998 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341ca88-535f-418d-92b8-43c7215c9891 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:01.188269 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341ca88-535f-418d-92b8-43c7215c9891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:01.202861 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341ca88-535f-418d-92b8-43c7215c9891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:01.204303 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341ca88-535f-418d-92b8-43c7215c9891 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:01.214906 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1321/2641] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:17:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:17:01.376948 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a734b37-325d-4bdd-9892-2036a11d2238 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:01.378511 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-2a734b37-325d-4bdd-9892-2036a11d2238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:01.392023 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a734b37-325d-4bdd-9892-2036a11d2238 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:01.397577 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20398c5e-559a-4087-9b8a-b1e9c8b34bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:01.398772 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20398c5e-559a-4087-9b8a-b1e9c8b34bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:01.399065 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20398c5e-559a-4087-9b8a-b1e9c8b34bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:01.399387 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20398c5e-559a-4087-9b8a-b1e9c8b34bce admin admin] PATH_INFO: `/v3/projects/767457cee9584e02afc690428a89a898` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:01.400836 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20398c5e-559a-4087-9b8a-b1e9c8b34bce admin admin] RBAC: Authorizing `identity:delete_project(project_id=767457cee9584e02afc690428a89a898)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:01.403316 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20398c5e-559a-4087-9b8a-b1e9c8b34bce admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:01.454580 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-20398c5e-559a-4087-9b8a-b1e9c8b34bce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '767457cee9584e02afc690428a89a898', 'request_id': 'req-20398c5e-559a-4087-9b8a-b1e9c8b34bce'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:01.462365 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-20398c5e-559a-4087-9b8a-b1e9c8b34bce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '767457cee9584e02afc690428a89a898', 'request_id': 'req-20398c5e-559a-4087-9b8a-b1e9c8b34bce'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:01.468001 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-20398c5e-559a-4087-9b8a-b1e9c8b34bce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '767457cee9584e02afc690428a89a898', 'request_id': 'req-20398c5e-559a-4087-9b8a-b1e9c8b34bce'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:01.479363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-20398c5e-559a-4087-9b8a-b1e9c8b34bce admin admin] The token cache is being invalidate because project 767457cee9584e02afc690428a89a898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:17:01.479654 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-20398c5e-559a-4087-9b8a-b1e9c8b34bce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:01.480286 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-20398c5e-559a-4087-9b8a-b1e9c8b34bce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:01.481895 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1321/2642] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:17:01 2021] DELETE /identity/v3/projects/767457cee9584e02afc690428a89a898 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:17:01.487598 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6283c39-2cb1-40ee-bdb5-8b2e5f417a19 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:01.487884 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6283c39-2cb1-40ee-bdb5-8b2e5f417a19 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:01.488159 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6283c39-2cb1-40ee-bdb5-8b2e5f417a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:01.505710 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-d6283c39-2cb1-40ee-bdb5-8b2e5f417a19 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:17:01.506855 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-d6283c39-2cb1-40ee-bdb5-8b2e5f417a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:01.564821 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1322/2643] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:17:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:17:01.573415 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694193cf-6031-4ab6-aa70-3f02da0663f2 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:01.573717 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694193cf-6031-4ab6-aa70-3f02da0663f2 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:01.573998 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694193cf-6031-4ab6-aa70-3f02da0663f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:01.592585 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-694193cf-6031-4ab6-aa70-3f02da0663f2 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:17:01.593835 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-694193cf-6031-4ab6-aa70-3f02da0663f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:01.601658 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1322/2644] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:17:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:17:01.606765 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6283c39-2cb1-40ee-bdb5-8b2e5f417a19 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:01.616233 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6283c39-2cb1-40ee-bdb5-8b2e5f417a19 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:01.620934 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88003b-d1ad-4e25-b35b-5840c1fd5f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:01.621599 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88003b-d1ad-4e25-b35b-5840c1fd5f8e admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:01.621881 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88003b-d1ad-4e25-b35b-5840c1fd5f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:01.622158 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88003b-d1ad-4e25-b35b-5840c1fd5f8e admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:01.622880 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88003b-d1ad-4e25-b35b-5840c1fd5f8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:17:01.623183 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88003b-d1ad-4e25-b35b-5840c1fd5f8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:01.624775 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88003b-d1ad-4e25-b35b-5840c1fd5f8e admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:01.636195 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1323/2645] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:17:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:17:01.640430 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694193cf-6031-4ab6-aa70-3f02da0663f2 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:01.650334 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694193cf-6031-4ab6-aa70-3f02da0663f2 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:01.655092 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c149e7-c4ef-4985-bf42-94a3c5f29fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:01.655725 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c149e7-c4ef-4985-bf42-94a3c5f29fbb admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:01.656003 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c149e7-c4ef-4985-bf42-94a3c5f29fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:01.656272 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c149e7-c4ef-4985-bf42-94a3c5f29fbb admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:01.657026 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c149e7-c4ef-4985-bf42-94a3c5f29fbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:01.658930 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c149e7-c4ef-4985-bf42-94a3c5f29fbb admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:01.684113 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1323/2646] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:17:01 2021] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:17:01.688312 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88003b-d1ad-4e25-b35b-5840c1fd5f8e admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:01.698322 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88003b-d1ad-4e25-b35b-5840c1fd5f8e admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:01.752597 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec4e74-4383-4e14-a50c-9523706d0b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:01.753255 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec4e74-4383-4e14-a50c-9523706d0b56 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:01.753586 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec4e74-4383-4e14-a50c-9523706d0b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:01.753864 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec4e74-4383-4e14-a50c-9523706d0b56 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:01.754563 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec4e74-4383-4e14-a50c-9523706d0b56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:01.756545 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec4e74-4383-4e14-a50c-9523706d0b56 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:01.776792 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1324/2647] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:17:01 2021] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:17:01.780974 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c149e7-c4ef-4985-bf42-94a3c5f29fbb admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:01.792282 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c149e7-c4ef-4985-bf42-94a3c5f29fbb admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:01.796824 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6be4a-64d5-41bc-9b34-fe3b927e22e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:01.797497 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6be4a-64d5-41bc-9b34-fe3b927e22e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:01.797783 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6be4a-64d5-41bc-9b34-fe3b927e22e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:01.798053 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6be4a-64d5-41bc-9b34-fe3b927e22e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:01.798844 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6be4a-64d5-41bc-9b34-fe3b927e22e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:01.800418 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6be4a-64d5-41bc-9b34-fe3b927e22e0 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:01.810582 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1324/2648] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:17:01 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:17:01.814484 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec4e74-4383-4e14-a50c-9523706d0b56 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:01.828494 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec4e74-4383-4e14-a50c-9523706d0b56 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:01.833433 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e410cca-d29b-4b4f-ab1a-6dca3d2baf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:01.834094 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e410cca-d29b-4b4f-ab1a-6dca3d2baf79 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:01.834376 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e410cca-d29b-4b4f-ab1a-6dca3d2baf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:01.834650 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e410cca-d29b-4b4f-ab1a-6dca3d2baf79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:01.835379 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e410cca-d29b-4b4f-ab1a-6dca3d2baf79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:01.837670 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e410cca-d29b-4b4f-ab1a-6dca3d2baf79 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:01.851878 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1325/2649] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:17:01 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:17:01.857070 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6be4a-64d5-41bc-9b34-fe3b927e22e0 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:01.867788 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6be4a-64d5-41bc-9b34-fe3b927e22e0 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:01.872790 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47448c-c48c-418d-ac79-d6e85bfc9011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:01.873715 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47448c-c48c-418d-ac79-d6e85bfc9011 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:01.873996 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47448c-c48c-418d-ac79-d6e85bfc9011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:01.874371 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47448c-c48c-418d-ac79-d6e85bfc9011 admin admin] PATH_INFO: `/v3/projects/d37336bbfbab45f79ed53d56efe617c4/users/0c89b280c0864631a57aab8564633443/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:01.896992 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47448c-c48c-418d-ac79-d6e85bfc9011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d37336bbfbab45f79ed53d56efe617c4, user_id=0c89b280c0864631a57aab8564633443, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:01.900285 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47448c-c48c-418d-ac79-d6e85bfc9011 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:01.913836 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1325/2650] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:17:01 2021] PUT /identity/v3/projects/d37336bbfbab45f79ed53d56efe617c4/users/0c89b280c0864631a57aab8564633443/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:17:01.918956 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472db78-8fd6-4b36-b9be-6af61b652c61 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:01.919470 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472db78-8fd6-4b36-b9be-6af61b652c61 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:01.919661 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472db78-8fd6-4b36-b9be-6af61b652c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:01.937408 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-b472db78-8fd6-4b36-b9be-6af61b652c61 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:17:01.938630 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-b472db78-8fd6-4b36-b9be-6af61b652c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:01.997664 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1326/2651] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:17:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:17:02.007480 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47448c-c48c-418d-ac79-d6e85bfc9011 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:02.009690 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-ad47448c-c48c-418d-ac79-d6e85bfc9011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:02.066789 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47448c-c48c-418d-ac79-d6e85bfc9011 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:02.070589 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c4697-003f-4b63-994a-b6d029dc2b6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:02.071996 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c4697-003f-4b63-994a-b6d029dc2b6a service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:02.072304 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c4697-003f-4b63-994a-b6d029dc2b6a service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:02.072651 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c4697-003f-4b63-994a-b6d029dc2b6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:02.081912 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c4697-003f-4b63-994a-b6d029dc2b6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:02.083349 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c4697-003f-4b63-994a-b6d029dc2b6a service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:02.093730 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1326/2652] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:17:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:17:06.937214 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c0d13-1e4f-4399-a8d5-da830bff16d7 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:06.937773 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c0d13-1e4f-4399-a8d5-da830bff16d7 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:06.937872 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c0d13-1e4f-4399-a8d5-da830bff16d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:06.967421 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-a62c0d13-1e4f-4399-a8d5-da830bff16d7 None None] MFA Rules not processed for user `0c89b280c0864631a57aab8564633443`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:17:06.968653 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-a62c0d13-1e4f-4399-a8d5-da830bff16d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:07.039728 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1327/2653] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:17:06 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:17:07.044785 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c4697-003f-4b63-994a-b6d029dc2b6a service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:07.054310 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c4697-003f-4b63-994a-b6d029dc2b6a service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:07.062379 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde39356-356a-49ba-ac57-d1972e947a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:07.063040 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde39356-356a-49ba-ac57-d1972e947a0f admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:07.063510 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde39356-356a-49ba-ac57-d1972e947a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:07.063962 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde39356-356a-49ba-ac57-d1972e947a0f admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:07.064880 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde39356-356a-49ba-ac57-d1972e947a0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:07.066894 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde39356-356a-49ba-ac57-d1972e947a0f admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:07.095456 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1327/2654] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:17:07 2021] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:17:07.099433 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c0d13-1e4f-4399-a8d5-da830bff16d7 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:07.110231 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c0d13-1e4f-4399-a8d5-da830bff16d7 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:07.183530 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a8f5b-f992-440f-a031-4719d448f906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:07.184301 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a8f5b-f992-440f-a031-4719d448f906 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:07.184691 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a8f5b-f992-440f-a031-4719d448f906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:07.185056 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a8f5b-f992-440f-a031-4719d448f906 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:07.185922 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a8f5b-f992-440f-a031-4719d448f906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:07.188000 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a8f5b-f992-440f-a031-4719d448f906 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:07.211583 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1328/2655] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:17:07 2021] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:17:07.215481 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde39356-356a-49ba-ac57-d1972e947a0f admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:07.225861 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde39356-356a-49ba-ac57-d1972e947a0f admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:07.231035 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb64713-c19d-472a-a8af-fa99cccb7690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:07.231694 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb64713-c19d-472a-a8af-fa99cccb7690 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:07.231977 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb64713-c19d-472a-a8af-fa99cccb7690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:07.232252 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb64713-c19d-472a-a8af-fa99cccb7690 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:07.232996 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb64713-c19d-472a-a8af-fa99cccb7690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:07.234637 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb64713-c19d-472a-a8af-fa99cccb7690 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:07.245703 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1328/2656] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:17:07 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:17:07.249818 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a8f5b-f992-440f-a031-4719d448f906 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:07.260182 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a8f5b-f992-440f-a031-4719d448f906 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:07.264958 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6383a-d653-4815-996b-f773527c972b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:07.265879 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6383a-d653-4815-996b-f773527c972b admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:07.266164 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6383a-d653-4815-996b-f773527c972b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:07.266443 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6383a-d653-4815-996b-f773527c972b admin admin] PATH_INFO: `/v3/projects/edfbca64f58045d185b9667be12525c4/users/c5eb100430ad40f1a1f5beb6df6184d3/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:07.282501 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6383a-d653-4815-996b-f773527c972b admin admin] RBAC: Authorizing `identity:create_grant(project_id=edfbca64f58045d185b9667be12525c4, user_id=c5eb100430ad40f1a1f5beb6df6184d3, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:07.285193 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6383a-d653-4815-996b-f773527c972b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:07.298888 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1329/2657] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:17:07 2021] PUT /identity/v3/projects/edfbca64f58045d185b9667be12525c4/users/c5eb100430ad40f1a1f5beb6df6184d3/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:17:07.302793 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb64713-c19d-472a-a8af-fa99cccb7690 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:07.312541 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb64713-c19d-472a-a8af-fa99cccb7690 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:07.367359 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8664d-8edd-40e4-95d9-80e68760b059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:07.368044 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8664d-8edd-40e4-95d9-80e68760b059 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:07.368567 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8664d-8edd-40e4-95d9-80e68760b059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:07.369003 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8664d-8edd-40e4-95d9-80e68760b059 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:07.370090 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8664d-8edd-40e4-95d9-80e68760b059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:07.373330 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8664d-8edd-40e4-95d9-80e68760b059 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:07.384387 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1329/2658] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:17:07 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:17:07.388532 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6383a-d653-4815-996b-f773527c972b admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:07.399036 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6383a-d653-4815-996b-f773527c972b admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:07.403730 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34891aaf-6948-4b45-bdbc-3e3ee22a69ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:07.404600 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34891aaf-6948-4b45-bdbc-3e3ee22a69ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:07.404886 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34891aaf-6948-4b45-bdbc-3e3ee22a69ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:07.405159 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34891aaf-6948-4b45-bdbc-3e3ee22a69ea admin admin] PATH_INFO: `/v3/projects/edfbca64f58045d185b9667be12525c4/users/c5eb100430ad40f1a1f5beb6df6184d3/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:07.407185 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34891aaf-6948-4b45-bdbc-3e3ee22a69ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=edfbca64f58045d185b9667be12525c4, user_id=c5eb100430ad40f1a1f5beb6df6184d3, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:07.409871 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34891aaf-6948-4b45-bdbc-3e3ee22a69ea admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:07.421067 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1330/2659] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:17:07 2021] PUT /identity/v3/projects/edfbca64f58045d185b9667be12525c4/users/c5eb100430ad40f1a1f5beb6df6184d3/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:17:11.833856 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5ceb0-6a6d-42d2-94fa-f991891f448c None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:11.834348 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5ceb0-6a6d-42d2-94fa-f991891f448c None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:11.834447 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5ceb0-6a6d-42d2-94fa-f991891f448c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:11.861329 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-3af5ceb0-6a6d-42d2-94fa-f991891f448c None None] MFA Rules not processed for user `c5eb100430ad40f1a1f5beb6df6184d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:17:11.862503 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-3af5ceb0-6a6d-42d2-94fa-f991891f448c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:11.936618 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1330/2660] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:17:11 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:17:11.948789 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34891aaf-6948-4b45-bdbc-3e3ee22a69ea admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:11.950610 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-34891aaf-6948-4b45-bdbc-3e3ee22a69ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:12.026435 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34891aaf-6948-4b45-bdbc-3e3ee22a69ea admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:12.032073 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916ac13-6191-4ccd-a032-ba68cea732e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:12.032724 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916ac13-6191-4ccd-a032-ba68cea732e3 service nova] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:12.033007 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916ac13-6191-4ccd-a032-ba68cea732e3 service nova] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:12.033282 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916ac13-6191-4ccd-a032-ba68cea732e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:12.091044 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916ac13-6191-4ccd-a032-ba68cea732e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:12.092979 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916ac13-6191-4ccd-a032-ba68cea732e3 service nova] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:12.121747 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1331/2661] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:17:11 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:17:21.054139 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5ceb0-6a6d-42d2-94fa-f991891f448c None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:21.077932 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5ceb0-6a6d-42d2-94fa-f991891f448c None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:21.083759 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ae18a-c665-40c0-ae2b-0c623d4ed5de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:21.084416 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ae18a-c665-40c0-ae2b-0c623d4ed5de service nova] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:21.084702 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ae18a-c665-40c0-ae2b-0c623d4ed5de service nova] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:21.084981 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ae18a-c665-40c0-ae2b-0c623d4ed5de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:21.086814 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-854ae18a-c665-40c0-ae2b-0c623d4ed5de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:21.143600 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ae18a-c665-40c0-ae2b-0c623d4ed5de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:21.145108 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ae18a-c665-40c0-ae2b-0c623d4ed5de service nova] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:21.154927 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1331/2662] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:17:21 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:17:31.836309 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b896b3-b187-485b-885e-81c75fe31f71 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:31.836852 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b896b3-b187-485b-885e-81c75fe31f71 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:31.836956 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b896b3-b187-485b-885e-81c75fe31f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:31.854909 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-51b896b3-b187-485b-885e-81c75fe31f71 None None] MFA Rules not processed for user `0c89b280c0864631a57aab8564633443`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:17:31.856113 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-51b896b3-b187-485b-885e-81c75fe31f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:31.863103 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1332/2663] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:17:31 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:17:32.218701 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ae18a-c665-40c0-ae2b-0c623d4ed5de service nova] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:32.285044 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ae18a-c665-40c0-ae2b-0c623d4ed5de service nova] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:32.288740 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8ed8e-0c30-43a7-9e45-3e94245ddba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:32.290247 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8ed8e-0c30-43a7-9e45-3e94245ddba3 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:32.290756 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8ed8e-0c30-43a7-9e45-3e94245ddba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:32.291262 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8ed8e-0c30-43a7-9e45-3e94245ddba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:32.293409 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-e7f8ed8e-0c30-43a7-9e45-3e94245ddba3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:32.304666 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8ed8e-0c30-43a7-9e45-3e94245ddba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:32.306641 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8ed8e-0c30-43a7-9e45-3e94245ddba3 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:32.314860 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1332/2664] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:17:32 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:17:46.218935 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b896b3-b187-485b-885e-81c75fe31f71 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:46.220359 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-51b896b3-b187-485b-885e-81c75fe31f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:46.233612 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b896b3-b187-485b-885e-81c75fe31f71 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:46.237157 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109acae0-67e1-4582-b81f-66e987343f70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:46.237821 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109acae0-67e1-4582-b81f-66e987343f70 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:46.238100 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109acae0-67e1-4582-b81f-66e987343f70 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:46.238393 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109acae0-67e1-4582-b81f-66e987343f70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:46.240084 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-109acae0-67e1-4582-b81f-66e987343f70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:46.300977 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109acae0-67e1-4582-b81f-66e987343f70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:46.302398 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109acae0-67e1-4582-b81f-66e987343f70 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:46.312096 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1333/2665] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:17:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:17:48.693577 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8ed8e-0c30-43a7-9e45-3e94245ddba3 service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:48.704264 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8ed8e-0c30-43a7-9e45-3e94245ddba3 service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:48.708293 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521ba6b-b939-47df-8189-fd8a04a7fc07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:48.709123 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521ba6b-b939-47df-8189-fd8a04a7fc07 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:48.709725 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521ba6b-b939-47df-8189-fd8a04a7fc07 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:48.710158 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521ba6b-b939-47df-8189-fd8a04a7fc07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:48.721371 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521ba6b-b939-47df-8189-fd8a04a7fc07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:48.722814 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521ba6b-b939-47df-8189-fd8a04a7fc07 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:48.732421 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1333/2666] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:17:48 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:17:50.064984 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109acae0-67e1-4582-b81f-66e987343f70 service neutron] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:50.067165 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-109acae0-67e1-4582-b81f-66e987343f70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:50.082781 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109acae0-67e1-4582-b81f-66e987343f70 service neutron] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:50.090814 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60853006-4103-4f30-8cf0-c88b8c98e431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:50.091758 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60853006-4103-4f30-8cf0-c88b8c98e431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:50.092109 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60853006-4103-4f30-8cf0-c88b8c98e431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:50.092472 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60853006-4103-4f30-8cf0-c88b8c98e431 admin admin] PATH_INFO: `/v3/users/2b01ba54246a4e8482417367b6329c1a` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:50.093799 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60853006-4103-4f30-8cf0-c88b8c98e431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b01ba54246a4e8482417367b6329c1a)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:50.095796 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60853006-4103-4f30-8cf0-c88b8c98e431 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:50.145676 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-60853006-4103-4f30-8cf0-c88b8c98e431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b01ba54246a4e8482417367b6329c1a'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:50.146335 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-60853006-4103-4f30-8cf0-c88b8c98e431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b01ba54246a4e8482417367b6329c1a'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:50.157380 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-60853006-4103-4f30-8cf0-c88b8c98e431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b01ba54246a4e8482417367b6329c1a'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:50.158145 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-60853006-4103-4f30-8cf0-c88b8c98e431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b01ba54246a4e8482417367b6329c1a'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:50.170355 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-60853006-4103-4f30-8cf0-c88b8c98e431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b01ba54246a4e8482417367b6329c1a'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:50.182843 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1334/2667] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:17:50 2021] DELETE /identity/v3/users/2b01ba54246a4e8482417367b6329c1a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:17:50.359850 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521ba6b-b939-47df-8189-fd8a04a7fc07 service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:50.373935 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521ba6b-b939-47df-8189-fd8a04a7fc07 service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:50.432883 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596df8ad-09db-4aec-9b75-d6eef47d40ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:50.433776 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596df8ad-09db-4aec-9b75-d6eef47d40ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:50.434061 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596df8ad-09db-4aec-9b75-d6eef47d40ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:50.434342 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596df8ad-09db-4aec-9b75-d6eef47d40ca admin admin] PATH_INFO: `/v3/projects/4293903670af4a238fe13d805fcd9d59` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:50.435559 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596df8ad-09db-4aec-9b75-d6eef47d40ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4293903670af4a238fe13d805fcd9d59)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:50.437576 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596df8ad-09db-4aec-9b75-d6eef47d40ca admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:50.485714 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-596df8ad-09db-4aec-9b75-d6eef47d40ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4293903670af4a238fe13d805fcd9d59', 'request_id': 'req-596df8ad-09db-4aec-9b75-d6eef47d40ca'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:50.492781 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-596df8ad-09db-4aec-9b75-d6eef47d40ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4293903670af4a238fe13d805fcd9d59', 'request_id': 'req-596df8ad-09db-4aec-9b75-d6eef47d40ca'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:50.498321 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-596df8ad-09db-4aec-9b75-d6eef47d40ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4293903670af4a238fe13d805fcd9d59', 'request_id': 'req-596df8ad-09db-4aec-9b75-d6eef47d40ca'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:50.509195 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-596df8ad-09db-4aec-9b75-d6eef47d40ca admin admin] The token cache is being invalidate because project 4293903670af4a238fe13d805fcd9d59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:17:50.509544 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-596df8ad-09db-4aec-9b75-d6eef47d40ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:50.510247 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-596df8ad-09db-4aec-9b75-d6eef47d40ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:50.511806 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1334/2668] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:17:50 2021] DELETE /identity/v3/projects/4293903670af4a238fe13d805fcd9d59 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:17:50.517690 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc854e8-f532-4e87-be8b-57a7fb4b101b None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:50.517976 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc854e8-f532-4e87-be8b-57a7fb4b101b None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:50.518249 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc854e8-f532-4e87-be8b-57a7fb4b101b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:50.536720 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-1cc854e8-f532-4e87-be8b-57a7fb4b101b None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:17:50.539216 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-1cc854e8-f532-4e87-be8b-57a7fb4b101b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:50.608305 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1335/2669] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:17:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:17:50.615867 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed34d1-eea0-407a-9091-71783a282099 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:50.616157 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed34d1-eea0-407a-9091-71783a282099 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:50.616434 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed34d1-eea0-407a-9091-71783a282099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:50.636170 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-e7ed34d1-eea0-407a-9091-71783a282099 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:17:50.638079 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-e7ed34d1-eea0-407a-9091-71783a282099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:50.660244 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1335/2670] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:17:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:17:50.660611 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc854e8-f532-4e87-be8b-57a7fb4b101b None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:50.662073 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-1cc854e8-f532-4e87-be8b-57a7fb4b101b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:50.664530 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed34d1-eea0-407a-9091-71783a282099 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:50.675635 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed34d1-eea0-407a-9091-71783a282099 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:50.680392 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d631cb7-611a-4201-8984-62e235606a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:50.681049 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d631cb7-611a-4201-8984-62e235606a4a admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:50.681334 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d631cb7-611a-4201-8984-62e235606a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:50.681702 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d631cb7-611a-4201-8984-62e235606a4a admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:50.682617 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d631cb7-611a-4201-8984-62e235606a4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:17:50.682932 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d631cb7-611a-4201-8984-62e235606a4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:50.684692 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d631cb7-611a-4201-8984-62e235606a4a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:50.697001 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1336/2671] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:17:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:17:50.702134 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d631cb7-611a-4201-8984-62e235606a4a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:50.711947 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d631cb7-611a-4201-8984-62e235606a4a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:50.718196 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d7ba5-3cf1-4cf1-8c9c-8e128f89a9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:50.718847 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d7ba5-3cf1-4cf1-8c9c-8e128f89a9e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:50.719135 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d7ba5-3cf1-4cf1-8c9c-8e128f89a9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:50.719414 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d7ba5-3cf1-4cf1-8c9c-8e128f89a9e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:50.720117 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d7ba5-3cf1-4cf1-8c9c-8e128f89a9e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:50.722065 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d7ba5-3cf1-4cf1-8c9c-8e128f89a9e4 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:50.741045 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc854e8-f532-4e87-be8b-57a7fb4b101b None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:50.747209 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7218db-168b-48c7-9da0-b55196324985 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:50.747959 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7218db-168b-48c7-9da0-b55196324985 service nova] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:50.748363 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7218db-168b-48c7-9da0-b55196324985 service nova] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:50.748700 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7218db-168b-48c7-9da0-b55196324985 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:50.751023 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-9f7218db-168b-48c7-9da0-b55196324985 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:50.760850 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1337/2672] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:17:50 2021] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:17:50.765092 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d7ba5-3cf1-4cf1-8c9c-8e128f89a9e4 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:50.765280 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7218db-168b-48c7-9da0-b55196324985 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:50.766843 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7218db-168b-48c7-9da0-b55196324985 service nova] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:50.778638 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1336/2673] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:17:50 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:17:50.832751 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d7ba5-3cf1-4cf1-8c9c-8e128f89a9e4 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:50.837959 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2a5c1-e5b6-4226-8cea-1662ddba2c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:50.838705 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2a5c1-e5b6-4226-8cea-1662ddba2c97 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:50.839065 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2a5c1-e5b6-4226-8cea-1662ddba2c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:50.839409 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2a5c1-e5b6-4226-8cea-1662ddba2c97 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:50.840192 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2a5c1-e5b6-4226-8cea-1662ddba2c97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:50.842218 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2a5c1-e5b6-4226-8cea-1662ddba2c97 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:50.863785 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1338/2674] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:17:50 2021] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:17:50.868067 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7218db-168b-48c7-9da0-b55196324985 service nova] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:50.882837 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7218db-168b-48c7-9da0-b55196324985 service nova] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:50.888103 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe3695-bda2-44a9-9b9f-25c5be8eef8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:50.889296 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe3695-bda2-44a9-9b9f-25c5be8eef8a admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:50.889679 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe3695-bda2-44a9-9b9f-25c5be8eef8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:50.890463 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe3695-bda2-44a9-9b9f-25c5be8eef8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:50.891354 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe3695-bda2-44a9-9b9f-25c5be8eef8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:50.894268 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe3695-bda2-44a9-9b9f-25c5be8eef8a admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:50.909987 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1337/2675] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:17:50 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:17:50.911239 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2a5c1-e5b6-4226-8cea-1662ddba2c97 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:50.923674 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2a5c1-e5b6-4226-8cea-1662ddba2c97 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:50.929333 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0aeca-a6a5-4ad1-bba9-d175c19ebbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:50.930215 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0aeca-a6a5-4ad1-bba9-d175c19ebbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:50.930498 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0aeca-a6a5-4ad1-bba9-d175c19ebbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:50.930773 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0aeca-a6a5-4ad1-bba9-d175c19ebbc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:50.932274 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0aeca-a6a5-4ad1-bba9-d175c19ebbc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:50.934391 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0aeca-a6a5-4ad1-bba9-d175c19ebbc9 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:50.948307 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1339/2676] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:17:50 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:17:50.952544 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe3695-bda2-44a9-9b9f-25c5be8eef8a admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:50.963449 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe3695-bda2-44a9-9b9f-25c5be8eef8a admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:50.968687 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4b426-968b-452d-828a-200b23565c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:50.969606 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4b426-968b-452d-828a-200b23565c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:50.970002 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4b426-968b-452d-828a-200b23565c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:50.970281 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4b426-968b-452d-828a-200b23565c4c admin admin] PATH_INFO: `/v3/projects/e84c4abaea2f443e965cc2979c025e86/users/5bf295900cc54dd998ef9272787ea983/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:50.988729 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4b426-968b-452d-828a-200b23565c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e84c4abaea2f443e965cc2979c025e86, user_id=5bf295900cc54dd998ef9272787ea983, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:50.991538 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4b426-968b-452d-828a-200b23565c4c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:51.009367 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1338/2677] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:17:50 2021] PUT /identity/v3/projects/e84c4abaea2f443e965cc2979c025e86/users/5bf295900cc54dd998ef9272787ea983/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:17:51.020585 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445a724-8340-4623-8783-ea7757826799 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:51.020877 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445a724-8340-4623-8783-ea7757826799 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:51.021150 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445a724-8340-4623-8783-ea7757826799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:51.066357 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-e445a724-8340-4623-8783-ea7757826799 None None] MFA Rules not processed for user `5bf295900cc54dd998ef9272787ea983`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:17:51.068735 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-e445a724-8340-4623-8783-ea7757826799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:51.138977 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1340/2678] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:17:51 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:17:51.151248 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4b426-968b-452d-828a-200b23565c4c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:51.153102 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-abe4b426-968b-452d-828a-200b23565c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:51.232254 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4b426-968b-452d-828a-200b23565c4c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:51.238400 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5225e3-d200-4034-91d1-566fa572d75d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:51.239051 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5225e3-d200-4034-91d1-566fa572d75d service nova] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:51.239330 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5225e3-d200-4034-91d1-566fa572d75d service nova] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:51.239748 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5225e3-d200-4034-91d1-566fa572d75d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:51.248748 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5225e3-d200-4034-91d1-566fa572d75d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:51.250316 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5225e3-d200-4034-91d1-566fa572d75d service nova] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:51.260207 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1339/2679] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:17:51 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:17:59.357750 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445a724-8340-4623-8783-ea7757826799 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:59.359155 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-e445a724-8340-4623-8783-ea7757826799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:59.415325 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445a724-8340-4623-8783-ea7757826799 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:59.419261 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667b6b4-86be-429e-9970-f33de142264b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:59.419907 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667b6b4-86be-429e-9970-f33de142264b service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:59.420195 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667b6b4-86be-429e-9970-f33de142264b service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:59.420475 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667b6b4-86be-429e-9970-f33de142264b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:59.422277 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-1667b6b4-86be-429e-9970-f33de142264b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:59.480574 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667b6b4-86be-429e-9970-f33de142264b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:59.482047 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667b6b4-86be-429e-9970-f33de142264b service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:59.491325 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1341/2680] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:17:59 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:17:59.536410 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5225e3-d200-4034-91d1-566fa572d75d service nova] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:59.597140 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5225e3-d200-4034-91d1-566fa572d75d service nova] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:59.601823 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861f766-a1c6-4514-b54b-a8062d1f59e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:59.602616 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861f766-a1c6-4514-b54b-a8062d1f59e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:59.602901 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861f766-a1c6-4514-b54b-a8062d1f59e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:59.603180 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861f766-a1c6-4514-b54b-a8062d1f59e2 admin admin] PATH_INFO: `/v3/users/5bf295900cc54dd998ef9272787ea983` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:59.605060 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861f766-a1c6-4514-b54b-a8062d1f59e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bf295900cc54dd998ef9272787ea983)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:59.607047 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861f766-a1c6-4514-b54b-a8062d1f59e2 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:59.652804 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-b861f766-a1c6-4514-b54b-a8062d1f59e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bf295900cc54dd998ef9272787ea983'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:59.653503 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-b861f766-a1c6-4514-b54b-a8062d1f59e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bf295900cc54dd998ef9272787ea983'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:59.662429 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-b861f766-a1c6-4514-b54b-a8062d1f59e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bf295900cc54dd998ef9272787ea983'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:59.662429 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-b861f766-a1c6-4514-b54b-a8062d1f59e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bf295900cc54dd998ef9272787ea983'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:59.674682 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-b861f766-a1c6-4514-b54b-a8062d1f59e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bf295900cc54dd998ef9272787ea983'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:17:59.690179 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1340/2681] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:17:59 2021] DELETE /identity/v3/users/5bf295900cc54dd998ef9272787ea983 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:17:59.694875 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d8589-d9c0-4544-ba33-0538fda39723 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:59.695211 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d8589-d9c0-4544-ba33-0538fda39723 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:59.695544 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d8589-d9c0-4544-ba33-0538fda39723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:59.720824 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-608d8589-d9c0-4544-ba33-0538fda39723 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:17:59.722035 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-608d8589-d9c0-4544-ba33-0538fda39723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:59.781665 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1342/2682] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:17:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:17:59.788340 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861f766-a1c6-4514-b54b-a8062d1f59e2 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:17:59.789804 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-b861f766-a1c6-4514-b54b-a8062d1f59e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:17:59.851557 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861f766-a1c6-4514-b54b-a8062d1f59e2 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:17:59.855932 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e01b1-bfbe-4114-8668-0d5fbbf1a956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:17:59.856530 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e01b1-bfbe-4114-8668-0d5fbbf1a956 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:17:59.856813 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e01b1-bfbe-4114-8668-0d5fbbf1a956 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:17:59.857089 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e01b1-bfbe-4114-8668-0d5fbbf1a956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:17:59.867213 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e01b1-bfbe-4114-8668-0d5fbbf1a956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:17:59.868684 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e01b1-bfbe-4114-8668-0d5fbbf1a956 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:17:59.879398 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1341/2683] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:17:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:18:00.162008 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d8589-d9c0-4544-ba33-0538fda39723 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:00.163748 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-608d8589-d9c0-4544-ba33-0538fda39723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:00.182706 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d8589-d9c0-4544-ba33-0538fda39723 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:00.188029 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a785e-7494-4612-826d-bd40aa7da028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:00.190151 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a785e-7494-4612-826d-bd40aa7da028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:00.190452 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a785e-7494-4612-826d-bd40aa7da028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:00.190713 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a785e-7494-4612-826d-bd40aa7da028 admin admin] PATH_INFO: `/v3/projects/e84c4abaea2f443e965cc2979c025e86` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:00.191921 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a785e-7494-4612-826d-bd40aa7da028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e84c4abaea2f443e965cc2979c025e86)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:00.194050 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a785e-7494-4612-826d-bd40aa7da028 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:00.241590 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-371a785e-7494-4612-826d-bd40aa7da028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e84c4abaea2f443e965cc2979c025e86', 'request_id': 'req-371a785e-7494-4612-826d-bd40aa7da028'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:00.248993 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-371a785e-7494-4612-826d-bd40aa7da028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e84c4abaea2f443e965cc2979c025e86', 'request_id': 'req-371a785e-7494-4612-826d-bd40aa7da028'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:00.254634 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-371a785e-7494-4612-826d-bd40aa7da028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e84c4abaea2f443e965cc2979c025e86', 'request_id': 'req-371a785e-7494-4612-826d-bd40aa7da028'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:00.266099 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-371a785e-7494-4612-826d-bd40aa7da028 admin admin] The token cache is being invalidate because project e84c4abaea2f443e965cc2979c025e86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:18:00.266391 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-371a785e-7494-4612-826d-bd40aa7da028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:00.267038 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-371a785e-7494-4612-826d-bd40aa7da028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:00.268621 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1343/2684] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:18:00 2021] DELETE /identity/v3/projects/e84c4abaea2f443e965cc2979c025e86 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:00.274434 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a1454-e9ec-4ca1-b3f4-d4ebf41690bc None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:00.274800 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a1454-e9ec-4ca1-b3f4-d4ebf41690bc None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:00.275150 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a1454-e9ec-4ca1-b3f4-d4ebf41690bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:00.299438 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-078a1454-e9ec-4ca1-b3f4-d4ebf41690bc None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:00.300739 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-078a1454-e9ec-4ca1-b3f4-d4ebf41690bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:00.363783 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1342/2685] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:18:00.372311 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae2d8f-ac70-4d6d-9663-740e119f7838 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:00.372853 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae2d8f-ac70-4d6d-9663-740e119f7838 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:00.372853 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae2d8f-ac70-4d6d-9663-740e119f7838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:00.391118 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-17ae2d8f-ac70-4d6d-9663-740e119f7838 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:00.392329 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-17ae2d8f-ac70-4d6d-9663-740e119f7838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:00.400409 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1344/2686] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:00.404823 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a1454-e9ec-4ca1-b3f4-d4ebf41690bc None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:00.414371 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a1454-e9ec-4ca1-b3f4-d4ebf41690bc None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:00.420000 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0930d5-87b3-49d4-8ea3-5760e4fb674d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:00.420668 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0930d5-87b3-49d4-8ea3-5760e4fb674d admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:00.420952 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0930d5-87b3-49d4-8ea3-5760e4fb674d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:00.421227 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0930d5-87b3-49d4-8ea3-5760e4fb674d admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:00.422015 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0930d5-87b3-49d4-8ea3-5760e4fb674d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:18:00.422328 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0930d5-87b3-49d4-8ea3-5760e4fb674d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:00.423952 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0930d5-87b3-49d4-8ea3-5760e4fb674d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:00.436295 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1343/2687] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:18:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:18:00.440397 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae2d8f-ac70-4d6d-9663-740e119f7838 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:00.449758 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae2d8f-ac70-4d6d-9663-740e119f7838 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:00.454748 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e8ed6-ebb6-4ecb-91b8-3bba7ae6ea75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:00.455395 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e8ed6-ebb6-4ecb-91b8-3bba7ae6ea75 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:00.455678 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e8ed6-ebb6-4ecb-91b8-3bba7ae6ea75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:00.455949 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e8ed6-ebb6-4ecb-91b8-3bba7ae6ea75 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:00.456677 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e8ed6-ebb6-4ecb-91b8-3bba7ae6ea75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:00.458643 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e8ed6-ebb6-4ecb-91b8-3bba7ae6ea75 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:00.487537 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1345/2688] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:18:00 2021] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:18:00.489024 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0930d5-87b3-49d4-8ea3-5760e4fb674d admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:00.500003 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0930d5-87b3-49d4-8ea3-5760e4fb674d admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:00.556148 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695db72-360f-473e-8bac-dcdb418f5ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:00.558524 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695db72-360f-473e-8bac-dcdb418f5ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:00.558524 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695db72-360f-473e-8bac-dcdb418f5ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:00.558524 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695db72-360f-473e-8bac-dcdb418f5ce6 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:00.558905 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695db72-360f-473e-8bac-dcdb418f5ce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:00.561184 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695db72-360f-473e-8bac-dcdb418f5ce6 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:00.584875 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1344/2689] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:18:00 2021] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:18:00.586281 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e8ed6-ebb6-4ecb-91b8-3bba7ae6ea75 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:00.607582 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e8ed6-ebb6-4ecb-91b8-3bba7ae6ea75 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:00.612407 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ea326-df4c-4a8b-8e17-f35e9009c49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:00.613062 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ea326-df4c-4a8b-8e17-f35e9009c49d admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:00.613371 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ea326-df4c-4a8b-8e17-f35e9009c49d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:00.613674 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ea326-df4c-4a8b-8e17-f35e9009c49d admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:00.615567 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ea326-df4c-4a8b-8e17-f35e9009c49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:00.615988 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ea326-df4c-4a8b-8e17-f35e9009c49d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:00.631978 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1346/2690] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:00 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:18:00.632669 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695db72-360f-473e-8bac-dcdb418f5ce6 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:00.643411 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695db72-360f-473e-8bac-dcdb418f5ce6 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:00.648395 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5aad7-0991-44ad-9062-ff4ac7c8ac26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:00.649067 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5aad7-0991-44ad-9062-ff4ac7c8ac26 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:00.649351 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5aad7-0991-44ad-9062-ff4ac7c8ac26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:00.649675 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5aad7-0991-44ad-9062-ff4ac7c8ac26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:00.650481 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5aad7-0991-44ad-9062-ff4ac7c8ac26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:00.652374 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5aad7-0991-44ad-9062-ff4ac7c8ac26 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:00.663635 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1345/2691] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:00 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:18:00.668565 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ea326-df4c-4a8b-8e17-f35e9009c49d admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:00.680253 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ea326-df4c-4a8b-8e17-f35e9009c49d admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:00.687076 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726893ef-6b05-477d-82ac-1446f9f7c242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:00.688117 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726893ef-6b05-477d-82ac-1446f9f7c242 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:00.688462 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726893ef-6b05-477d-82ac-1446f9f7c242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:00.688805 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726893ef-6b05-477d-82ac-1446f9f7c242 admin admin] PATH_INFO: `/v3/projects/07acf0620832463ebff6ab866e852caa/users/7aa9daed777349148ae41d811b9bae44/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:00.707590 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726893ef-6b05-477d-82ac-1446f9f7c242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07acf0620832463ebff6ab866e852caa, user_id=7aa9daed777349148ae41d811b9bae44, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:00.710620 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726893ef-6b05-477d-82ac-1446f9f7c242 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:00.739696 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1347/2692] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:18:00 2021] PUT /identity/v3/projects/07acf0620832463ebff6ab866e852caa/users/7aa9daed777349148ae41d811b9bae44/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:18:00.752956 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa218a40-0ba7-4327-81ea-6be99880b553 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:00.753365 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa218a40-0ba7-4327-81ea-6be99880b553 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:00.753798 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa218a40-0ba7-4327-81ea-6be99880b553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:00.809171 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-aa218a40-0ba7-4327-81ea-6be99880b553 None None] MFA Rules not processed for user `7aa9daed777349148ae41d811b9bae44`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:00.810796 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-aa218a40-0ba7-4327-81ea-6be99880b553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:00.896244 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1346/2693] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:00 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:00.908050 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726893ef-6b05-477d-82ac-1446f9f7c242 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:00.909852 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-726893ef-6b05-477d-82ac-1446f9f7c242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:00.989151 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726893ef-6b05-477d-82ac-1446f9f7c242 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:00.995271 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9589df5-26ad-4ec8-aa70-e061099dd436 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:00.995921 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9589df5-26ad-4ec8-aa70-e061099dd436 service nova] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:00.996205 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9589df5-26ad-4ec8-aa70-e061099dd436 service nova] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:00.996781 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9589df5-26ad-4ec8-aa70-e061099dd436 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:01.004768 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9589df5-26ad-4ec8-aa70-e061099dd436 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:01.006457 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9589df5-26ad-4ec8-aa70-e061099dd436 service nova] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:01.015830 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1348/2694] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:00 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:18:01.206937 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa218a40-0ba7-4327-81ea-6be99880b553 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:01.276441 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa218a40-0ba7-4327-81ea-6be99880b553 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:01.282892 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c934664-7cb8-46b5-926a-abf1fc7e5ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:01.283909 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c934664-7cb8-46b5-926a-abf1fc7e5ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:01.284228 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c934664-7cb8-46b5-926a-abf1fc7e5ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:01.285190 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c934664-7cb8-46b5-926a-abf1fc7e5ae8 admin admin] PATH_INFO: `/v3/users/7aa9daed777349148ae41d811b9bae44` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:01.285824 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c934664-7cb8-46b5-926a-abf1fc7e5ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aa9daed777349148ae41d811b9bae44)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:01.287900 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c934664-7cb8-46b5-926a-abf1fc7e5ae8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:01.334546 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-8c934664-7cb8-46b5-926a-abf1fc7e5ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aa9daed777349148ae41d811b9bae44'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:01.335270 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-8c934664-7cb8-46b5-926a-abf1fc7e5ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aa9daed777349148ae41d811b9bae44'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:01.342443 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-8c934664-7cb8-46b5-926a-abf1fc7e5ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aa9daed777349148ae41d811b9bae44'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:01.343107 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-8c934664-7cb8-46b5-926a-abf1fc7e5ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aa9daed777349148ae41d811b9bae44'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:01.355449 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-8c934664-7cb8-46b5-926a-abf1fc7e5ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aa9daed777349148ae41d811b9bae44'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:01.368906 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1347/2695] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:18:01 2021] DELETE /identity/v3/users/7aa9daed777349148ae41d811b9bae44 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:01.374163 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2617c-e742-47cb-8ffa-0d4ad9ce60f1 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:01.374680 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2617c-e742-47cb-8ffa-0d4ad9ce60f1 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:01.374791 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2617c-e742-47cb-8ffa-0d4ad9ce60f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:01.393465 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-95c2617c-e742-47cb-8ffa-0d4ad9ce60f1 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:01.394607 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-95c2617c-e742-47cb-8ffa-0d4ad9ce60f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:01.455261 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1349/2696] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:18:01.465848 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c934664-7cb8-46b5-926a-abf1fc7e5ae8 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:01.467337 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-8c934664-7cb8-46b5-926a-abf1fc7e5ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:01.524628 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c934664-7cb8-46b5-926a-abf1fc7e5ae8 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:01.528567 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5d624-2367-4f5e-90a1-5b9dabd41eb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:01.529213 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5d624-2367-4f5e-90a1-5b9dabd41eb9 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:01.529545 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5d624-2367-4f5e-90a1-5b9dabd41eb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:01.529823 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5d624-2367-4f5e-90a1-5b9dabd41eb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:01.538964 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc5d624-2367-4f5e-90a1-5b9dabd41eb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:01.540715 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc5d624-2367-4f5e-90a1-5b9dabd41eb9 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:01.551027 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1348/2697] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:18:02.111187 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2617c-e742-47cb-8ffa-0d4ad9ce60f1 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:02.112604 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-95c2617c-e742-47cb-8ffa-0d4ad9ce60f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:02.123988 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2617c-e742-47cb-8ffa-0d4ad9ce60f1 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:02.129991 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d8fca-8ad0-45bf-bd2a-5e45ea59e3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:02.130859 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d8fca-8ad0-45bf-bd2a-5e45ea59e3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:02.131139 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d8fca-8ad0-45bf-bd2a-5e45ea59e3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:02.131411 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d8fca-8ad0-45bf-bd2a-5e45ea59e3bd admin admin] PATH_INFO: `/v3/projects/07acf0620832463ebff6ab866e852caa` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:02.132781 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d8fca-8ad0-45bf-bd2a-5e45ea59e3bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=07acf0620832463ebff6ab866e852caa)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:02.135588 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d8fca-8ad0-45bf-bd2a-5e45ea59e3bd admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:02.192132 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-053d8fca-8ad0-45bf-bd2a-5e45ea59e3bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07acf0620832463ebff6ab866e852caa', 'request_id': 'req-053d8fca-8ad0-45bf-bd2a-5e45ea59e3bd'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:02.199559 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-053d8fca-8ad0-45bf-bd2a-5e45ea59e3bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07acf0620832463ebff6ab866e852caa', 'request_id': 'req-053d8fca-8ad0-45bf-bd2a-5e45ea59e3bd'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:02.204824 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-053d8fca-8ad0-45bf-bd2a-5e45ea59e3bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07acf0620832463ebff6ab866e852caa', 'request_id': 'req-053d8fca-8ad0-45bf-bd2a-5e45ea59e3bd'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:02.216883 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-053d8fca-8ad0-45bf-bd2a-5e45ea59e3bd admin admin] The token cache is being invalidate because project 07acf0620832463ebff6ab866e852caa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:18:02.217175 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-053d8fca-8ad0-45bf-bd2a-5e45ea59e3bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:02.217920 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-053d8fca-8ad0-45bf-bd2a-5e45ea59e3bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:02.219455 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1350/2698] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:18:02 2021] DELETE /identity/v3/projects/07acf0620832463ebff6ab866e852caa => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:18:02.225085 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052db33-2583-46c1-813b-748827b2f1e6 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:02.225596 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052db33-2583-46c1-813b-748827b2f1e6 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:02.225697 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052db33-2583-46c1-813b-748827b2f1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:02.243419 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-b052db33-2583-46c1-813b-748827b2f1e6 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:02.245116 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-b052db33-2583-46c1-813b-748827b2f1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:02.300787 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1349/2699] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:02.309181 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d31ebd-7ec8-4917-a895-138b5d3e3a86 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:02.309512 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d31ebd-7ec8-4917-a895-138b5d3e3a86 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:02.309819 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d31ebd-7ec8-4917-a895-138b5d3e3a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:02.328603 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-44d31ebd-7ec8-4917-a895-138b5d3e3a86 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:02.329925 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-44d31ebd-7ec8-4917-a895-138b5d3e3a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:02.337697 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1351/2700] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:02.341884 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052db33-2583-46c1-813b-748827b2f1e6 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:02.351657 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052db33-2583-46c1-813b-748827b2f1e6 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:02.356276 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9e7c3-01d5-4977-8060-9905df9c46d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:02.356974 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9e7c3-01d5-4977-8060-9905df9c46d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:02.357223 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9e7c3-01d5-4977-8060-9905df9c46d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:02.357525 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9e7c3-01d5-4977-8060-9905df9c46d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:02.358278 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9e7c3-01d5-4977-8060-9905df9c46d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:18:02.358580 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9e7c3-01d5-4977-8060-9905df9c46d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:02.360207 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9e7c3-01d5-4977-8060-9905df9c46d7 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:02.372017 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1350/2701] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:18:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:18:02.376612 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d31ebd-7ec8-4917-a895-138b5d3e3a86 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:02.389543 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d31ebd-7ec8-4917-a895-138b5d3e3a86 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:02.394387 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bd49b-6535-4c99-87d7-1868a5447f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:02.395064 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bd49b-6535-4c99-87d7-1868a5447f98 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:02.395352 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bd49b-6535-4c99-87d7-1868a5447f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:02.395633 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bd49b-6535-4c99-87d7-1868a5447f98 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:02.396376 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07bd49b-6535-4c99-87d7-1868a5447f98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:02.398348 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07bd49b-6535-4c99-87d7-1868a5447f98 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:02.424576 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1352/2702] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:18:02 2021] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:18:02.428801 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9e7c3-01d5-4977-8060-9905df9c46d7 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:02.438760 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9e7c3-01d5-4977-8060-9905df9c46d7 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:02.495795 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9f880-71db-40eb-afdb-fa96d3a214f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:02.496382 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9f880-71db-40eb-afdb-fa96d3a214f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:02.496694 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9f880-71db-40eb-afdb-fa96d3a214f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:02.496973 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9f880-71db-40eb-afdb-fa96d3a214f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:02.497748 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9f880-71db-40eb-afdb-fa96d3a214f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:02.499824 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9f880-71db-40eb-afdb-fa96d3a214f5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:02.520510 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1351/2703] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:18:02 2021] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:18:02.524675 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bd49b-6535-4c99-87d7-1868a5447f98 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:02.535836 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bd49b-6535-4c99-87d7-1868a5447f98 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:02.540797 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0dc3f-7d2a-4e06-b780-e7874f22e832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:02.542154 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0dc3f-7d2a-4e06-b780-e7874f22e832 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:02.542540 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0dc3f-7d2a-4e06-b780-e7874f22e832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:02.542822 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0dc3f-7d2a-4e06-b780-e7874f22e832 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:02.543571 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0dc3f-7d2a-4e06-b780-e7874f22e832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:02.545171 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0dc3f-7d2a-4e06-b780-e7874f22e832 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:02.555527 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1353/2704] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:02 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:18:02.559763 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9f880-71db-40eb-afdb-fa96d3a214f5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:02.574297 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9f880-71db-40eb-afdb-fa96d3a214f5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:02.579107 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87555b90-aa1e-4e57-ac99-16b05a0d7b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:02.579776 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87555b90-aa1e-4e57-ac99-16b05a0d7b07 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:02.580064 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87555b90-aa1e-4e57-ac99-16b05a0d7b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:02.580362 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87555b90-aa1e-4e57-ac99-16b05a0d7b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:02.581087 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87555b90-aa1e-4e57-ac99-16b05a0d7b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:02.582751 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87555b90-aa1e-4e57-ac99-16b05a0d7b07 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:02.594006 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1352/2705] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:02 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:18:02.597886 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0dc3f-7d2a-4e06-b780-e7874f22e832 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:02.608508 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0dc3f-7d2a-4e06-b780-e7874f22e832 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:02.613193 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b605f-6cbe-4180-95a7-a6325d8b6364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:02.614106 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b605f-6cbe-4180-95a7-a6325d8b6364 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:02.614389 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b605f-6cbe-4180-95a7-a6325d8b6364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:02.614667 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b605f-6cbe-4180-95a7-a6325d8b6364 admin admin] PATH_INFO: `/v3/projects/cbe5d2fb9cfc432bb45283520c0a3dc9/users/88454ceb57314ca7882f4055c54288b3/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:02.630553 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b605f-6cbe-4180-95a7-a6325d8b6364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe5d2fb9cfc432bb45283520c0a3dc9, user_id=88454ceb57314ca7882f4055c54288b3, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:02.633258 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b605f-6cbe-4180-95a7-a6325d8b6364 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:02.649825 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1354/2706] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:18:02 2021] PUT /identity/v3/projects/cbe5d2fb9cfc432bb45283520c0a3dc9/users/88454ceb57314ca7882f4055c54288b3/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:18:02.660905 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317175ac-34b8-4b96-97db-54ea9d8adb4e None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:02.661198 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317175ac-34b8-4b96-97db-54ea9d8adb4e None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:02.661509 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317175ac-34b8-4b96-97db-54ea9d8adb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:02.689220 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-317175ac-34b8-4b96-97db-54ea9d8adb4e None None] MFA Rules not processed for user `88454ceb57314ca7882f4055c54288b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:02.690474 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-317175ac-34b8-4b96-97db-54ea9d8adb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:02.753581 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1353/2707] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:02 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:02.757849 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b605f-6cbe-4180-95a7-a6325d8b6364 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:02.819638 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b605f-6cbe-4180-95a7-a6325d8b6364 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:02.824707 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1973d-def4-4039-9165-1439a7aa69e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:02.825370 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1973d-def4-4039-9165-1439a7aa69e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:02.825680 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1973d-def4-4039-9165-1439a7aa69e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:02.825959 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1973d-def4-4039-9165-1439a7aa69e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:02.826694 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1973d-def4-4039-9165-1439a7aa69e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:02.828602 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1973d-def4-4039-9165-1439a7aa69e6 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:02.854362 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1355/2708] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:18:02 2021] POST /identity/v3/projects => generated 399 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:18:02.858379 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317175ac-34b8-4b96-97db-54ea9d8adb4e None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:02.870953 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317175ac-34b8-4b96-97db-54ea9d8adb4e None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:02.944430 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db911b-2119-4136-9109-abcb03175109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:02.945125 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db911b-2119-4136-9109-abcb03175109 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:02.945512 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db911b-2119-4136-9109-abcb03175109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:02.945888 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db911b-2119-4136-9109-abcb03175109 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:02.946624 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db911b-2119-4136-9109-abcb03175109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:02.949289 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db911b-2119-4136-9109-abcb03175109 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:02.973867 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1354/2709] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:18:02 2021] POST /identity/v3/users => generated 306 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:18:02.978896 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1973d-def4-4039-9165-1439a7aa69e6 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:02.991146 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1973d-def4-4039-9165-1439a7aa69e6 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:02.996443 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5680279-0684-41c4-b836-4e452958e73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:02.997096 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5680279-0684-41c4-b836-4e452958e73e admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:02.997902 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5680279-0684-41c4-b836-4e452958e73e admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:02.998183 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5680279-0684-41c4-b836-4e452958e73e admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:02.998925 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5680279-0684-41c4-b836-4e452958e73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:03.000761 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5680279-0684-41c4-b836-4e452958e73e admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:03.012252 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1356/2710] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:02 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:18:03.016399 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db911b-2119-4136-9109-abcb03175109 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:03.026489 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db911b-2119-4136-9109-abcb03175109 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:03.031553 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ebd73-70ea-498d-bf1a-c88cf53ab163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:03.032419 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ebd73-70ea-498d-bf1a-c88cf53ab163 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:03.032698 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ebd73-70ea-498d-bf1a-c88cf53ab163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:03.032971 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ebd73-70ea-498d-bf1a-c88cf53ab163 admin admin] PATH_INFO: `/v3/projects/9586c0c695ac4bf2ae69276f776d69b2/users/68bb6e143dde48c7879943991198d30e/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:03.048787 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ebd73-70ea-498d-bf1a-c88cf53ab163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9586c0c695ac4bf2ae69276f776d69b2, user_id=68bb6e143dde48c7879943991198d30e, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:03.051646 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ebd73-70ea-498d-bf1a-c88cf53ab163 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:03.064992 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1355/2711] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:18:03 2021] PUT /identity/v3/projects/9586c0c695ac4bf2ae69276f776d69b2/users/68bb6e143dde48c7879943991198d30e/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:03.068885 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5680279-0684-41c4-b836-4e452958e73e admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:03.079553 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5680279-0684-41c4-b836-4e452958e73e admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:03.133490 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaadba9-83f9-47b6-b544-322cef76b890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:03.134160 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaadba9-83f9-47b6-b544-322cef76b890 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:03.134440 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaadba9-83f9-47b6-b544-322cef76b890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:03.134821 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaadba9-83f9-47b6-b544-322cef76b890 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:03.135512 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaadba9-83f9-47b6-b544-322cef76b890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:03.137135 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaadba9-83f9-47b6-b544-322cef76b890 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:03.147322 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1357/2712] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:03 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:18:03.152018 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ebd73-70ea-498d-bf1a-c88cf53ab163 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:03.161912 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ebd73-70ea-498d-bf1a-c88cf53ab163 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:03.167420 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21ce63-2c50-4664-9e29-7c181db12864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:03.168282 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21ce63-2c50-4664-9e29-7c181db12864 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:03.168558 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21ce63-2c50-4664-9e29-7c181db12864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:03.168830 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21ce63-2c50-4664-9e29-7c181db12864 admin admin] PATH_INFO: `/v3/projects/9586c0c695ac4bf2ae69276f776d69b2/users/68bb6e143dde48c7879943991198d30e/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:03.170847 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21ce63-2c50-4664-9e29-7c181db12864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9586c0c695ac4bf2ae69276f776d69b2, user_id=68bb6e143dde48c7879943991198d30e, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:03.174626 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21ce63-2c50-4664-9e29-7c181db12864 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:03.185639 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1356/2713] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:18:03 2021] PUT /identity/v3/projects/9586c0c695ac4bf2ae69276f776d69b2/users/68bb6e143dde48c7879943991198d30e/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:03.196930 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b53ee-0d1f-4334-a544-ab1a1d1e956d None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:03.197230 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b53ee-0d1f-4334-a544-ab1a1d1e956d None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:03.197647 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b53ee-0d1f-4334-a544-ab1a1d1e956d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:03.227826 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-e71b53ee-0d1f-4334-a544-ab1a1d1e956d None None] MFA Rules not processed for user `68bb6e143dde48c7879943991198d30e`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:03.230324 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-e71b53ee-0d1f-4334-a544-ab1a1d1e956d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:03.311362 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1358/2714] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:03 2021] POST /identity/v3/auth/tokens => generated 3333 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:03.322477 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21ce63-2c50-4664-9e29-7c181db12864 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:03.324746 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-0e21ce63-2c50-4664-9e29-7c181db12864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:03.396205 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21ce63-2c50-4664-9e29-7c181db12864 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:03.400482 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5169e8-6e98-4a64-a63f-2fbfe0116e5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:03.401296 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5169e8-6e98-4a64-a63f-2fbfe0116e5a service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:03.401653 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5169e8-6e98-4a64-a63f-2fbfe0116e5a service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:03.401999 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5169e8-6e98-4a64-a63f-2fbfe0116e5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:03.413027 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5169e8-6e98-4a64-a63f-2fbfe0116e5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:03.414506 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5169e8-6e98-4a64-a63f-2fbfe0116e5a service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:03.424569 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1357/2715] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:03 2021] GET /identity/v3/auth/tokens => generated 3333 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:18:03.496541 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b53ee-0d1f-4334-a544-ab1a1d1e956d None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:03.505880 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b53ee-0d1f-4334-a544-ab1a1d1e956d None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:03.509546 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f45a8f-96a1-41b8-9dff-d1253e454ecb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:03.510366 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f45a8f-96a1-41b8-9dff-d1253e454ecb service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:03.510708 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f45a8f-96a1-41b8-9dff-d1253e454ecb service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:03.510991 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f45a8f-96a1-41b8-9dff-d1253e454ecb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:03.566738 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f45a8f-96a1-41b8-9dff-d1253e454ecb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:03.568089 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f45a8f-96a1-41b8-9dff-d1253e454ecb service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:03.579599 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1359/2716] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:03 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:18:04.514305 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5169e8-6e98-4a64-a63f-2fbfe0116e5a service cinder] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:04.515746 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-dd5169e8-6e98-4a64-a63f-2fbfe0116e5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:04.574634 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5169e8-6e98-4a64-a63f-2fbfe0116e5a service cinder] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:04.578365 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725d9aa-5be7-4c35-b97a-136a7090870f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:04.579055 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725d9aa-5be7-4c35-b97a-136a7090870f service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:04.579340 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725d9aa-5be7-4c35-b97a-136a7090870f service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:04.579617 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725d9aa-5be7-4c35-b97a-136a7090870f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:04.581515 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-9725d9aa-5be7-4c35-b97a-136a7090870f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:04.645823 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725d9aa-5be7-4c35-b97a-136a7090870f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:04.647273 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725d9aa-5be7-4c35-b97a-136a7090870f service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:04.657517 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1358/2717] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:18:07.687483 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f45a8f-96a1-41b8-9dff-d1253e454ecb service cinder] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:07.702964 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f45a8f-96a1-41b8-9dff-d1253e454ecb service cinder] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:07.712126 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0fd04-f239-4ede-9799-faffa82c4e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:07.713627 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0fd04-f239-4ede-9799-faffa82c4e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:07.714064 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0fd04-f239-4ede-9799-faffa82c4e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:07.716079 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0fd04-f239-4ede-9799-faffa82c4e29 admin admin] PATH_INFO: `/v3/users/88454ceb57314ca7882f4055c54288b3` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:07.718631 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0fd04-f239-4ede-9799-faffa82c4e29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88454ceb57314ca7882f4055c54288b3)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:07.728284 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0fd04-f239-4ede-9799-faffa82c4e29 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:07.865280 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-f2e0fd04-f239-4ede-9799-faffa82c4e29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88454ceb57314ca7882f4055c54288b3'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:07.867334 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-f2e0fd04-f239-4ede-9799-faffa82c4e29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88454ceb57314ca7882f4055c54288b3'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:07.868088 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-f2e0fd04-f239-4ede-9799-faffa82c4e29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88454ceb57314ca7882f4055c54288b3'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:07.884352 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-f2e0fd04-f239-4ede-9799-faffa82c4e29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88454ceb57314ca7882f4055c54288b3'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:07.894528 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-f2e0fd04-f239-4ede-9799-faffa82c4e29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88454ceb57314ca7882f4055c54288b3'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:07.931037 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1360/2718] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:18:07 2021] DELETE /identity/v3/users/88454ceb57314ca7882f4055c54288b3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:07.939185 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9262ce-0656-4ca1-a6e1-ea72ffdac779 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:07.940252 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9262ce-0656-4ca1-a6e1-ea72ffdac779 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:07.940586 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9262ce-0656-4ca1-a6e1-ea72ffdac779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:07.972842 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-ab9262ce-0656-4ca1-a6e1-ea72ffdac779 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:07.974127 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-ab9262ce-0656-4ca1-a6e1-ea72ffdac779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:08.065134 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1359/2719] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:08.072248 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0fd04-f239-4ede-9799-faffa82c4e29 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:08.074271 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f2e0fd04-f239-4ede-9799-faffa82c4e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:08.156345 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0fd04-f239-4ede-9799-faffa82c4e29 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:08.161115 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f067c-f21c-4657-8398-25bf5a2fd30e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:08.161794 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f067c-f21c-4657-8398-25bf5a2fd30e service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:08.162075 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f067c-f21c-4657-8398-25bf5a2fd30e service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:08.162347 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f067c-f21c-4657-8398-25bf5a2fd30e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:08.176686 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f067c-f21c-4657-8398-25bf5a2fd30e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:08.178312 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f067c-f21c-4657-8398-25bf5a2fd30e service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:08.202431 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1361/2720] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:18:08.565815 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9262ce-0656-4ca1-a6e1-ea72ffdac779 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:08.567287 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-ab9262ce-0656-4ca1-a6e1-ea72ffdac779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:08.579488 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9262ce-0656-4ca1-a6e1-ea72ffdac779 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:08.596119 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806199a6-e3fd-489e-91f7-8a05a7f65df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:08.597338 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806199a6-e3fd-489e-91f7-8a05a7f65df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:08.597671 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806199a6-e3fd-489e-91f7-8a05a7f65df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:08.597948 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806199a6-e3fd-489e-91f7-8a05a7f65df6 admin admin] PATH_INFO: `/v3/projects/cbe5d2fb9cfc432bb45283520c0a3dc9` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:08.599581 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806199a6-e3fd-489e-91f7-8a05a7f65df6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbe5d2fb9cfc432bb45283520c0a3dc9)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:08.602866 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806199a6-e3fd-489e-91f7-8a05a7f65df6 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:08.653735 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-806199a6-e3fd-489e-91f7-8a05a7f65df6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbe5d2fb9cfc432bb45283520c0a3dc9', 'request_id': 'req-806199a6-e3fd-489e-91f7-8a05a7f65df6'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:08.662226 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-806199a6-e3fd-489e-91f7-8a05a7f65df6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbe5d2fb9cfc432bb45283520c0a3dc9', 'request_id': 'req-806199a6-e3fd-489e-91f7-8a05a7f65df6'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:08.669616 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-806199a6-e3fd-489e-91f7-8a05a7f65df6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbe5d2fb9cfc432bb45283520c0a3dc9', 'request_id': 'req-806199a6-e3fd-489e-91f7-8a05a7f65df6'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:08.682561 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-806199a6-e3fd-489e-91f7-8a05a7f65df6 admin admin] The token cache is being invalidate because project cbe5d2fb9cfc432bb45283520c0a3dc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:18:08.682856 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-806199a6-e3fd-489e-91f7-8a05a7f65df6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:08.683522 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-806199a6-e3fd-489e-91f7-8a05a7f65df6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:08.685222 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1360/2721] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:18:08 2021] DELETE /identity/v3/projects/cbe5d2fb9cfc432bb45283520c0a3dc9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:18:08.689424 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f067c-f21c-4657-8398-25bf5a2fd30e service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:08.699624 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f067c-f21c-4657-8398-25bf5a2fd30e service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:08.754957 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1aafb-db7f-404d-9ca8-04c356885139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:08.755912 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1aafb-db7f-404d-9ca8-04c356885139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:08.756101 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1aafb-db7f-404d-9ca8-04c356885139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:08.756375 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1aafb-db7f-404d-9ca8-04c356885139 admin admin] PATH_INFO: `/v3/users/68bb6e143dde48c7879943991198d30e` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:08.757611 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1aafb-db7f-404d-9ca8-04c356885139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68bb6e143dde48c7879943991198d30e)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:08.759515 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1aafb-db7f-404d-9ca8-04c356885139 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:08.805911 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-84d1aafb-db7f-404d-9ca8-04c356885139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68bb6e143dde48c7879943991198d30e'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:08.807062 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-84d1aafb-db7f-404d-9ca8-04c356885139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68bb6e143dde48c7879943991198d30e'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:08.807916 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-84d1aafb-db7f-404d-9ca8-04c356885139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68bb6e143dde48c7879943991198d30e'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:08.824727 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-84d1aafb-db7f-404d-9ca8-04c356885139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68bb6e143dde48c7879943991198d30e'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:08.833397 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-84d1aafb-db7f-404d-9ca8-04c356885139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68bb6e143dde48c7879943991198d30e'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:08.848862 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1362/2722] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:18:08 2021] DELETE /identity/v3/users/68bb6e143dde48c7879943991198d30e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:18:09.178732 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806199a6-e3fd-489e-91f7-8a05a7f65df6 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:09.180935 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-806199a6-e3fd-489e-91f7-8a05a7f65df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:09.194529 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806199a6-e3fd-489e-91f7-8a05a7f65df6 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:09.296894 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd1d56-e6d5-401b-9d2d-ea92c032f52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:09.298076 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd1d56-e6d5-401b-9d2d-ea92c032f52f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:09.298413 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd1d56-e6d5-401b-9d2d-ea92c032f52f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:09.298695 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd1d56-e6d5-401b-9d2d-ea92c032f52f admin admin] PATH_INFO: `/v3/projects/9586c0c695ac4bf2ae69276f776d69b2` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:09.299949 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd1d56-e6d5-401b-9d2d-ea92c032f52f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9586c0c695ac4bf2ae69276f776d69b2)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:09.301899 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd1d56-e6d5-401b-9d2d-ea92c032f52f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:09.355957 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-88bd1d56-e6d5-401b-9d2d-ea92c032f52f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9586c0c695ac4bf2ae69276f776d69b2', 'request_id': 'req-88bd1d56-e6d5-401b-9d2d-ea92c032f52f'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:09.363976 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-88bd1d56-e6d5-401b-9d2d-ea92c032f52f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9586c0c695ac4bf2ae69276f776d69b2', 'request_id': 'req-88bd1d56-e6d5-401b-9d2d-ea92c032f52f'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:09.369646 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-88bd1d56-e6d5-401b-9d2d-ea92c032f52f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9586c0c695ac4bf2ae69276f776d69b2', 'request_id': 'req-88bd1d56-e6d5-401b-9d2d-ea92c032f52f'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:09.380844 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-88bd1d56-e6d5-401b-9d2d-ea92c032f52f admin admin] The token cache is being invalidate because project 9586c0c695ac4bf2ae69276f776d69b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:18:09.381130 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-88bd1d56-e6d5-401b-9d2d-ea92c032f52f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:09.381859 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-88bd1d56-e6d5-401b-9d2d-ea92c032f52f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:09.383410 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1361/2723] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:18:09 2021] DELETE /identity/v3/projects/9586c0c695ac4bf2ae69276f776d69b2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:09.389517 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62809a15-c1e1-4743-b05e-b169cdbeddc1 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:09.389810 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62809a15-c1e1-4743-b05e-b169cdbeddc1 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:09.390500 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62809a15-c1e1-4743-b05e-b169cdbeddc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:09.408783 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-62809a15-c1e1-4743-b05e-b169cdbeddc1 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:09.410022 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-62809a15-c1e1-4743-b05e-b169cdbeddc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:09.479956 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1363/2724] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:09.487892 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9f0d0-3d7b-42ee-a3f9-53544fe51aee None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:09.488285 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9f0d0-3d7b-42ee-a3f9-53544fe51aee None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:09.488664 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9f0d0-3d7b-42ee-a3f9-53544fe51aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:09.511520 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-c2a9f0d0-3d7b-42ee-a3f9-53544fe51aee None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:09.512737 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-c2a9f0d0-3d7b-42ee-a3f9-53544fe51aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:09.522174 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1362/2725] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:09.527543 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62809a15-c1e1-4743-b05e-b169cdbeddc1 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:09.541412 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62809a15-c1e1-4743-b05e-b169cdbeddc1 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:09.546226 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d6e9d-f410-434b-b82a-dd09c1184922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:09.546980 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d6e9d-f410-434b-b82a-dd09c1184922 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:09.547311 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d6e9d-f410-434b-b82a-dd09c1184922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:09.547776 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d6e9d-f410-434b-b82a-dd09c1184922 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:09.548580 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d6e9d-f410-434b-b82a-dd09c1184922 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:18:09.548949 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d6e9d-f410-434b-b82a-dd09c1184922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:09.550654 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d6e9d-f410-434b-b82a-dd09c1184922 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:09.563397 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1364/2726] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:18:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:18:09.567936 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9f0d0-3d7b-42ee-a3f9-53544fe51aee None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:09.577890 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9f0d0-3d7b-42ee-a3f9-53544fe51aee None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:09.582817 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a71f82-e225-4b64-b9be-26e2f27807ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:09.583468 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a71f82-e225-4b64-b9be-26e2f27807ad admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:09.583754 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a71f82-e225-4b64-b9be-26e2f27807ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:09.584031 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a71f82-e225-4b64-b9be-26e2f27807ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:09.584787 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a71f82-e225-4b64-b9be-26e2f27807ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:09.595417 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a71f82-e225-4b64-b9be-26e2f27807ad admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:09.627189 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1363/2727] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:18:09 2021] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:18:09.628369 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d6e9d-f410-434b-b82a-dd09c1184922 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:09.639773 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d6e9d-f410-434b-b82a-dd09c1184922 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:09.715569 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee4731-afa3-438b-add3-6b171e432094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:09.718180 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee4731-afa3-438b-add3-6b171e432094 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:09.720866 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee4731-afa3-438b-add3-6b171e432094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:09.721922 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee4731-afa3-438b-add3-6b171e432094 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:09.722686 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee4731-afa3-438b-add3-6b171e432094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:09.728263 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee4731-afa3-438b-add3-6b171e432094 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:09.759763 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1365/2728] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:18:09 2021] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:18:09.761036 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a71f82-e225-4b64-b9be-26e2f27807ad admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:09.779909 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a71f82-e225-4b64-b9be-26e2f27807ad admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:09.788197 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df407285-278a-4a8d-844c-f4e8eaa48ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:09.789047 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df407285-278a-4a8d-844c-f4e8eaa48ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:09.789196 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df407285-278a-4a8d-844c-f4e8eaa48ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:09.789579 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df407285-278a-4a8d-844c-f4e8eaa48ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:09.790338 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df407285-278a-4a8d-844c-f4e8eaa48ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:09.794006 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df407285-278a-4a8d-844c-f4e8eaa48ee6 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:09.806960 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1364/2729] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:09 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:18:09.811431 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee4731-afa3-438b-add3-6b171e432094 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:09.824908 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee4731-afa3-438b-add3-6b171e432094 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:09.830483 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771527ae-73a7-4ede-950b-0238f67a8022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:09.831152 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771527ae-73a7-4ede-950b-0238f67a8022 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:09.831438 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771527ae-73a7-4ede-950b-0238f67a8022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:09.831716 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771527ae-73a7-4ede-950b-0238f67a8022 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:09.832454 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771527ae-73a7-4ede-950b-0238f67a8022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:09.834230 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771527ae-73a7-4ede-950b-0238f67a8022 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:09.850891 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1366/2730] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:09 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:18:09.852038 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df407285-278a-4a8d-844c-f4e8eaa48ee6 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:09.863248 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df407285-278a-4a8d-844c-f4e8eaa48ee6 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:09.868137 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069519f7-f066-470d-a7a2-519702b60732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:09.869020 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069519f7-f066-470d-a7a2-519702b60732 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:09.869876 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069519f7-f066-470d-a7a2-519702b60732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:09.870372 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069519f7-f066-470d-a7a2-519702b60732 admin admin] PATH_INFO: `/v3/projects/3225b46947b14d2a8ded55df81e893c2/users/98e6b399af424198bd87285dbd32df79/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:09.886342 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069519f7-f066-470d-a7a2-519702b60732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3225b46947b14d2a8ded55df81e893c2, user_id=98e6b399af424198bd87285dbd32df79, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:09.889061 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069519f7-f066-470d-a7a2-519702b60732 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:09.913874 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1365/2731] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:18:09 2021] PUT /identity/v3/projects/3225b46947b14d2a8ded55df81e893c2/users/98e6b399af424198bd87285dbd32df79/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:09.915368 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fa9b6-3d4a-4d73-8030-d5a6091123c5 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:09.915929 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fa9b6-3d4a-4d73-8030-d5a6091123c5 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:09.916262 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fa9b6-3d4a-4d73-8030-d5a6091123c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:09.944931 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-5e6fa9b6-3d4a-4d73-8030-d5a6091123c5 None None] MFA Rules not processed for user `98e6b399af424198bd87285dbd32df79`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:09.946413 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-5e6fa9b6-3d4a-4d73-8030-d5a6091123c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:10.022396 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1367/2732] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:09 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:10.032943 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069519f7-f066-470d-a7a2-519702b60732 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:10.034912 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-069519f7-f066-470d-a7a2-519702b60732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:10.103037 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069519f7-f066-470d-a7a2-519702b60732 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:10.107832 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027d8dd-234e-4987-bd57-cd6d97c5bc50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:10.108684 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027d8dd-234e-4987-bd57-cd6d97c5bc50 service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:10.109260 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027d8dd-234e-4987-bd57-cd6d97c5bc50 service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:10.109782 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027d8dd-234e-4987-bd57-cd6d97c5bc50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:10.118978 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027d8dd-234e-4987-bd57-cd6d97c5bc50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:10.121519 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027d8dd-234e-4987-bd57-cd6d97c5bc50 service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:10.132398 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1366/2733] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:10 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:18:10.151207 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fa9b6-3d4a-4d73-8030-d5a6091123c5 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:10.219990 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fa9b6-3d4a-4d73-8030-d5a6091123c5 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:10.227753 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c36c9-61a9-4f00-acf8-d9d5a10a3246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:10.229224 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c36c9-61a9-4f00-acf8-d9d5a10a3246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:10.229712 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c36c9-61a9-4f00-acf8-d9d5a10a3246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:10.230207 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c36c9-61a9-4f00-acf8-d9d5a10a3246 admin admin] PATH_INFO: `/v3/users/98e6b399af424198bd87285dbd32df79` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:10.231754 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c36c9-61a9-4f00-acf8-d9d5a10a3246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98e6b399af424198bd87285dbd32df79)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:10.233791 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c36c9-61a9-4f00-acf8-d9d5a10a3246 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:10.293489 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-1b0c36c9-61a9-4f00-acf8-d9d5a10a3246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98e6b399af424198bd87285dbd32df79'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:10.294191 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-1b0c36c9-61a9-4f00-acf8-d9d5a10a3246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98e6b399af424198bd87285dbd32df79'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:10.294818 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-1b0c36c9-61a9-4f00-acf8-d9d5a10a3246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98e6b399af424198bd87285dbd32df79'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:10.306389 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-1b0c36c9-61a9-4f00-acf8-d9d5a10a3246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98e6b399af424198bd87285dbd32df79'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:10.314774 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-1b0c36c9-61a9-4f00-acf8-d9d5a10a3246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98e6b399af424198bd87285dbd32df79'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:10.327165 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1368/2734] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:18:10 2021] DELETE /identity/v3/users/98e6b399af424198bd87285dbd32df79 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:18:10.331597 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b566f0a-75ed-4abe-b9cd-ed9c31035fbb None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:10.332116 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b566f0a-75ed-4abe-b9cd-ed9c31035fbb None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:10.332300 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b566f0a-75ed-4abe-b9cd-ed9c31035fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:10.349414 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-8b566f0a-75ed-4abe-b9cd-ed9c31035fbb None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:10.351059 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-8b566f0a-75ed-4abe-b9cd-ed9c31035fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:10.413112 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1367/2735] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:10.423898 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c36c9-61a9-4f00-acf8-d9d5a10a3246 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:10.425214 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-1b0c36c9-61a9-4f00-acf8-d9d5a10a3246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:10.482632 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c36c9-61a9-4f00-acf8-d9d5a10a3246 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:10.486313 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40495429-91cb-4908-94c6-b6eea24dc075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:10.486949 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40495429-91cb-4908-94c6-b6eea24dc075 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:10.487248 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40495429-91cb-4908-94c6-b6eea24dc075 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:10.487520 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40495429-91cb-4908-94c6-b6eea24dc075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:10.497043 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40495429-91cb-4908-94c6-b6eea24dc075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:10.498519 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40495429-91cb-4908-94c6-b6eea24dc075 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:10.507894 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1369/2736] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:18:10.801827 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b566f0a-75ed-4abe-b9cd-ed9c31035fbb None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:10.803504 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-8b566f0a-75ed-4abe-b9cd-ed9c31035fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:10.820121 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b566f0a-75ed-4abe-b9cd-ed9c31035fbb None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:10.828221 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541facef-5668-47ba-a4f8-155e83957b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:10.829317 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541facef-5668-47ba-a4f8-155e83957b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:10.830301 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541facef-5668-47ba-a4f8-155e83957b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:10.830642 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541facef-5668-47ba-a4f8-155e83957b98 admin admin] PATH_INFO: `/v3/projects/3225b46947b14d2a8ded55df81e893c2` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:10.832202 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541facef-5668-47ba-a4f8-155e83957b98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3225b46947b14d2a8ded55df81e893c2)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:10.834606 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541facef-5668-47ba-a4f8-155e83957b98 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:10.886193 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-541facef-5668-47ba-a4f8-155e83957b98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3225b46947b14d2a8ded55df81e893c2', 'request_id': 'req-541facef-5668-47ba-a4f8-155e83957b98'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:10.894669 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-541facef-5668-47ba-a4f8-155e83957b98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3225b46947b14d2a8ded55df81e893c2', 'request_id': 'req-541facef-5668-47ba-a4f8-155e83957b98'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:10.901325 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-541facef-5668-47ba-a4f8-155e83957b98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3225b46947b14d2a8ded55df81e893c2', 'request_id': 'req-541facef-5668-47ba-a4f8-155e83957b98'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:10.912020 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-541facef-5668-47ba-a4f8-155e83957b98 admin admin] The token cache is being invalidate because project 3225b46947b14d2a8ded55df81e893c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:18:10.912305 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-541facef-5668-47ba-a4f8-155e83957b98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:10.912928 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-541facef-5668-47ba-a4f8-155e83957b98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:10.914486 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1368/2737] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:18:10 2021] DELETE /identity/v3/projects/3225b46947b14d2a8ded55df81e893c2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:10.921422 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74accc48-7e5e-46e8-95ef-035eb2adeef4 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:10.921903 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74accc48-7e5e-46e8-95ef-035eb2adeef4 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:10.922022 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74accc48-7e5e-46e8-95ef-035eb2adeef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:10.940227 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-74accc48-7e5e-46e8-95ef-035eb2adeef4 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:10.941457 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-74accc48-7e5e-46e8-95ef-035eb2adeef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:11.001453 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1370/2738] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:11.011027 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb081d2-e0f2-4ea5-bb7e-282eda9b0176 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:11.011027 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb081d2-e0f2-4ea5-bb7e-282eda9b0176 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:11.011027 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb081d2-e0f2-4ea5-bb7e-282eda9b0176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:11.032200 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-4fb081d2-e0f2-4ea5-bb7e-282eda9b0176 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:11.033473 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-4fb081d2-e0f2-4ea5-bb7e-282eda9b0176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:11.060235 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1369/2739] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:11.062333 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74accc48-7e5e-46e8-95ef-035eb2adeef4 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:11.078217 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74accc48-7e5e-46e8-95ef-035eb2adeef4 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:11.091964 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a2dd1-167e-4c1e-8a38-76ddf0f6a972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:11.092927 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a2dd1-167e-4c1e-8a38-76ddf0f6a972 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:11.093490 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a2dd1-167e-4c1e-8a38-76ddf0f6a972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:11.094147 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a2dd1-167e-4c1e-8a38-76ddf0f6a972 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:11.094984 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a2dd1-167e-4c1e-8a38-76ddf0f6a972 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:18:11.095392 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a2dd1-167e-4c1e-8a38-76ddf0f6a972 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:11.097098 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a2dd1-167e-4c1e-8a38-76ddf0f6a972 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:11.117337 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1371/2740] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:18:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:18:11.117889 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb081d2-e0f2-4ea5-bb7e-282eda9b0176 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:11.148488 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb081d2-e0f2-4ea5-bb7e-282eda9b0176 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:11.154381 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5901a87-72ab-4e86-b86c-40f22cf29227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:11.156626 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5901a87-72ab-4e86-b86c-40f22cf29227 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:11.157183 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5901a87-72ab-4e86-b86c-40f22cf29227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:11.157608 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5901a87-72ab-4e86-b86c-40f22cf29227 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:11.158937 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5901a87-72ab-4e86-b86c-40f22cf29227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:11.162720 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5901a87-72ab-4e86-b86c-40f22cf29227 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:11.206691 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1370/2741] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:18:11 2021] POST /identity/v3/projects => generated 371 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:18:11.210623 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a2dd1-167e-4c1e-8a38-76ddf0f6a972 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:11.224568 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a2dd1-167e-4c1e-8a38-76ddf0f6a972 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:11.297217 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773af427-7714-4031-9d86-dedb870ef2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:11.298018 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773af427-7714-4031-9d86-dedb870ef2af admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:11.298305 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773af427-7714-4031-9d86-dedb870ef2af admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:11.298579 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773af427-7714-4031-9d86-dedb870ef2af admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:11.299308 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773af427-7714-4031-9d86-dedb870ef2af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:11.301257 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773af427-7714-4031-9d86-dedb870ef2af admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:11.334059 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1372/2742] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:18:11 2021] POST /identity/v3/users => generated 286 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:18:11.335387 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5901a87-72ab-4e86-b86c-40f22cf29227 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:11.347464 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5901a87-72ab-4e86-b86c-40f22cf29227 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:11.355000 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa289e-2563-42da-9f4c-cde612b2c8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:11.355859 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa289e-2563-42da-9f4c-cde612b2c8ce admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:11.356210 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa289e-2563-42da-9f4c-cde612b2c8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:11.356592 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa289e-2563-42da-9f4c-cde612b2c8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:11.357457 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa289e-2563-42da-9f4c-cde612b2c8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:11.360714 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa289e-2563-42da-9f4c-cde612b2c8ce admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:11.374177 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1371/2743] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:11 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:18:11.377758 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773af427-7714-4031-9d86-dedb870ef2af admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:11.388393 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773af427-7714-4031-9d86-dedb870ef2af admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:11.395334 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ef7d9-35a6-4d79-9c15-c2a22de4c9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:11.395334 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ef7d9-35a6-4d79-9c15-c2a22de4c9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:11.395682 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ef7d9-35a6-4d79-9c15-c2a22de4c9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:11.395682 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ef7d9-35a6-4d79-9c15-c2a22de4c9c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:11.396496 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ef7d9-35a6-4d79-9c15-c2a22de4c9c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:11.398176 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ef7d9-35a6-4d79-9c15-c2a22de4c9c4 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:11.410404 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1373/2744] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:11 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:18:11.414877 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa289e-2563-42da-9f4c-cde612b2c8ce admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:11.428073 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa289e-2563-42da-9f4c-cde612b2c8ce admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:11.436424 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519a925-6397-4bbe-9ac0-e66ade9f45e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:11.438346 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519a925-6397-4bbe-9ac0-e66ade9f45e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:11.439313 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519a925-6397-4bbe-9ac0-e66ade9f45e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:11.440026 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519a925-6397-4bbe-9ac0-e66ade9f45e0 admin admin] PATH_INFO: `/v3/projects/8e8e7145a2084956ba89af500884573f/users/3d49d0b41c0e486684992ee88028fe00/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:11.461366 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519a925-6397-4bbe-9ac0-e66ade9f45e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e8e7145a2084956ba89af500884573f, user_id=3d49d0b41c0e486684992ee88028fe00, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:11.465136 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519a925-6397-4bbe-9ac0-e66ade9f45e0 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:11.482805 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1372/2745] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:18:11 2021] PUT /identity/v3/projects/8e8e7145a2084956ba89af500884573f/users/3d49d0b41c0e486684992ee88028fe00/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:11.492859 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea389cd4-44a0-48e6-98ff-84aa5311c32f None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:11.493147 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea389cd4-44a0-48e6-98ff-84aa5311c32f None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:11.493518 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea389cd4-44a0-48e6-98ff-84aa5311c32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:11.523717 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-ea389cd4-44a0-48e6-98ff-84aa5311c32f None None] MFA Rules not processed for user `3d49d0b41c0e486684992ee88028fe00`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:11.524944 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-ea389cd4-44a0-48e6-98ff-84aa5311c32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:11.603460 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1374/2746] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:11 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:11.610434 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519a925-6397-4bbe-9ac0-e66ade9f45e0 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:11.612459 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-a519a925-6397-4bbe-9ac0-e66ade9f45e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:11.695477 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519a925-6397-4bbe-9ac0-e66ade9f45e0 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:11.700604 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23179f-8a51-4d61-b35e-d0107d385960 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:11.701483 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23179f-8a51-4d61-b35e-d0107d385960 service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:11.701770 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23179f-8a51-4d61-b35e-d0107d385960 service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:11.702046 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23179f-8a51-4d61-b35e-d0107d385960 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:11.711065 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23179f-8a51-4d61-b35e-d0107d385960 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:11.712551 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23179f-8a51-4d61-b35e-d0107d385960 service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:11.722335 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1373/2747] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:11 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:18:11.742052 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea389cd4-44a0-48e6-98ff-84aa5311c32f None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:11.808463 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea389cd4-44a0-48e6-98ff-84aa5311c32f None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:11.816048 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819830ab-7da9-4c73-8a49-380c59af9593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:11.817476 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819830ab-7da9-4c73-8a49-380c59af9593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:11.817917 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819830ab-7da9-4c73-8a49-380c59af9593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:11.818513 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819830ab-7da9-4c73-8a49-380c59af9593 admin admin] PATH_INFO: `/v3/users/3d49d0b41c0e486684992ee88028fe00` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:11.820276 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819830ab-7da9-4c73-8a49-380c59af9593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d49d0b41c0e486684992ee88028fe00)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:11.822732 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819830ab-7da9-4c73-8a49-380c59af9593 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:11.824236 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23179f-8a51-4d61-b35e-d0107d385960 service cinder] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:11.825872 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-7d23179f-8a51-4d61-b35e-d0107d385960 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:11.845802 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23179f-8a51-4d61-b35e-d0107d385960 service cinder] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:11.851958 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39000366-203d-4085-8a89-d606874f69a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:11.852959 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39000366-203d-4085-8a89-d606874f69a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:11.853361 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39000366-203d-4085-8a89-d606874f69a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:11.854411 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39000366-203d-4085-8a89-d606874f69a4 admin admin] PATH_INFO: `/v3/users/aaa0c20019c84107b8324cd915ff78db` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:11.855761 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39000366-203d-4085-8a89-d606874f69a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaa0c20019c84107b8324cd915ff78db)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:11.857912 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39000366-203d-4085-8a89-d606874f69a4 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:11.875938 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-819830ab-7da9-4c73-8a49-380c59af9593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d49d0b41c0e486684992ee88028fe00'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:11.876900 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-819830ab-7da9-4c73-8a49-380c59af9593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d49d0b41c0e486684992ee88028fe00'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:11.877888 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-819830ab-7da9-4c73-8a49-380c59af9593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d49d0b41c0e486684992ee88028fe00'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:11.892335 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-819830ab-7da9-4c73-8a49-380c59af9593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d49d0b41c0e486684992ee88028fe00'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:11.900177 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-819830ab-7da9-4c73-8a49-380c59af9593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d49d0b41c0e486684992ee88028fe00'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:11.908927 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-39000366-203d-4085-8a89-d606874f69a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaa0c20019c84107b8324cd915ff78db'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:11.909713 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-39000366-203d-4085-8a89-d606874f69a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaa0c20019c84107b8324cd915ff78db'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:11.914282 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1375/2748] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:18:11 2021] DELETE /identity/v3/users/3d49d0b41c0e486684992ee88028fe00 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:11.917839 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-39000366-203d-4085-8a89-d606874f69a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaa0c20019c84107b8324cd915ff78db'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:11.918551 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-39000366-203d-4085-8a89-d606874f69a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaa0c20019c84107b8324cd915ff78db'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:11.919001 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47750223-8f8b-4c0e-bf30-662699ca04d0 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:11.919384 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47750223-8f8b-4c0e-bf30-662699ca04d0 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:11.919827 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47750223-8f8b-4c0e-bf30-662699ca04d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:11.930818 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-39000366-203d-4085-8a89-d606874f69a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaa0c20019c84107b8324cd915ff78db'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:11.938252 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-47750223-8f8b-4c0e-bf30-662699ca04d0 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:11.939474 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-47750223-8f8b-4c0e-bf30-662699ca04d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:11.945563 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1374/2749] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:18:11 2021] DELETE /identity/v3/users/aaa0c20019c84107b8324cd915ff78db => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:12.020068 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1376/2750] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:18:12.035607 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39000366-203d-4085-8a89-d606874f69a4 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:12.037038 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-39000366-203d-4085-8a89-d606874f69a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:12.103611 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39000366-203d-4085-8a89-d606874f69a4 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:12.108010 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aeb65a-dfe0-4e75-afaf-6fb8514c12e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:12.108661 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aeb65a-dfe0-4e75-afaf-6fb8514c12e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:12.108944 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aeb65a-dfe0-4e75-afaf-6fb8514c12e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:12.109222 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aeb65a-dfe0-4e75-afaf-6fb8514c12e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:12.144893 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47750223-8f8b-4c0e-bf30-662699ca04d0 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:12.146844 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-47750223-8f8b-4c0e-bf30-662699ca04d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:12.164877 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47750223-8f8b-4c0e-bf30-662699ca04d0 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:12.187134 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aeb65a-dfe0-4e75-afaf-6fb8514c12e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:12.188733 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aeb65a-dfe0-4e75-afaf-6fb8514c12e8 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:12.201096 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1375/2751] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:18:12.227873 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19604803-af0c-4445-9f64-6d9e2720966c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:12.229935 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19604803-af0c-4445-9f64-6d9e2720966c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:12.230293 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19604803-af0c-4445-9f64-6d9e2720966c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:12.230570 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19604803-af0c-4445-9f64-6d9e2720966c admin admin] PATH_INFO: `/v3/projects/fc22adb06b1e405ea619c273ffb94020` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:12.231815 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19604803-af0c-4445-9f64-6d9e2720966c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc22adb06b1e405ea619c273ffb94020)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:12.233771 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19604803-af0c-4445-9f64-6d9e2720966c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:12.284312 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-19604803-af0c-4445-9f64-6d9e2720966c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc22adb06b1e405ea619c273ffb94020', 'request_id': 'req-19604803-af0c-4445-9f64-6d9e2720966c'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:12.294139 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-19604803-af0c-4445-9f64-6d9e2720966c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc22adb06b1e405ea619c273ffb94020', 'request_id': 'req-19604803-af0c-4445-9f64-6d9e2720966c'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:12.300747 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-19604803-af0c-4445-9f64-6d9e2720966c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc22adb06b1e405ea619c273ffb94020', 'request_id': 'req-19604803-af0c-4445-9f64-6d9e2720966c'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:12.312939 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-19604803-af0c-4445-9f64-6d9e2720966c admin admin] The token cache is being invalidate because project fc22adb06b1e405ea619c273ffb94020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:18:12.313326 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-19604803-af0c-4445-9f64-6d9e2720966c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:12.313989 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-19604803-af0c-4445-9f64-6d9e2720966c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:12.315967 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1377/2752] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:18:12 2021] DELETE /identity/v3/projects/fc22adb06b1e405ea619c273ffb94020 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:18:12.319852 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aeb65a-dfe0-4e75-afaf-6fb8514c12e8 service neutron] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:12.333211 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aeb65a-dfe0-4e75-afaf-6fb8514c12e8 service neutron] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:12.394896 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5634810-bc52-4b55-a848-8da51c57b5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:12.396112 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5634810-bc52-4b55-a848-8da51c57b5c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:12.396112 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5634810-bc52-4b55-a848-8da51c57b5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:12.396306 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5634810-bc52-4b55-a848-8da51c57b5c0 admin admin] PATH_INFO: `/v3/users/4bec6399356d48458f2ba1da75993f64` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:12.397550 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5634810-bc52-4b55-a848-8da51c57b5c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bec6399356d48458f2ba1da75993f64)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:12.399645 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5634810-bc52-4b55-a848-8da51c57b5c0 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:12.452862 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-f5634810-bc52-4b55-a848-8da51c57b5c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bec6399356d48458f2ba1da75993f64'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:12.453606 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-f5634810-bc52-4b55-a848-8da51c57b5c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bec6399356d48458f2ba1da75993f64'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:12.460784 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-f5634810-bc52-4b55-a848-8da51c57b5c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bec6399356d48458f2ba1da75993f64'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:12.461468 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-f5634810-bc52-4b55-a848-8da51c57b5c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bec6399356d48458f2ba1da75993f64'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:12.473771 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-f5634810-bc52-4b55-a848-8da51c57b5c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bec6399356d48458f2ba1da75993f64'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:12.488101 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1376/2753] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:18:12 2021] DELETE /identity/v3/users/4bec6399356d48458f2ba1da75993f64 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:12.660735 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19604803-af0c-4445-9f64-6d9e2720966c admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:12.662426 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-19604803-af0c-4445-9f64-6d9e2720966c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:12.680212 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19604803-af0c-4445-9f64-6d9e2720966c admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:12.742418 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd9624-1ccb-4dd4-b920-2fdcf4f94aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:12.743274 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd9624-1ccb-4dd4-b920-2fdcf4f94aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:12.743561 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd9624-1ccb-4dd4-b920-2fdcf4f94aff admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:12.743837 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd9624-1ccb-4dd4-b920-2fdcf4f94aff admin admin] PATH_INFO: `/v3/projects/8e8e7145a2084956ba89af500884573f` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:12.745730 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd9624-1ccb-4dd4-b920-2fdcf4f94aff admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e8e7145a2084956ba89af500884573f)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:12.747705 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd9624-1ccb-4dd4-b920-2fdcf4f94aff admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:12.798516 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-33fd9624-1ccb-4dd4-b920-2fdcf4f94aff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e8e7145a2084956ba89af500884573f', 'request_id': 'req-33fd9624-1ccb-4dd4-b920-2fdcf4f94aff'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:12.806018 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-33fd9624-1ccb-4dd4-b920-2fdcf4f94aff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e8e7145a2084956ba89af500884573f', 'request_id': 'req-33fd9624-1ccb-4dd4-b920-2fdcf4f94aff'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:12.812305 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-33fd9624-1ccb-4dd4-b920-2fdcf4f94aff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e8e7145a2084956ba89af500884573f', 'request_id': 'req-33fd9624-1ccb-4dd4-b920-2fdcf4f94aff'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:12.824358 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-33fd9624-1ccb-4dd4-b920-2fdcf4f94aff admin admin] The token cache is being invalidate because project 8e8e7145a2084956ba89af500884573f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:18:12.824668 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-33fd9624-1ccb-4dd4-b920-2fdcf4f94aff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:12.825294 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-33fd9624-1ccb-4dd4-b920-2fdcf4f94aff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:12.827112 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1378/2754] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:18:12 2021] DELETE /identity/v3/projects/8e8e7145a2084956ba89af500884573f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:12.832825 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58d5ed-adf8-4fae-a899-da4dc759dad5 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:12.833225 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58d5ed-adf8-4fae-a899-da4dc759dad5 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:12.833538 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58d5ed-adf8-4fae-a899-da4dc759dad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:12.852010 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-1e58d5ed-adf8-4fae-a899-da4dc759dad5 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:12.853686 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-1e58d5ed-adf8-4fae-a899-da4dc759dad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:12.879537 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd9624-1ccb-4dd4-b920-2fdcf4f94aff admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:12.881042 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-33fd9624-1ccb-4dd4-b920-2fdcf4f94aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:12.936656 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1377/2755] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:12.938291 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277557e-a163-44db-b26e-031cf504d05c None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:12.938592 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277557e-a163-44db-b26e-031cf504d05c None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:12.938872 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277557e-a163-44db-b26e-031cf504d05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:12.960216 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd9624-1ccb-4dd4-b920-2fdcf4f94aff admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:12.960832 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-3277557e-a163-44db-b26e-031cf504d05c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:12.967796 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895094c5-2759-4f3f-8308-d639a389920a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:12.968909 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895094c5-2759-4f3f-8308-d639a389920a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:12.969174 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895094c5-2759-4f3f-8308-d639a389920a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:12.969512 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-3277557e-a163-44db-b26e-031cf504d05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:12.969734 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895094c5-2759-4f3f-8308-d639a389920a admin admin] PATH_INFO: `/v3/projects/5b784239c6a74157a0faa56ffc04020d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:12.971288 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895094c5-2759-4f3f-8308-d639a389920a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b784239c6a74157a0faa56ffc04020d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:12.973923 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895094c5-2759-4f3f-8308-d639a389920a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:12.991439 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1378/2756] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:12.997966 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277557e-a163-44db-b26e-031cf504d05c None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:13.023268 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277557e-a163-44db-b26e-031cf504d05c None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:13.032952 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b1235-d004-4bf3-8faa-b784a8cf099c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:13.033646 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b1235-d004-4bf3-8faa-b784a8cf099c admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:13.033932 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b1235-d004-4bf3-8faa-b784a8cf099c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:13.034207 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b1235-d004-4bf3-8faa-b784a8cf099c admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:13.034953 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b1235-d004-4bf3-8faa-b784a8cf099c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:18:13.035263 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b1235-d004-4bf3-8faa-b784a8cf099c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:13.036917 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b1235-d004-4bf3-8faa-b784a8cf099c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:13.069974 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1379/2757] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:18:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:18:13.074292 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-895094c5-2759-4f3f-8308-d639a389920a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b784239c6a74157a0faa56ffc04020d', 'request_id': 'req-895094c5-2759-4f3f-8308-d639a389920a'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:13.090546 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b1235-d004-4bf3-8faa-b784a8cf099c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:13.097663 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-895094c5-2759-4f3f-8308-d639a389920a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b784239c6a74157a0faa56ffc04020d', 'request_id': 'req-895094c5-2759-4f3f-8308-d639a389920a'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:13.116178 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b1235-d004-4bf3-8faa-b784a8cf099c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:13.118422 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-895094c5-2759-4f3f-8308-d639a389920a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b784239c6a74157a0faa56ffc04020d', 'request_id': 'req-895094c5-2759-4f3f-8308-d639a389920a'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:13.142822 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-895094c5-2759-4f3f-8308-d639a389920a admin admin] The token cache is being invalidate because project 5b784239c6a74157a0faa56ffc04020d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:18:13.143448 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-895094c5-2759-4f3f-8308-d639a389920a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:13.153776 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-895094c5-2759-4f3f-8308-d639a389920a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:13.156476 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1379/2758] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:18:12 2021] DELETE /identity/v3/projects/5b784239c6a74157a0faa56ffc04020d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:13.244506 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb92bbb-5b75-4016-83cb-ca37809f9866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:13.245766 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb92bbb-5b75-4016-83cb-ca37809f9866 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:13.246546 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb92bbb-5b75-4016-83cb-ca37809f9866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:13.247098 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb92bbb-5b75-4016-83cb-ca37809f9866 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:13.248166 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb92bbb-5b75-4016-83cb-ca37809f9866 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:13.251434 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb92bbb-5b75-4016-83cb-ca37809f9866 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:13.293101 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1380/2759] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:18:13 2021] POST /identity/v3/projects => generated 369 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:18:13.297138 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895094c5-2759-4f3f-8308-d639a389920a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:13.298959 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-895094c5-2759-4f3f-8308-d639a389920a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:13.321960 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895094c5-2759-4f3f-8308-d639a389920a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:13.388530 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c1d31-ed10-4228-982a-4460699344b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:13.389258 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c1d31-ed10-4228-982a-4460699344b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:13.389576 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c1d31-ed10-4228-982a-4460699344b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:13.389881 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c1d31-ed10-4228-982a-4460699344b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:13.390586 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c1d31-ed10-4228-982a-4460699344b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:13.392556 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c1d31-ed10-4228-982a-4460699344b3 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:13.413530 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1380/2760] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:18:13 2021] POST /identity/v3/users => generated 285 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:18:13.417892 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb92bbb-5b75-4016-83cb-ca37809f9866 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:13.428565 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb92bbb-5b75-4016-83cb-ca37809f9866 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:13.433690 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77338d83-e245-4673-9db3-6ae6755f190f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:13.434360 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77338d83-e245-4673-9db3-6ae6755f190f admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:13.434760 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77338d83-e245-4673-9db3-6ae6755f190f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:13.435041 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77338d83-e245-4673-9db3-6ae6755f190f admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:13.435788 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77338d83-e245-4673-9db3-6ae6755f190f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:13.437535 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77338d83-e245-4673-9db3-6ae6755f190f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:13.448307 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1381/2761] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:13 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:18:13.451981 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c1d31-ed10-4228-982a-4460699344b3 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:13.464359 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c1d31-ed10-4228-982a-4460699344b3 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:13.469528 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6cb1b-df25-4a6e-9aa9-1ad10ad27256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:13.470005 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6cb1b-df25-4a6e-9aa9-1ad10ad27256 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:13.470289 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6cb1b-df25-4a6e-9aa9-1ad10ad27256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:13.470565 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6cb1b-df25-4a6e-9aa9-1ad10ad27256 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:13.471312 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6cb1b-df25-4a6e-9aa9-1ad10ad27256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:13.473014 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6cb1b-df25-4a6e-9aa9-1ad10ad27256 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:13.486813 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1381/2762] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:13 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:18:13.491199 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77338d83-e245-4673-9db3-6ae6755f190f admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:13.503206 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77338d83-e245-4673-9db3-6ae6755f190f admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:13.508985 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbceae8a-51e1-471e-aaea-3d0f35bd7ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:13.510896 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbceae8a-51e1-471e-aaea-3d0f35bd7ed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:13.511048 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbceae8a-51e1-471e-aaea-3d0f35bd7ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:13.511431 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbceae8a-51e1-471e-aaea-3d0f35bd7ed4 admin admin] PATH_INFO: `/v3/projects/1078ad0d7222439dbfda0cfdd5d8624b/users/d1726bf8d6204c5cb99d6bf46273a8e9/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:13.532469 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbceae8a-51e1-471e-aaea-3d0f35bd7ed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1078ad0d7222439dbfda0cfdd5d8624b, user_id=d1726bf8d6204c5cb99d6bf46273a8e9, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:13.536082 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbceae8a-51e1-471e-aaea-3d0f35bd7ed4 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:13.553406 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1382/2763] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:18:13 2021] PUT /identity/v3/projects/1078ad0d7222439dbfda0cfdd5d8624b/users/d1726bf8d6204c5cb99d6bf46273a8e9/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:13.565642 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdbb21-8ab2-4db6-9fba-d6f4a602ab2a None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:13.565885 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdbb21-8ab2-4db6-9fba-d6f4a602ab2a None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:13.566157 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdbb21-8ab2-4db6-9fba-d6f4a602ab2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:13.594746 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-becdbb21-8ab2-4db6-9fba-d6f4a602ab2a None None] MFA Rules not processed for user `d1726bf8d6204c5cb99d6bf46273a8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:13.595967 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-becdbb21-8ab2-4db6-9fba-d6f4a602ab2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:13.665423 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1382/2764] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:13 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:13.677889 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbceae8a-51e1-471e-aaea-3d0f35bd7ed4 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:13.679747 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-bbceae8a-51e1-471e-aaea-3d0f35bd7ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:13.738314 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbceae8a-51e1-471e-aaea-3d0f35bd7ed4 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:13.741966 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdc4ce-adbf-49a1-9a69-9cb73cdafa45 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9072bd35fdf046669c196133f485d334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:13.742609 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdc4ce-adbf-49a1-9a69-9cb73cdafa45 service glance] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:13.742890 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdc4ce-adbf-49a1-9a69-9cb73cdafa45 service glance] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:13.743164 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdc4ce-adbf-49a1-9a69-9cb73cdafa45 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:13.751441 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdc4ce-adbf-49a1-9a69-9cb73cdafa45 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:13.752878 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdc4ce-adbf-49a1-9a69-9cb73cdafa45 service glance] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:13.761909 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1383/2765] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:13 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:18:18.826025 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becdbb21-8ab2-4db6-9fba-d6f4a602ab2a None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:18.827435 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-becdbb21-8ab2-4db6-9fba-d6f4a602ab2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:18.887518 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becdbb21-8ab2-4db6-9fba-d6f4a602ab2a None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:18.891108 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce7f91-4085-42e3-abc9-414ea7b014b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:18.891752 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce7f91-4085-42e3-abc9-414ea7b014b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:18.892032 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce7f91-4085-42e3-abc9-414ea7b014b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:18.892303 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce7f91-4085-42e3-abc9-414ea7b014b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:18.894273 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-e9ce7f91-4085-42e3-abc9-414ea7b014b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:18.964169 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce7f91-4085-42e3-abc9-414ea7b014b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:18.965910 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce7f91-4085-42e3-abc9-414ea7b014b8 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:18.979076 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1383/2766] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:18:22.180060 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdc4ce-adbf-49a1-9a69-9cb73cdafa45 service glance] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:22.181710 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-befdc4ce-adbf-49a1-9a69-9cb73cdafa45 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:22.195801 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdc4ce-adbf-49a1-9a69-9cb73cdafa45 service glance] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:22.201089 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1582b-c07b-4969-8d81-e23305eebf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:22.201978 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1582b-c07b-4969-8d81-e23305eebf5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:22.202260 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1582b-c07b-4969-8d81-e23305eebf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:22.202535 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1582b-c07b-4969-8d81-e23305eebf5f admin admin] PATH_INFO: `/v3/users/ff251ac504444235af8055f7a9c8e0a5` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:22.203730 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1582b-c07b-4969-8d81-e23305eebf5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff251ac504444235af8055f7a9c8e0a5)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:22.205680 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1582b-c07b-4969-8d81-e23305eebf5f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:22.252118 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-28a1582b-c07b-4969-8d81-e23305eebf5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff251ac504444235af8055f7a9c8e0a5'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:22.252857 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-28a1582b-c07b-4969-8d81-e23305eebf5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff251ac504444235af8055f7a9c8e0a5'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:22.259619 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-28a1582b-c07b-4969-8d81-e23305eebf5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff251ac504444235af8055f7a9c8e0a5'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:22.260808 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-28a1582b-c07b-4969-8d81-e23305eebf5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff251ac504444235af8055f7a9c8e0a5'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:22.272145 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-28a1582b-c07b-4969-8d81-e23305eebf5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff251ac504444235af8055f7a9c8e0a5'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:22.284720 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1384/2767] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:18:22 2021] DELETE /identity/v3/users/ff251ac504444235af8055f7a9c8e0a5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:22.454361 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce7f91-4085-42e3-abc9-414ea7b014b8 service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:22.466396 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce7f91-4085-42e3-abc9-414ea7b014b8 service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:22.532162 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec76ce-cb86-4237-bf00-4d4743454b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:22.532934 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec76ce-cb86-4237-bf00-4d4743454b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:22.533213 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec76ce-cb86-4237-bf00-4d4743454b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:22.533515 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec76ce-cb86-4237-bf00-4d4743454b22 admin admin] PATH_INFO: `/v3/projects/710c6a0383874f9b946e8376a79787b6` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:22.534708 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec76ce-cb86-4237-bf00-4d4743454b22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=710c6a0383874f9b946e8376a79787b6)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:22.536607 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec76ce-cb86-4237-bf00-4d4743454b22 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:22.585697 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b6ec76ce-cb86-4237-bf00-4d4743454b22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '710c6a0383874f9b946e8376a79787b6', 'request_id': 'req-b6ec76ce-cb86-4237-bf00-4d4743454b22'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:22.594978 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b6ec76ce-cb86-4237-bf00-4d4743454b22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '710c6a0383874f9b946e8376a79787b6', 'request_id': 'req-b6ec76ce-cb86-4237-bf00-4d4743454b22'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:22.600333 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b6ec76ce-cb86-4237-bf00-4d4743454b22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '710c6a0383874f9b946e8376a79787b6', 'request_id': 'req-b6ec76ce-cb86-4237-bf00-4d4743454b22'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:22.612119 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b6ec76ce-cb86-4237-bf00-4d4743454b22 admin admin] The token cache is being invalidate because project 710c6a0383874f9b946e8376a79787b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:18:22.612489 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b6ec76ce-cb86-4237-bf00-4d4743454b22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:22.613131 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b6ec76ce-cb86-4237-bf00-4d4743454b22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:22.614904 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1384/2768] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:18:22 2021] DELETE /identity/v3/projects/710c6a0383874f9b946e8376a79787b6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:22.622336 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bde1b-2185-4352-8684-f05495ebf280 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:22.622701 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bde1b-2185-4352-8684-f05495ebf280 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:22.622977 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bde1b-2185-4352-8684-f05495ebf280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:22.640765 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-0b6bde1b-2185-4352-8684-f05495ebf280 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:22.641994 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-0b6bde1b-2185-4352-8684-f05495ebf280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:22.706871 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1385/2769] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:22.715883 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f067f3f-f77e-4628-9c2b-bc16ec3711fe None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:22.716168 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f067f3f-f77e-4628-9c2b-bc16ec3711fe None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:22.716442 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f067f3f-f77e-4628-9c2b-bc16ec3711fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:22.735308 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-6f067f3f-f77e-4628-9c2b-bc16ec3711fe None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:22.736546 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-6f067f3f-f77e-4628-9c2b-bc16ec3711fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:22.744494 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1385/2770] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:22.748977 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bde1b-2185-4352-8684-f05495ebf280 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:22.758674 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bde1b-2185-4352-8684-f05495ebf280 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:22.764244 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6491b-9167-4a99-a94a-93f3b77d5856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:22.764932 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6491b-9167-4a99-a94a-93f3b77d5856 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:22.765213 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6491b-9167-4a99-a94a-93f3b77d5856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:22.765525 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6491b-9167-4a99-a94a-93f3b77d5856 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:22.766260 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6491b-9167-4a99-a94a-93f3b77d5856 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:18:22.766568 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6491b-9167-4a99-a94a-93f3b77d5856 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:22.768172 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6491b-9167-4a99-a94a-93f3b77d5856 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:22.780250 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1386/2771] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:18:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:18:22.784626 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f067f3f-f77e-4628-9c2b-bc16ec3711fe None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:22.794630 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f067f3f-f77e-4628-9c2b-bc16ec3711fe None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:22.799293 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfdee18-9dbd-436e-b384-0941604f0c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:22.799928 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdee18-9dbd-436e-b384-0941604f0c94 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:22.800207 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdee18-9dbd-436e-b384-0941604f0c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:22.800480 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdee18-9dbd-436e-b384-0941604f0c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:22.801179 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfdee18-9dbd-436e-b384-0941604f0c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:22.803111 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfdee18-9dbd-436e-b384-0941604f0c94 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:22.830666 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1386/2772] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:18:22 2021] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:18:22.834145 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6491b-9167-4a99-a94a-93f3b77d5856 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:22.843978 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6491b-9167-4a99-a94a-93f3b77d5856 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:22.900629 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b0822-a5e2-4dc5-ac06-734f666ec632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:22.901925 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b0822-a5e2-4dc5-ac06-734f666ec632 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:22.902212 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b0822-a5e2-4dc5-ac06-734f666ec632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:22.902490 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b0822-a5e2-4dc5-ac06-734f666ec632 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:22.903201 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b0822-a5e2-4dc5-ac06-734f666ec632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:22.905138 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b0822-a5e2-4dc5-ac06-734f666ec632 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:22.926977 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1387/2773] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:18:22 2021] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:18:22.931690 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfdee18-9dbd-436e-b384-0941604f0c94 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:22.942037 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfdee18-9dbd-436e-b384-0941604f0c94 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:22.946651 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3571fa8-73ef-4105-833e-dc8f6b208beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:22.947301 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3571fa8-73ef-4105-833e-dc8f6b208beb admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:22.947582 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3571fa8-73ef-4105-833e-dc8f6b208beb admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:22.948400 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3571fa8-73ef-4105-833e-dc8f6b208beb admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:22.949135 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3571fa8-73ef-4105-833e-dc8f6b208beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:22.953595 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3571fa8-73ef-4105-833e-dc8f6b208beb admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:22.966928 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1387/2774] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:22 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:18:22.970797 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b0822-a5e2-4dc5-ac06-734f666ec632 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:22.981489 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b0822-a5e2-4dc5-ac06-734f666ec632 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:22.987051 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ae793-7c5a-45d9-800f-d5195e07f25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:22.987720 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ae793-7c5a-45d9-800f-d5195e07f25f admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:22.988151 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ae793-7c5a-45d9-800f-d5195e07f25f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:22.988434 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ae793-7c5a-45d9-800f-d5195e07f25f admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:22.989172 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ae793-7c5a-45d9-800f-d5195e07f25f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:22.990832 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ae793-7c5a-45d9-800f-d5195e07f25f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:23.001181 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1388/2775] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:22 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:18:23.005306 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3571fa8-73ef-4105-833e-dc8f6b208beb admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:23.016064 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3571fa8-73ef-4105-833e-dc8f6b208beb admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:23.020882 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4671b2-1662-40bc-acd0-1467487fb802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:23.022735 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4671b2-1662-40bc-acd0-1467487fb802 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:23.023061 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4671b2-1662-40bc-acd0-1467487fb802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:23.023408 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4671b2-1662-40bc-acd0-1467487fb802 admin admin] PATH_INFO: `/v3/projects/1eb56608b89542a2b5a8373f402f236a/users/e8262d742403486e9da5e3e646a29eb8/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:23.039993 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4671b2-1662-40bc-acd0-1467487fb802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb56608b89542a2b5a8373f402f236a, user_id=e8262d742403486e9da5e3e646a29eb8, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:23.043503 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4671b2-1662-40bc-acd0-1467487fb802 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:23.063663 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1388/2776] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:18:23 2021] PUT /identity/v3/projects/1eb56608b89542a2b5a8373f402f236a/users/e8262d742403486e9da5e3e646a29eb8/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:23.075437 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8a38b-ccc8-452d-9e13-3ffe4e17573e None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:23.075955 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8a38b-ccc8-452d-9e13-3ffe4e17573e None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:23.076427 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8a38b-ccc8-452d-9e13-3ffe4e17573e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:23.105858 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-a7e8a38b-ccc8-452d-9e13-3ffe4e17573e None None] MFA Rules not processed for user `e8262d742403486e9da5e3e646a29eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:23.107345 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-a7e8a38b-ccc8-452d-9e13-3ffe4e17573e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:23.171426 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1389/2777] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:23 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:23.176086 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4671b2-1662-40bc-acd0-1467487fb802 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:23.238508 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4671b2-1662-40bc-acd0-1467487fb802 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:23.243228 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3ec25-1712-4f98-a5af-b6e4dbfe48bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:23.243876 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3ec25-1712-4f98-a5af-b6e4dbfe48bf admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:23.244162 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3ec25-1712-4f98-a5af-b6e4dbfe48bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:23.244443 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3ec25-1712-4f98-a5af-b6e4dbfe48bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:23.245722 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3ec25-1712-4f98-a5af-b6e4dbfe48bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:23.247619 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3ec25-1712-4f98-a5af-b6e4dbfe48bf admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:23.274918 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1389/2778] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:18:23 2021] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:18:23.279064 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8a38b-ccc8-452d-9e13-3ffe4e17573e None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:23.289838 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8a38b-ccc8-452d-9e13-3ffe4e17573e None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:23.351176 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ae32f-d8c4-4986-860b-c73c50ed975b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:23.351860 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ae32f-d8c4-4986-860b-c73c50ed975b admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:23.352146 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ae32f-d8c4-4986-860b-c73c50ed975b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:23.352426 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ae32f-d8c4-4986-860b-c73c50ed975b admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:23.353150 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ae32f-d8c4-4986-860b-c73c50ed975b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:23.355221 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ae32f-d8c4-4986-860b-c73c50ed975b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:23.378692 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1390/2779] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:18:23 2021] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:18:23.379839 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3ec25-1712-4f98-a5af-b6e4dbfe48bf admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:23.390775 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3ec25-1712-4f98-a5af-b6e4dbfe48bf admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:23.395514 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53077646-2f82-44e2-8f46-7c30f8bb46ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:23.396161 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53077646-2f82-44e2-8f46-7c30f8bb46ec admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:23.396444 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53077646-2f82-44e2-8f46-7c30f8bb46ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:23.396725 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53077646-2f82-44e2-8f46-7c30f8bb46ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:23.397705 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53077646-2f82-44e2-8f46-7c30f8bb46ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:23.400565 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53077646-2f82-44e2-8f46-7c30f8bb46ec admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:23.412596 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1390/2780] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:23 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:18:23.416812 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ae32f-d8c4-4986-860b-c73c50ed975b admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:23.426880 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ae32f-d8c4-4986-860b-c73c50ed975b admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:23.431746 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c935d2-503d-495f-bbb8-f4f1002ea71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:23.433114 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c935d2-503d-495f-bbb8-f4f1002ea71f admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:23.433402 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c935d2-503d-495f-bbb8-f4f1002ea71f admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:23.433685 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c935d2-503d-495f-bbb8-f4f1002ea71f admin admin] PATH_INFO: `/v3/projects/7c9dc9c2c1394486974f083dafb6c5e5/users/d694fc990aff4fb08c3f4a2e4d494d7d/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:23.447741 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c935d2-503d-495f-bbb8-f4f1002ea71f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c9dc9c2c1394486974f083dafb6c5e5, user_id=d694fc990aff4fb08c3f4a2e4d494d7d, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:23.450927 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c935d2-503d-495f-bbb8-f4f1002ea71f admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:23.463905 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1391/2781] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:18:23 2021] PUT /identity/v3/projects/7c9dc9c2c1394486974f083dafb6c5e5/users/d694fc990aff4fb08c3f4a2e4d494d7d/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:23.468173 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53077646-2f82-44e2-8f46-7c30f8bb46ec admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:23.479001 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53077646-2f82-44e2-8f46-7c30f8bb46ec admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:23.534208 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61254c30-ef1b-44dd-b182-e0e904e74a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:23.534871 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61254c30-ef1b-44dd-b182-e0e904e74a2c admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:23.535150 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61254c30-ef1b-44dd-b182-e0e904e74a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:23.535420 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61254c30-ef1b-44dd-b182-e0e904e74a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:23.536178 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61254c30-ef1b-44dd-b182-e0e904e74a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:23.537859 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61254c30-ef1b-44dd-b182-e0e904e74a2c admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:23.548532 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1391/2782] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:23 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:18:23.552599 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c935d2-503d-495f-bbb8-f4f1002ea71f admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:23.563174 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c935d2-503d-495f-bbb8-f4f1002ea71f admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:23.567712 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ce523-c699-448b-84a1-8062ab631fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:23.568575 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ce523-c699-448b-84a1-8062ab631fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:23.568854 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ce523-c699-448b-84a1-8062ab631fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:23.569126 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ce523-c699-448b-84a1-8062ab631fcc admin admin] PATH_INFO: `/v3/projects/7c9dc9c2c1394486974f083dafb6c5e5/users/d694fc990aff4fb08c3f4a2e4d494d7d/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:23.571097 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ce523-c699-448b-84a1-8062ab631fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c9dc9c2c1394486974f083dafb6c5e5, user_id=d694fc990aff4fb08c3f4a2e4d494d7d, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:23.574475 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ce523-c699-448b-84a1-8062ab631fcc admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:23.584325 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1392/2783] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:18:23 2021] PUT /identity/v3/projects/7c9dc9c2c1394486974f083dafb6c5e5/users/d694fc990aff4fb08c3f4a2e4d494d7d/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:23.594546 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96864fd-b121-423f-8da6-deb1947efa72 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:23.594847 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96864fd-b121-423f-8da6-deb1947efa72 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:23.595112 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96864fd-b121-423f-8da6-deb1947efa72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:23.621814 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-b96864fd-b121-423f-8da6-deb1947efa72 None None] MFA Rules not processed for user `d694fc990aff4fb08c3f4a2e4d494d7d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:23.622996 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-b96864fd-b121-423f-8da6-deb1947efa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:23.693012 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1392/2784] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:23 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:23.703872 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ce523-c699-448b-84a1-8062ab631fcc admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:23.705801 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-c68ce523-c699-448b-84a1-8062ab631fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:23.761100 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ce523-c699-448b-84a1-8062ab631fcc admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:23.764725 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0adf8-8376-4e9b-9f1b-fa1bfb364b2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:23.765351 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0adf8-8376-4e9b-9f1b-fa1bfb364b2a service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:23.765662 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0adf8-8376-4e9b-9f1b-fa1bfb364b2a service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:23.765935 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0adf8-8376-4e9b-9f1b-fa1bfb364b2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:23.774568 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0adf8-8376-4e9b-9f1b-fa1bfb364b2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:23.776049 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0adf8-8376-4e9b-9f1b-fa1bfb364b2a service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:23.785321 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1393/2785] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:23 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:18:23.848988 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96864fd-b121-423f-8da6-deb1947efa72 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:23.913476 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96864fd-b121-423f-8da6-deb1947efa72 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:23.919035 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2a944-9c00-42be-be40-9bad585aa339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:23.919890 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2a944-9c00-42be-be40-9bad585aa339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:23.920171 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2a944-9c00-42be-be40-9bad585aa339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:23.920447 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2a944-9c00-42be-be40-9bad585aa339 admin admin] PATH_INFO: `/v3/users/e8262d742403486e9da5e3e646a29eb8` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:23.921691 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2a944-9c00-42be-be40-9bad585aa339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8262d742403486e9da5e3e646a29eb8)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:23.923593 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2a944-9c00-42be-be40-9bad585aa339 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:23.969054 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-7bd2a944-9c00-42be-be40-9bad585aa339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8262d742403486e9da5e3e646a29eb8'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:23.969704 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-7bd2a944-9c00-42be-be40-9bad585aa339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8262d742403486e9da5e3e646a29eb8'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:23.970301 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-7bd2a944-9c00-42be-be40-9bad585aa339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8262d742403486e9da5e3e646a29eb8'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:23.982468 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-7bd2a944-9c00-42be-be40-9bad585aa339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8262d742403486e9da5e3e646a29eb8'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:23.989642 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-7bd2a944-9c00-42be-be40-9bad585aa339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8262d742403486e9da5e3e646a29eb8'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:24.002373 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1393/2786] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:18:23 2021] DELETE /identity/v3/users/e8262d742403486e9da5e3e646a29eb8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:24.006875 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885234f-113f-4b1b-a6ac-141925cf72ee None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:24.007164 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885234f-113f-4b1b-a6ac-141925cf72ee None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:24.007459 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885234f-113f-4b1b-a6ac-141925cf72ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:24.025133 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-1885234f-113f-4b1b-a6ac-141925cf72ee None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:24.026373 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-1885234f-113f-4b1b-a6ac-141925cf72ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:24.086490 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1394/2787] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:24.096469 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2a944-9c00-42be-be40-9bad585aa339 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:24.097938 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-7bd2a944-9c00-42be-be40-9bad585aa339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:24.155599 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2a944-9c00-42be-be40-9bad585aa339 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:24.159486 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c9f25-5e7b-4ff8-bcd6-cda2bd7473a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:24.160150 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c9f25-5e7b-4ff8-bcd6-cda2bd7473a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:24.160438 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c9f25-5e7b-4ff8-bcd6-cda2bd7473a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:24.160708 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c9f25-5e7b-4ff8-bcd6-cda2bd7473a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:24.169996 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c9f25-5e7b-4ff8-bcd6-cda2bd7473a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:24.171418 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c9f25-5e7b-4ff8-bcd6-cda2bd7473a7 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:24.180492 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1394/2788] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:18:24.446383 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885234f-113f-4b1b-a6ac-141925cf72ee None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:24.448506 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-1885234f-113f-4b1b-a6ac-141925cf72ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:24.463334 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885234f-113f-4b1b-a6ac-141925cf72ee None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:24.469592 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b05046-ea19-469f-87a2-4c56bcbd0bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:24.470461 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b05046-ea19-469f-87a2-4c56bcbd0bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:24.470740 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b05046-ea19-469f-87a2-4c56bcbd0bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:24.471035 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b05046-ea19-469f-87a2-4c56bcbd0bc8 admin admin] PATH_INFO: `/v3/projects/1eb56608b89542a2b5a8373f402f236a` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:24.472671 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b05046-ea19-469f-87a2-4c56bcbd0bc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb56608b89542a2b5a8373f402f236a)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:24.474815 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b05046-ea19-469f-87a2-4c56bcbd0bc8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:24.520476 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-f4b05046-ea19-469f-87a2-4c56bcbd0bc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb56608b89542a2b5a8373f402f236a', 'request_id': 'req-f4b05046-ea19-469f-87a2-4c56bcbd0bc8'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:24.528515 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-f4b05046-ea19-469f-87a2-4c56bcbd0bc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb56608b89542a2b5a8373f402f236a', 'request_id': 'req-f4b05046-ea19-469f-87a2-4c56bcbd0bc8'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:24.534108 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-f4b05046-ea19-469f-87a2-4c56bcbd0bc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb56608b89542a2b5a8373f402f236a', 'request_id': 'req-f4b05046-ea19-469f-87a2-4c56bcbd0bc8'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:24.545088 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-f4b05046-ea19-469f-87a2-4c56bcbd0bc8 admin admin] The token cache is being invalidate because project 1eb56608b89542a2b5a8373f402f236a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:18:24.545376 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-f4b05046-ea19-469f-87a2-4c56bcbd0bc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:24.546034 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-f4b05046-ea19-469f-87a2-4c56bcbd0bc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:24.547560 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1395/2789] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:18:24 2021] DELETE /identity/v3/projects/1eb56608b89542a2b5a8373f402f236a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:24.551524 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c9f25-5e7b-4ff8-bcd6-cda2bd7473a7 service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:24.561024 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c9f25-5e7b-4ff8-bcd6-cda2bd7473a7 service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:24.618360 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d55fcf-0479-445b-bee9-cc0b9b6fd273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:24.619218 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d55fcf-0479-445b-bee9-cc0b9b6fd273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:24.619526 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d55fcf-0479-445b-bee9-cc0b9b6fd273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:24.619958 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d55fcf-0479-445b-bee9-cc0b9b6fd273 admin admin] PATH_INFO: `/v3/users/d694fc990aff4fb08c3f4a2e4d494d7d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:24.621154 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d55fcf-0479-445b-bee9-cc0b9b6fd273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d694fc990aff4fb08c3f4a2e4d494d7d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:24.623107 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d55fcf-0479-445b-bee9-cc0b9b6fd273 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:24.672273 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-85d55fcf-0479-445b-bee9-cc0b9b6fd273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd694fc990aff4fb08c3f4a2e4d494d7d'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:24.672920 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-85d55fcf-0479-445b-bee9-cc0b9b6fd273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd694fc990aff4fb08c3f4a2e4d494d7d'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:24.673547 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-85d55fcf-0479-445b-bee9-cc0b9b6fd273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd694fc990aff4fb08c3f4a2e4d494d7d'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:24.685453 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-85d55fcf-0479-445b-bee9-cc0b9b6fd273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd694fc990aff4fb08c3f4a2e4d494d7d'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:24.692723 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-85d55fcf-0479-445b-bee9-cc0b9b6fd273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd694fc990aff4fb08c3f4a2e4d494d7d'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:24.705892 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1395/2790] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:18:24 2021] DELETE /identity/v3/users/d694fc990aff4fb08c3f4a2e4d494d7d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:24.971093 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b05046-ea19-469f-87a2-4c56bcbd0bc8 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:24.972576 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-f4b05046-ea19-469f-87a2-4c56bcbd0bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:24.987835 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b05046-ea19-469f-87a2-4c56bcbd0bc8 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:25.047720 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e533a-9ac7-4684-ad79-8af0a0493d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:25.048574 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e533a-9ac7-4684-ad79-8af0a0493d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:25.048856 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e533a-9ac7-4684-ad79-8af0a0493d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:25.049127 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e533a-9ac7-4684-ad79-8af0a0493d62 admin admin] PATH_INFO: `/v3/projects/7c9dc9c2c1394486974f083dafb6c5e5` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:25.050368 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e533a-9ac7-4684-ad79-8af0a0493d62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c9dc9c2c1394486974f083dafb6c5e5)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:25.052300 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e533a-9ac7-4684-ad79-8af0a0493d62 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:25.098147 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-212e533a-9ac7-4684-ad79-8af0a0493d62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c9dc9c2c1394486974f083dafb6c5e5', 'request_id': 'req-212e533a-9ac7-4684-ad79-8af0a0493d62'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:25.108162 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-212e533a-9ac7-4684-ad79-8af0a0493d62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c9dc9c2c1394486974f083dafb6c5e5', 'request_id': 'req-212e533a-9ac7-4684-ad79-8af0a0493d62'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:25.114518 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-212e533a-9ac7-4684-ad79-8af0a0493d62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c9dc9c2c1394486974f083dafb6c5e5', 'request_id': 'req-212e533a-9ac7-4684-ad79-8af0a0493d62'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:25.125508 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-212e533a-9ac7-4684-ad79-8af0a0493d62 admin admin] The token cache is being invalidate because project 7c9dc9c2c1394486974f083dafb6c5e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:18:25.125793 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-212e533a-9ac7-4684-ad79-8af0a0493d62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:25.126432 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-212e533a-9ac7-4684-ad79-8af0a0493d62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:25.127942 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1396/2791] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:18:24 2021] DELETE /identity/v3/projects/7c9dc9c2c1394486974f083dafb6c5e5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:25.133597 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fca003-e496-4469-9586-d91e8fee2a65 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:25.133886 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fca003-e496-4469-9586-d91e8fee2a65 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:25.134159 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fca003-e496-4469-9586-d91e8fee2a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:25.153467 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-d0fca003-e496-4469-9586-d91e8fee2a65 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:25.154655 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-d0fca003-e496-4469-9586-d91e8fee2a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:25.214318 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1396/2792] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:25.223182 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5911f-9523-4bc3-aaba-d50419f9c7d0 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:25.223468 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5911f-9523-4bc3-aaba-d50419f9c7d0 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:25.223742 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5911f-9523-4bc3-aaba-d50419f9c7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:25.242023 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-05d5911f-9523-4bc3-aaba-d50419f9c7d0 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:25.243203 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-05d5911f-9523-4bc3-aaba-d50419f9c7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:25.251587 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1397/2793] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:25.256609 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fca003-e496-4469-9586-d91e8fee2a65 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:25.267523 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fca003-e496-4469-9586-d91e8fee2a65 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:25.272168 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ca26d-85a2-459a-a002-10523f103667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:25.272823 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ca26d-85a2-459a-a002-10523f103667 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:25.273109 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ca26d-85a2-459a-a002-10523f103667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:25.273381 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ca26d-85a2-459a-a002-10523f103667 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:25.274143 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ca26d-85a2-459a-a002-10523f103667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:18:25.274448 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ca26d-85a2-459a-a002-10523f103667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:25.276037 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ca26d-85a2-459a-a002-10523f103667 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:25.287380 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1397/2794] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:18:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 16:18:25.292599 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5911f-9523-4bc3-aaba-d50419f9c7d0 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:25.301692 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5911f-9523-4bc3-aaba-d50419f9c7d0 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:25.306255 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb2012-9c29-40bf-9114-664fd019d84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:25.306886 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb2012-9c29-40bf-9114-664fd019d84c admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:25.307782 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb2012-9c29-40bf-9114-664fd019d84c admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:25.308062 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb2012-9c29-40bf-9114-664fd019d84c admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:25.308751 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb2012-9c29-40bf-9114-664fd019d84c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:25.310669 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb2012-9c29-40bf-9114-664fd019d84c admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:25.334993 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1398/2795] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:18:25 2021] POST /identity/v3/projects => generated 393 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:18:25.339789 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ca26d-85a2-459a-a002-10523f103667 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:25.350545 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ca26d-85a2-459a-a002-10523f103667 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:25.404330 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a0334-8256-4e43-9197-c24d88d9a195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:25.404983 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a0334-8256-4e43-9197-c24d88d9a195 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:25.405264 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a0334-8256-4e43-9197-c24d88d9a195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:25.405565 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a0334-8256-4e43-9197-c24d88d9a195 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:25.406265 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a0334-8256-4e43-9197-c24d88d9a195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:25.408159 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a0334-8256-4e43-9197-c24d88d9a195 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:25.427576 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1398/2796] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:18:25 2021] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:18:25.432003 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb2012-9c29-40bf-9114-664fd019d84c admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:25.444162 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb2012-9c29-40bf-9114-664fd019d84c admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:25.448996 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafd51b-38ab-42c9-8b17-595976e89a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:25.449727 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafd51b-38ab-42c9-8b17-595976e89a02 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:25.450031 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafd51b-38ab-42c9-8b17-595976e89a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:25.450304 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafd51b-38ab-42c9-8b17-595976e89a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:25.451055 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafd51b-38ab-42c9-8b17-595976e89a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:25.452753 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafd51b-38ab-42c9-8b17-595976e89a02 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:25.463818 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1399/2797] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:25 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:18:25.468057 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a0334-8256-4e43-9197-c24d88d9a195 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:25.477906 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a0334-8256-4e43-9197-c24d88d9a195 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:25.483462 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115c49b-5965-4943-b4c2-3e3d3b904963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:25.484108 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115c49b-5965-4943-b4c2-3e3d3b904963 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:25.484392 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115c49b-5965-4943-b4c2-3e3d3b904963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:25.484664 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115c49b-5965-4943-b4c2-3e3d3b904963 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:25.485449 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115c49b-5965-4943-b4c2-3e3d3b904963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:25.487046 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115c49b-5965-4943-b4c2-3e3d3b904963 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:25.496846 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1399/2798] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:25 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:18:25.500906 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafd51b-38ab-42c9-8b17-595976e89a02 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:25.510690 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafd51b-38ab-42c9-8b17-595976e89a02 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:25.516357 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc983d-9839-43ae-bcd7-33eccff25dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:25.517529 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc983d-9839-43ae-bcd7-33eccff25dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:25.517861 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc983d-9839-43ae-bcd7-33eccff25dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:25.518367 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc983d-9839-43ae-bcd7-33eccff25dc0 admin admin] PATH_INFO: `/v3/projects/cc291b3698ab453d8ef49514afeaaecc/users/85a3f157e51441338bff1eac2e5fc708/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:25.533935 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc983d-9839-43ae-bcd7-33eccff25dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc291b3698ab453d8ef49514afeaaecc, user_id=85a3f157e51441338bff1eac2e5fc708, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:25.536584 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc983d-9839-43ae-bcd7-33eccff25dc0 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:25.550121 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1400/2799] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:18:25 2021] PUT /identity/v3/projects/cc291b3698ab453d8ef49514afeaaecc/users/85a3f157e51441338bff1eac2e5fc708/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:25.560448 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c99104-c931-4343-8c5e-cf637c29f29a None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:25.560933 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c99104-c931-4343-8c5e-cf637c29f29a None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:25.561132 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c99104-c931-4343-8c5e-cf637c29f29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:25.588287 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-f4c99104-c931-4343-8c5e-cf637c29f29a None None] MFA Rules not processed for user `85a3f157e51441338bff1eac2e5fc708`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:25.593348 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-f4c99104-c931-4343-8c5e-cf637c29f29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:25.657774 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1400/2800] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:25 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:25.662677 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc983d-9839-43ae-bcd7-33eccff25dc0 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:25.723356 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc983d-9839-43ae-bcd7-33eccff25dc0 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:25.728056 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56a456-4ab4-4377-9d99-4ef751c906e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:25.728712 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56a456-4ab4-4377-9d99-4ef751c906e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:25.729056 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56a456-4ab4-4377-9d99-4ef751c906e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:25.729891 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56a456-4ab4-4377-9d99-4ef751c906e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:25.730586 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56a456-4ab4-4377-9d99-4ef751c906e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:25.732488 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56a456-4ab4-4377-9d99-4ef751c906e0 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:25.759620 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1401/2801] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:18:25 2021] POST /identity/v3/projects => generated 391 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:18:25.760959 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c99104-c931-4343-8c5e-cf637c29f29a None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:25.772157 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c99104-c931-4343-8c5e-cf637c29f29a None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:25.831517 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0423f-2096-48d2-9a4c-20145237f312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:25.832185 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0423f-2096-48d2-9a4c-20145237f312 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:25.832474 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0423f-2096-48d2-9a4c-20145237f312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:25.832752 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0423f-2096-48d2-9a4c-20145237f312 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:25.833506 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0423f-2096-48d2-9a4c-20145237f312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:25.835417 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0423f-2096-48d2-9a4c-20145237f312 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:25.856541 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1401/2802] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:18:25 2021] POST /identity/v3/users => generated 302 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:18:25.860454 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56a456-4ab4-4377-9d99-4ef751c906e0 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:25.870964 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56a456-4ab4-4377-9d99-4ef751c906e0 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:25.875664 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c81b3-a7ab-4b5e-914f-9a5d46dfe1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:25.876316 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c81b3-a7ab-4b5e-914f-9a5d46dfe1ee admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:25.876599 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c81b3-a7ab-4b5e-914f-9a5d46dfe1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:25.876877 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c81b3-a7ab-4b5e-914f-9a5d46dfe1ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:25.877724 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c81b3-a7ab-4b5e-914f-9a5d46dfe1ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:25.879534 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c81b3-a7ab-4b5e-914f-9a5d46dfe1ee admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:25.890587 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1402/2803] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:25 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:18:25.894774 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0423f-2096-48d2-9a4c-20145237f312 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:25.906749 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0423f-2096-48d2-9a4c-20145237f312 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:25.911470 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73006f6d-7b21-4904-b88f-a88ab7a302cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:25.912350 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73006f6d-7b21-4904-b88f-a88ab7a302cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:25.912630 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73006f6d-7b21-4904-b88f-a88ab7a302cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:25.912904 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73006f6d-7b21-4904-b88f-a88ab7a302cc admin admin] PATH_INFO: `/v3/projects/aee9f8ea7ff9475398ae0c237985c635/users/894b7b9000f047c8b0dcfcdd430e9992/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:25.927904 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73006f6d-7b21-4904-b88f-a88ab7a302cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee9f8ea7ff9475398ae0c237985c635, user_id=894b7b9000f047c8b0dcfcdd430e9992, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:25.930577 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73006f6d-7b21-4904-b88f-a88ab7a302cc admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:25.943482 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1402/2804] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:18:25 2021] PUT /identity/v3/projects/aee9f8ea7ff9475398ae0c237985c635/users/894b7b9000f047c8b0dcfcdd430e9992/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:25.947514 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c81b3-a7ab-4b5e-914f-9a5d46dfe1ee admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:25.957889 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c81b3-a7ab-4b5e-914f-9a5d46dfe1ee admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:26.019257 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56154503-198c-4c54-83e6-d77e1ee20bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:26.019842 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56154503-198c-4c54-83e6-d77e1ee20bbf admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:26.020126 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56154503-198c-4c54-83e6-d77e1ee20bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:26.020401 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56154503-198c-4c54-83e6-d77e1ee20bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:26.021141 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56154503-198c-4c54-83e6-d77e1ee20bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:26.022793 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56154503-198c-4c54-83e6-d77e1ee20bbf admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:26.033716 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1403/2805] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:25 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:18:26.038024 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73006f6d-7b21-4904-b88f-a88ab7a302cc admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:26.048609 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73006f6d-7b21-4904-b88f-a88ab7a302cc admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:26.053282 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417c27f-bb8c-4408-9b88-7ebc4a74e88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:26.054191 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417c27f-bb8c-4408-9b88-7ebc4a74e88a admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:26.054470 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417c27f-bb8c-4408-9b88-7ebc4a74e88a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:26.054770 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417c27f-bb8c-4408-9b88-7ebc4a74e88a admin admin] PATH_INFO: `/v3/projects/aee9f8ea7ff9475398ae0c237985c635/users/894b7b9000f047c8b0dcfcdd430e9992/roles/bc362f875c6d4cee83ba65b8d134462d` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:26.056744 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417c27f-bb8c-4408-9b88-7ebc4a74e88a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee9f8ea7ff9475398ae0c237985c635, user_id=894b7b9000f047c8b0dcfcdd430e9992, role_id=bc362f875c6d4cee83ba65b8d134462d)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:26.059545 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417c27f-bb8c-4408-9b88-7ebc4a74e88a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:26.070757 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1403/2806] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:18:26 2021] PUT /identity/v3/projects/aee9f8ea7ff9475398ae0c237985c635/users/894b7b9000f047c8b0dcfcdd430e9992/roles/bc362f875c6d4cee83ba65b8d134462d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:18:26.085304 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da50ae8-bb68-4e99-b8f1-da172d70e7bc None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:26.085621 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da50ae8-bb68-4e99-b8f1-da172d70e7bc None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:26.085907 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da50ae8-bb68-4e99-b8f1-da172d70e7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:26.113011 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-5da50ae8-bb68-4e99-b8f1-da172d70e7bc None None] MFA Rules not processed for user `894b7b9000f047c8b0dcfcdd430e9992`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:26.114260 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-5da50ae8-bb68-4e99-b8f1-da172d70e7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:26.183584 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1404/2807] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:26 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:26.193213 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417c27f-bb8c-4408-9b88-7ebc4a74e88a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:26.194938 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c417c27f-bb8c-4408-9b88-7ebc4a74e88a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:26.252969 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417c27f-bb8c-4408-9b88-7ebc4a74e88a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:26.256633 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fa406-093e-4be2-9f3e-3e019000d591 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:26.257275 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fa406-093e-4be2-9f3e-3e019000d591 service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:26.257598 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fa406-093e-4be2-9f3e-3e019000d591 service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:26.257886 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fa406-093e-4be2-9f3e-3e019000d591 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:26.267341 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512fa406-093e-4be2-9f3e-3e019000d591 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:26.268775 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512fa406-093e-4be2-9f3e-3e019000d591 service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:26.278156 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1404/2808] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:26 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:18:26.321103 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da50ae8-bb68-4e99-b8f1-da172d70e7bc None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:26.322547 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-5da50ae8-bb68-4e99-b8f1-da172d70e7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:26.335094 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da50ae8-bb68-4e99-b8f1-da172d70e7bc None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:26.338916 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff9d66-1c27-4a8f-ba26-60e421e00e16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:26.339542 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff9d66-1c27-4a8f-ba26-60e421e00e16 service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:26.339821 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff9d66-1c27-4a8f-ba26-60e421e00e16 service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:26.340117 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff9d66-1c27-4a8f-ba26-60e421e00e16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:26.400307 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff9d66-1c27-4a8f-ba26-60e421e00e16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:26.402242 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff9d66-1c27-4a8f-ba26-60e421e00e16 service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:26.411979 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1405/2809] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:26 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:18:29.582434 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fa406-093e-4be2-9f3e-3e019000d591 service cinder] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:29.641402 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fa406-093e-4be2-9f3e-3e019000d591 service cinder] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:29.645940 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446b6fe-5400-4852-8857-bb6ba69f9151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:29.646812 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446b6fe-5400-4852-8857-bb6ba69f9151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:29.647095 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446b6fe-5400-4852-8857-bb6ba69f9151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:29.647369 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446b6fe-5400-4852-8857-bb6ba69f9151 admin admin] PATH_INFO: `/v3/users/85a3f157e51441338bff1eac2e5fc708` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:29.648571 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446b6fe-5400-4852-8857-bb6ba69f9151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85a3f157e51441338bff1eac2e5fc708)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:29.650488 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446b6fe-5400-4852-8857-bb6ba69f9151 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:29.694882 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b446b6fe-5400-4852-8857-bb6ba69f9151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85a3f157e51441338bff1eac2e5fc708'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:29.695448 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b446b6fe-5400-4852-8857-bb6ba69f9151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85a3f157e51441338bff1eac2e5fc708'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:29.696048 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b446b6fe-5400-4852-8857-bb6ba69f9151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85a3f157e51441338bff1eac2e5fc708'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:29.707978 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b446b6fe-5400-4852-8857-bb6ba69f9151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85a3f157e51441338bff1eac2e5fc708'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:29.715225 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-b446b6fe-5400-4852-8857-bb6ba69f9151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85a3f157e51441338bff1eac2e5fc708'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:29.726805 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1405/2810] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:18:29 2021] DELETE /identity/v3/users/85a3f157e51441338bff1eac2e5fc708 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:29.731355 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f051e-5d6c-44b0-836f-1c785a6ceec7 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:29.731828 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f051e-5d6c-44b0-836f-1c785a6ceec7 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:29.731977 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f051e-5d6c-44b0-836f-1c785a6ceec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:29.748595 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-884f051e-5d6c-44b0-836f-1c785a6ceec7 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:29.749853 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-884f051e-5d6c-44b0-836f-1c785a6ceec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:29.806332 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1406/2811] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:29.817122 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446b6fe-5400-4852-8857-bb6ba69f9151 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:29.818740 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-b446b6fe-5400-4852-8857-bb6ba69f9151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:29.883580 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446b6fe-5400-4852-8857-bb6ba69f9151 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:29.887365 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a953e-8211-4d2f-9878-90e6bacb7fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:29.888001 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a953e-8211-4d2f-9878-90e6bacb7fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:29.888282 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a953e-8211-4d2f-9878-90e6bacb7fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:29.888555 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a953e-8211-4d2f-9878-90e6bacb7fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:29.897365 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a953e-8211-4d2f-9878-90e6bacb7fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:29.898824 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a953e-8211-4d2f-9878-90e6bacb7fb0 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:29.908202 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1406/2812] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:18:30.169297 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f051e-5d6c-44b0-836f-1c785a6ceec7 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:30.170768 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-884f051e-5d6c-44b0-836f-1c785a6ceec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:30.184089 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f051e-5d6c-44b0-836f-1c785a6ceec7 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:30.189452 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb4ec7-9624-422d-95de-dc8e42b089f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:30.190309 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb4ec7-9624-422d-95de-dc8e42b089f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:30.190612 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb4ec7-9624-422d-95de-dc8e42b089f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:30.190883 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb4ec7-9624-422d-95de-dc8e42b089f8 admin admin] PATH_INFO: `/v3/projects/cc291b3698ab453d8ef49514afeaaecc` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:30.192196 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb4ec7-9624-422d-95de-dc8e42b089f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc291b3698ab453d8ef49514afeaaecc)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:30.194237 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb4ec7-9624-422d-95de-dc8e42b089f8 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:30.240646 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-f3fb4ec7-9624-422d-95de-dc8e42b089f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc291b3698ab453d8ef49514afeaaecc', 'request_id': 'req-f3fb4ec7-9624-422d-95de-dc8e42b089f8'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:30.247845 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-f3fb4ec7-9624-422d-95de-dc8e42b089f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc291b3698ab453d8ef49514afeaaecc', 'request_id': 'req-f3fb4ec7-9624-422d-95de-dc8e42b089f8'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:30.253462 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-f3fb4ec7-9624-422d-95de-dc8e42b089f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc291b3698ab453d8ef49514afeaaecc', 'request_id': 'req-f3fb4ec7-9624-422d-95de-dc8e42b089f8'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:30.264426 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-f3fb4ec7-9624-422d-95de-dc8e42b089f8 admin admin] The token cache is being invalidate because project cc291b3698ab453d8ef49514afeaaecc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:18:30.264708 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-f3fb4ec7-9624-422d-95de-dc8e42b089f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:30.265325 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-f3fb4ec7-9624-422d-95de-dc8e42b089f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:30.266859 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1407/2813] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:18:30 2021] DELETE /identity/v3/projects/cc291b3698ab453d8ef49514afeaaecc => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:30.270811 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a953e-8211-4d2f-9878-90e6bacb7fb0 service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:30.280261 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a953e-8211-4d2f-9878-90e6bacb7fb0 service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:30.334103 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ac08e-4364-4c4e-9f75-0549067e8f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:30.334965 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ac08e-4364-4c4e-9f75-0549067e8f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:30.335245 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ac08e-4364-4c4e-9f75-0549067e8f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:30.335520 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ac08e-4364-4c4e-9f75-0549067e8f9d admin admin] PATH_INFO: `/v3/users/894b7b9000f047c8b0dcfcdd430e9992` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:30.336774 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ac08e-4364-4c4e-9f75-0549067e8f9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=894b7b9000f047c8b0dcfcdd430e9992)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:30.338840 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ac08e-4364-4c4e-9f75-0549067e8f9d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:30.382277 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-1c6ac08e-4364-4c4e-9f75-0549067e8f9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '894b7b9000f047c8b0dcfcdd430e9992'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:30.382971 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-1c6ac08e-4364-4c4e-9f75-0549067e8f9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '894b7b9000f047c8b0dcfcdd430e9992'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:30.383573 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-1c6ac08e-4364-4c4e-9f75-0549067e8f9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '894b7b9000f047c8b0dcfcdd430e9992'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:30.394985 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-1c6ac08e-4364-4c4e-9f75-0549067e8f9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '894b7b9000f047c8b0dcfcdd430e9992'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:30.401816 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-1c6ac08e-4364-4c4e-9f75-0549067e8f9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '894b7b9000f047c8b0dcfcdd430e9992'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:30.413878 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1407/2814] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:18:30 2021] DELETE /identity/v3/users/894b7b9000f047c8b0dcfcdd430e9992 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:30.669508 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb4ec7-9624-422d-95de-dc8e42b089f8 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:30.670946 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-f3fb4ec7-9624-422d-95de-dc8e42b089f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:30.684073 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb4ec7-9624-422d-95de-dc8e42b089f8 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:30.745411 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5753504-9312-430e-a22e-efaa754f562b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:30.746307 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5753504-9312-430e-a22e-efaa754f562b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:30.746599 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5753504-9312-430e-a22e-efaa754f562b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:30.746879 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5753504-9312-430e-a22e-efaa754f562b admin admin] PATH_INFO: `/v3/projects/aee9f8ea7ff9475398ae0c237985c635` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:30.748076 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5753504-9312-430e-a22e-efaa754f562b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aee9f8ea7ff9475398ae0c237985c635)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:30.750043 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5753504-9312-430e-a22e-efaa754f562b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:30.795174 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-a5753504-9312-430e-a22e-efaa754f562b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aee9f8ea7ff9475398ae0c237985c635', 'request_id': 'req-a5753504-9312-430e-a22e-efaa754f562b'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:30.802247 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-a5753504-9312-430e-a22e-efaa754f562b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aee9f8ea7ff9475398ae0c237985c635', 'request_id': 'req-a5753504-9312-430e-a22e-efaa754f562b'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:30.807755 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-a5753504-9312-430e-a22e-efaa754f562b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aee9f8ea7ff9475398ae0c237985c635', 'request_id': 'req-a5753504-9312-430e-a22e-efaa754f562b'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:30.818722 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-a5753504-9312-430e-a22e-efaa754f562b admin admin] The token cache is being invalidate because project aee9f8ea7ff9475398ae0c237985c635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:18:30.818981 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-a5753504-9312-430e-a22e-efaa754f562b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:30.819815 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-a5753504-9312-430e-a22e-efaa754f562b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:30.821702 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1408/2815] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:18:30 2021] DELETE /identity/v3/projects/aee9f8ea7ff9475398ae0c237985c635 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:30.827415 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931d916-b41a-467f-a36b-e2e6dc64e3d4 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:30.827896 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931d916-b41a-467f-a36b-e2e6dc64e3d4 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:30.828083 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931d916-b41a-467f-a36b-e2e6dc64e3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:30.846567 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-3931d916-b41a-467f-a36b-e2e6dc64e3d4 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:30.847776 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-3931d916-b41a-467f-a36b-e2e6dc64e3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:30.921730 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1408/2816] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:30.930674 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9dd734-1d61-4dcd-b990-a760e7be7031 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:30.930957 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9dd734-1d61-4dcd-b990-a760e7be7031 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:30.931232 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9dd734-1d61-4dcd-b990-a760e7be7031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:30.949155 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-ff9dd734-1d61-4dcd-b990-a760e7be7031 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:30.950390 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-ff9dd734-1d61-4dcd-b990-a760e7be7031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:30.958514 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1409/2817] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:30.962533 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931d916-b41a-467f-a36b-e2e6dc64e3d4 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:30.972424 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931d916-b41a-467f-a36b-e2e6dc64e3d4 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:30.977347 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b240b8-ee62-4e4d-83a9-955fac6d7fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:30.977796 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b240b8-ee62-4e4d-83a9-955fac6d7fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:30.978077 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b240b8-ee62-4e4d-83a9-955fac6d7fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:30.978348 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b240b8-ee62-4e4d-83a9-955fac6d7fb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:30.979661 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b240b8-ee62-4e4d-83a9-955fac6d7fb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:18:30.980111 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b240b8-ee62-4e4d-83a9-955fac6d7fb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:30.981762 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b240b8-ee62-4e4d-83a9-955fac6d7fb2 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:30.997132 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1409/2818] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:18:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:18:30.998301 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9dd734-1d61-4dcd-b990-a760e7be7031 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:31.007500 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9dd734-1d61-4dcd-b990-a760e7be7031 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:31.012298 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f72c5c-ec47-4df7-a34d-18fc972244b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:31.012928 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f72c5c-ec47-4df7-a34d-18fc972244b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:31.013208 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f72c5c-ec47-4df7-a34d-18fc972244b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:31.013519 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f72c5c-ec47-4df7-a34d-18fc972244b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:31.014218 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f72c5c-ec47-4df7-a34d-18fc972244b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:31.016109 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f72c5c-ec47-4df7-a34d-18fc972244b7 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:31.044661 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1410/2819] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:18:30 2021] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:18:31.045833 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b240b8-ee62-4e4d-83a9-955fac6d7fb2 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:31.055750 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b240b8-ee62-4e4d-83a9-955fac6d7fb2 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:31.111512 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdad3fe-8067-4f6a-925a-6ed9b667b10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:31.112176 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdad3fe-8067-4f6a-925a-6ed9b667b10a admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:31.112461 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdad3fe-8067-4f6a-925a-6ed9b667b10a admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:31.112738 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdad3fe-8067-4f6a-925a-6ed9b667b10a admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:31.113475 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdad3fe-8067-4f6a-925a-6ed9b667b10a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:31.115391 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdad3fe-8067-4f6a-925a-6ed9b667b10a admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:31.137077 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1410/2820] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:18:31 2021] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:18:31.140259 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f72c5c-ec47-4df7-a34d-18fc972244b7 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:31.150681 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f72c5c-ec47-4df7-a34d-18fc972244b7 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:31.155901 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a7a2a-8d65-4ea1-bc19-1363af265976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:31.156776 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a7a2a-8d65-4ea1-bc19-1363af265976 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:31.157221 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a7a2a-8d65-4ea1-bc19-1363af265976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:31.157635 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a7a2a-8d65-4ea1-bc19-1363af265976 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:31.158509 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a7a2a-8d65-4ea1-bc19-1363af265976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:31.160107 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a7a2a-8d65-4ea1-bc19-1363af265976 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:31.172259 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1411/2821] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:31 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 16:18:31.176345 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdad3fe-8067-4f6a-925a-6ed9b667b10a admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:31.188201 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdad3fe-8067-4f6a-925a-6ed9b667b10a admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:31.193233 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35defe83-c10c-45e9-8011-a24d9221ea87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:31.194092 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35defe83-c10c-45e9-8011-a24d9221ea87 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:31.194380 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35defe83-c10c-45e9-8011-a24d9221ea87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:31.194657 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35defe83-c10c-45e9-8011-a24d9221ea87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:31.195405 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35defe83-c10c-45e9-8011-a24d9221ea87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:31.197047 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35defe83-c10c-45e9-8011-a24d9221ea87 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:31.207384 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1411/2822] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:31 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:18:31.211562 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a7a2a-8d65-4ea1-bc19-1363af265976 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:31.222206 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a7a2a-8d65-4ea1-bc19-1363af265976 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:31.226918 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c965db-3b2c-41ba-810b-b174290a7f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:31.227872 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c965db-3b2c-41ba-810b-b174290a7f2b admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:31.228151 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c965db-3b2c-41ba-810b-b174290a7f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:31.228472 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c965db-3b2c-41ba-810b-b174290a7f2b admin admin] PATH_INFO: `/v3/projects/748cd74e6a3046c2813209b79155e559/users/31ad39ff00364c0bb50af6ca52f3b7f1/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:31.244396 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c965db-3b2c-41ba-810b-b174290a7f2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=748cd74e6a3046c2813209b79155e559, user_id=31ad39ff00364c0bb50af6ca52f3b7f1, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:31.248112 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c965db-3b2c-41ba-810b-b174290a7f2b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:31.262169 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1412/2823] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:18:31 2021] PUT /identity/v3/projects/748cd74e6a3046c2813209b79155e559/users/31ad39ff00364c0bb50af6ca52f3b7f1/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:31.272235 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efffc09-846b-42fb-9e67-83586232731d None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:31.272523 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efffc09-846b-42fb-9e67-83586232731d None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:31.272801 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efffc09-846b-42fb-9e67-83586232731d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:31.299868 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-5efffc09-846b-42fb-9e67-83586232731d None None] MFA Rules not processed for user `31ad39ff00364c0bb50af6ca52f3b7f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:31.300999 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-5efffc09-846b-42fb-9e67-83586232731d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:31.362657 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1412/2824] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:31 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:31.373421 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c965db-3b2c-41ba-810b-b174290a7f2b admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:31.375098 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-a0c965db-3b2c-41ba-810b-b174290a7f2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:31.429332 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c965db-3b2c-41ba-810b-b174290a7f2b admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:31.433851 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4a747-da5b-4122-ab32-484d4c794469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:31.434482 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4a747-da5b-4122-ab32-484d4c794469 service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:31.434763 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4a747-da5b-4122-ab32-484d4c794469 service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:31.435035 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4a747-da5b-4122-ab32-484d4c794469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:31.443206 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4a747-da5b-4122-ab32-484d4c794469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:31.444660 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4a747-da5b-4122-ab32-484d4c794469 service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:31.453407 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1413/2825] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:31 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:18:31.477571 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efffc09-846b-42fb-9e67-83586232731d None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:31.537214 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efffc09-846b-42fb-9e67-83586232731d None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:31.542684 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9e1b5-43f7-4cac-b8aa-f411a452bb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:31.543531 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9e1b5-43f7-4cac-b8aa-f411a452bb43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:31.543808 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9e1b5-43f7-4cac-b8aa-f411a452bb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:31.544075 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9e1b5-43f7-4cac-b8aa-f411a452bb43 admin admin] PATH_INFO: `/v3/users/31ad39ff00364c0bb50af6ca52f3b7f1` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:31.545259 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9e1b5-43f7-4cac-b8aa-f411a452bb43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31ad39ff00364c0bb50af6ca52f3b7f1)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:31.547178 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9e1b5-43f7-4cac-b8aa-f411a452bb43 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:31.590518 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-9de9e1b5-43f7-4cac-b8aa-f411a452bb43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31ad39ff00364c0bb50af6ca52f3b7f1'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:31.591165 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-9de9e1b5-43f7-4cac-b8aa-f411a452bb43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31ad39ff00364c0bb50af6ca52f3b7f1'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:31.591771 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-9de9e1b5-43f7-4cac-b8aa-f411a452bb43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31ad39ff00364c0bb50af6ca52f3b7f1'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:31.603207 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-9de9e1b5-43f7-4cac-b8aa-f411a452bb43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31ad39ff00364c0bb50af6ca52f3b7f1'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:31.611228 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-9de9e1b5-43f7-4cac-b8aa-f411a452bb43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31ad39ff00364c0bb50af6ca52f3b7f1'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:31.623324 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1413/2826] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:18:31 2021] DELETE /identity/v3/users/31ad39ff00364c0bb50af6ca52f3b7f1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:31.627957 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daa451-a208-4b23-af96-e32a9bfb72e3 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:31.628256 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daa451-a208-4b23-af96-e32a9bfb72e3 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:31.628539 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daa451-a208-4b23-af96-e32a9bfb72e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:31.645367 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-83daa451-a208-4b23-af96-e32a9bfb72e3 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:31.646598 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-83daa451-a208-4b23-af96-e32a9bfb72e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:31.705581 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1414/2827] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:31.715923 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9e1b5-43f7-4cac-b8aa-f411a452bb43 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:31.717446 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-9de9e1b5-43f7-4cac-b8aa-f411a452bb43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:31.771785 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9e1b5-43f7-4cac-b8aa-f411a452bb43 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:31.775369 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53294c99-558a-498f-ae12-cd427b66a301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:31.776649 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53294c99-558a-498f-ae12-cd427b66a301 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:31.777218 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53294c99-558a-498f-ae12-cd427b66a301 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:31.777529 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53294c99-558a-498f-ae12-cd427b66a301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:31.786195 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53294c99-558a-498f-ae12-cd427b66a301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:31.787781 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53294c99-558a-498f-ae12-cd427b66a301 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:31.797718 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1414/2828] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:18:32.058697 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83daa451-a208-4b23-af96-e32a9bfb72e3 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:32.060163 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-83daa451-a208-4b23-af96-e32a9bfb72e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:32.075291 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83daa451-a208-4b23-af96-e32a9bfb72e3 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:32.080206 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cfa64-a6c8-4c37-869d-fd5a57107a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:32.081061 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cfa64-a6c8-4c37-869d-fd5a57107a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:32.081338 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cfa64-a6c8-4c37-869d-fd5a57107a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:32.082132 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cfa64-a6c8-4c37-869d-fd5a57107a8d admin admin] PATH_INFO: `/v3/projects/748cd74e6a3046c2813209b79155e559` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:32.083537 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0cfa64-a6c8-4c37-869d-fd5a57107a8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=748cd74e6a3046c2813209b79155e559)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:32.085451 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0cfa64-a6c8-4c37-869d-fd5a57107a8d admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:32.132098 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-cc0cfa64-a6c8-4c37-869d-fd5a57107a8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '748cd74e6a3046c2813209b79155e559', 'request_id': 'req-cc0cfa64-a6c8-4c37-869d-fd5a57107a8d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:32.139658 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-cc0cfa64-a6c8-4c37-869d-fd5a57107a8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '748cd74e6a3046c2813209b79155e559', 'request_id': 'req-cc0cfa64-a6c8-4c37-869d-fd5a57107a8d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:32.146360 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-cc0cfa64-a6c8-4c37-869d-fd5a57107a8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '748cd74e6a3046c2813209b79155e559', 'request_id': 'req-cc0cfa64-a6c8-4c37-869d-fd5a57107a8d'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:32.158128 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-cc0cfa64-a6c8-4c37-869d-fd5a57107a8d admin admin] The token cache is being invalidate because project 748cd74e6a3046c2813209b79155e559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:18:32.158419 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-cc0cfa64-a6c8-4c37-869d-fd5a57107a8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:32.159195 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-cc0cfa64-a6c8-4c37-869d-fd5a57107a8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:32.160784 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1415/2829] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:18:32 2021] DELETE /identity/v3/projects/748cd74e6a3046c2813209b79155e559 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:18:32.167277 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70d943-bc93-416d-9455-6ee0f34f0047 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:32.167906 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70d943-bc93-416d-9455-6ee0f34f0047 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:32.167906 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70d943-bc93-416d-9455-6ee0f34f0047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:32.185599 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-5e70d943-bc93-416d-9455-6ee0f34f0047 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:32.186811 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-5e70d943-bc93-416d-9455-6ee0f34f0047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:32.253287 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1415/2830] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:18:32.262077 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259da325-41a3-4e64-80b3-7c420f7a7482 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:32.262371 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259da325-41a3-4e64-80b3-7c420f7a7482 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:32.262648 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259da325-41a3-4e64-80b3-7c420f7a7482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:32.282596 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-259da325-41a3-4e64-80b3-7c420f7a7482 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:32.283798 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-259da325-41a3-4e64-80b3-7c420f7a7482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:32.300211 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1416/2831] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:32.305224 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70d943-bc93-416d-9455-6ee0f34f0047 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:32.318607 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70d943-bc93-416d-9455-6ee0f34f0047 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:32.325920 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0f5ba-5ca6-4331-b914-cb69aeb1b918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:32.326741 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0f5ba-5ca6-4331-b914-cb69aeb1b918 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:32.327163 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0f5ba-5ca6-4331-b914-cb69aeb1b918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:32.327538 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0f5ba-5ca6-4331-b914-cb69aeb1b918 admin admin] PATH_INFO: `/v3/domains` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:32.328622 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0f5ba-5ca6-4331-b914-cb69aeb1b918 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:18:32.329426 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0f5ba-5ca6-4331-b914-cb69aeb1b918 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:32.331381 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0f5ba-5ca6-4331-b914-cb69aeb1b918 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:32.346508 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1416/2832] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:18:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:18:32.350571 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259da325-41a3-4e64-80b3-7c420f7a7482 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:32.360821 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259da325-41a3-4e64-80b3-7c420f7a7482 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:32.366306 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6294d-0e79-49da-9444-336eebc08960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:32.367026 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6294d-0e79-49da-9444-336eebc08960 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:32.367315 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6294d-0e79-49da-9444-336eebc08960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:32.367588 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6294d-0e79-49da-9444-336eebc08960 admin admin] PATH_INFO: `/v3/projects` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:32.368304 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6294d-0e79-49da-9444-336eebc08960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:32.371467 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6294d-0e79-49da-9444-336eebc08960 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:32.397808 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1417/2833] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:18:32 2021] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:18:32.402840 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0f5ba-5ca6-4331-b914-cb69aeb1b918 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:32.412823 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0f5ba-5ca6-4331-b914-cb69aeb1b918 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:32.467183 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822c42a-2c9d-4152-b16c-a006b8662788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:32.467846 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822c42a-2c9d-4152-b16c-a006b8662788 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:32.468132 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822c42a-2c9d-4152-b16c-a006b8662788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:32.468401 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822c42a-2c9d-4152-b16c-a006b8662788 admin admin] PATH_INFO: `/v3/users` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:32.469098 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822c42a-2c9d-4152-b16c-a006b8662788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:32.471027 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822c42a-2c9d-4152-b16c-a006b8662788 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:32.489697 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1417/2834] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:18:32 2021] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 16:18:32.494085 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6294d-0e79-49da-9444-336eebc08960 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:32.505661 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6294d-0e79-49da-9444-336eebc08960 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:32.510303 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d069c-ab86-405b-a52b-55835894cfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:32.511695 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d069c-ab86-405b-a52b-55835894cfc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:32.511985 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d069c-ab86-405b-a52b-55835894cfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:32.512264 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d069c-ab86-405b-a52b-55835894cfc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:32.512996 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d069c-ab86-405b-a52b-55835894cfc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:32.514664 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d069c-ab86-405b-a52b-55835894cfc5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:32.525458 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1418/2835] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:32 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:18:32.530021 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822c42a-2c9d-4152-b16c-a006b8662788 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:32.539772 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822c42a-2c9d-4152-b16c-a006b8662788 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:32.544591 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742986d2-4637-4035-82f4-f2ee2fd3c3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:32.545233 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742986d2-4637-4035-82f4-f2ee2fd3c3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:32.545553 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742986d2-4637-4035-82f4-f2ee2fd3c3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:32.545829 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742986d2-4637-4035-82f4-f2ee2fd3c3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:32.546551 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742986d2-4637-4035-82f4-f2ee2fd3c3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:32.548156 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742986d2-4637-4035-82f4-f2ee2fd3c3f8 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:32.558275 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1418/2836] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:32 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:18:32.562331 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d069c-ab86-405b-a52b-55835894cfc5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:32.572092 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d069c-ab86-405b-a52b-55835894cfc5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:32.577249 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5fb1b-e214-405c-b6a1-8acfce7f7202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:32.578146 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5fb1b-e214-405c-b6a1-8acfce7f7202 admin admin] REQUEST_METHOD: `PUT` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:32.578431 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5fb1b-e214-405c-b6a1-8acfce7f7202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:32.578703 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5fb1b-e214-405c-b6a1-8acfce7f7202 admin admin] PATH_INFO: `/v3/projects/e15dc48faa0c423e9cfb7e34facc959b/users/dfb43739519b44368e274c788031766b/roles/530f09f883ac47cba230257bcf458141` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:32.593372 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5fb1b-e214-405c-b6a1-8acfce7f7202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15dc48faa0c423e9cfb7e34facc959b, user_id=dfb43739519b44368e274c788031766b, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:32.596081 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5fb1b-e214-405c-b6a1-8acfce7f7202 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:32.609482 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1419/2837] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:18:32 2021] PUT /identity/v3/projects/e15dc48faa0c423e9cfb7e34facc959b/users/dfb43739519b44368e274c788031766b/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:32.614426 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3393a6e-4ff1-4d04-9f48-4de8be5b3245 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:32.614716 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3393a6e-4ff1-4d04-9f48-4de8be5b3245 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:32.614995 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3393a6e-4ff1-4d04-9f48-4de8be5b3245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:32.632458 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-a3393a6e-4ff1-4d04-9f48-4de8be5b3245 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:32.633692 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-a3393a6e-4ff1-4d04-9f48-4de8be5b3245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:32.698901 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1419/2838] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:32.708922 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5fb1b-e214-405c-b6a1-8acfce7f7202 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:32.710615 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-abc5fb1b-e214-405c-b6a1-8acfce7f7202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:32.766401 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5fb1b-e214-405c-b6a1-8acfce7f7202 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:32.770113 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f8d05-2327-4115-8247-a38551a595ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:32.770747 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f8d05-2327-4115-8247-a38551a595ce service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:32.771032 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f8d05-2327-4115-8247-a38551a595ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:32.771310 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f8d05-2327-4115-8247-a38551a595ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:32.780909 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f8d05-2327-4115-8247-a38551a595ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:32.782373 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f8d05-2327-4115-8247-a38551a595ce service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:32.791853 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1420/2839] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:18:33.401266 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cfe30-3207-42c8-9cd8-21be9bca8455 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:33.401836 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cfe30-3207-42c8-9cd8-21be9bca8455 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:33.401836 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cfe30-3207-42c8-9cd8-21be9bca8455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:33.428118 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-185cfe30-3207-42c8-9cd8-21be9bca8455 None None] MFA Rules not processed for user `dfb43739519b44368e274c788031766b`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:33.429335 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-185cfe30-3207-42c8-9cd8-21be9bca8455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:33.493597 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1420/2840] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:33 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:18:33.504219 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f8d05-2327-4115-8247-a38551a595ce service neutron] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:33.505785 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-1e9f8d05-2327-4115-8247-a38551a595ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:33.564770 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f8d05-2327-4115-8247-a38551a595ce service neutron] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:33.568336 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd6daa-8fac-4da0-8f53-e1501df2d025 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:33.568977 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd6daa-8fac-4da0-8f53-e1501df2d025 service cinder] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:33.569262 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd6daa-8fac-4da0-8f53-e1501df2d025 service cinder] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:33.569617 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd6daa-8fac-4da0-8f53-e1501df2d025 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:33.578090 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd6daa-8fac-4da0-8f53-e1501df2d025 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:33.579507 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd6daa-8fac-4da0-8f53-e1501df2d025 service cinder] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:33.588031 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1421/2841] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:33 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:18:37.018316 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f0d8e-1fb6-48cb-864f-4eaa1b4b6d20 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:37.018826 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f0d8e-1fb6-48cb-864f-4eaa1b4b6d20 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:37.018925 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f0d8e-1fb6-48cb-864f-4eaa1b4b6d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:37.036714 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-d13f0d8e-1fb6-48cb-864f-4eaa1b4b6d20 None None] MFA Rules not processed for user `dfb43739519b44368e274c788031766b`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:37.037947 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-d13f0d8e-1fb6-48cb-864f-4eaa1b4b6d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:37.046191 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1421/2842] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:37 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:47.991323 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd6daa-8fac-4da0-8f53-e1501df2d025 service cinder] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:47.992888 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-43dd6daa-8fac-4da0-8f53-e1501df2d025 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:48.017471 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd6daa-8fac-4da0-8f53-e1501df2d025 service cinder] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:48.024413 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c1248-7404-4021-af45-3ed65cba22b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:48.024413 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c1248-7404-4021-af45-3ed65cba22b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:48.024413 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c1248-7404-4021-af45-3ed65cba22b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:48.024735 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c1248-7404-4021-af45-3ed65cba22b3 admin admin] PATH_INFO: `/v3/users/d1726bf8d6204c5cb99d6bf46273a8e9` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:48.026069 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c1248-7404-4021-af45-3ed65cba22b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1726bf8d6204c5cb99d6bf46273a8e9)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:48.028847 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c1248-7404-4021-af45-3ed65cba22b3 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:48.081229 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-ed9c1248-7404-4021-af45-3ed65cba22b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1726bf8d6204c5cb99d6bf46273a8e9'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:48.082024 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-ed9c1248-7404-4021-af45-3ed65cba22b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1726bf8d6204c5cb99d6bf46273a8e9'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:48.089981 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-ed9c1248-7404-4021-af45-3ed65cba22b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1726bf8d6204c5cb99d6bf46273a8e9'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:48.090621 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-ed9c1248-7404-4021-af45-3ed65cba22b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1726bf8d6204c5cb99d6bf46273a8e9'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:48.102225 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-ed9c1248-7404-4021-af45-3ed65cba22b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1726bf8d6204c5cb99d6bf46273a8e9'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:48.115365 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1422/2843] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:18:47 2021] DELETE /identity/v3/users/d1726bf8d6204c5cb99d6bf46273a8e9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:18:48.119897 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf484185-ec0f-480c-b320-995db08706b5 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:48.120904 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf484185-ec0f-480c-b320-995db08706b5 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:48.121133 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf484185-ec0f-480c-b320-995db08706b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:48.139908 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-cf484185-ec0f-480c-b320-995db08706b5 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:48.141130 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-cf484185-ec0f-480c-b320-995db08706b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:48.199263 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1422/2844] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 16:18:48.208623 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c1248-7404-4021-af45-3ed65cba22b3 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:48.210033 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-ed9c1248-7404-4021-af45-3ed65cba22b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:48.266061 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c1248-7404-4021-af45-3ed65cba22b3 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:48.269663 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d7a02-f211-40c6-9695-2408b9687975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:48.270335 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d7a02-f211-40c6-9695-2408b9687975 service neutron] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:48.270622 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d7a02-f211-40c6-9695-2408b9687975 service neutron] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:48.270897 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d7a02-f211-40c6-9695-2408b9687975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:48.280300 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d7a02-f211-40c6-9695-2408b9687975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:48.281786 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d7a02-f211-40c6-9695-2408b9687975 service neutron] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:48.290994 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1423/2845] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:18:48.550814 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf484185-ec0f-480c-b320-995db08706b5 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:48.552265 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-cf484185-ec0f-480c-b320-995db08706b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:48.564647 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf484185-ec0f-480c-b320-995db08706b5 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:48.573422 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400af2de-eb61-43a1-8ac6-6e3918bf9065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:48.573422 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400af2de-eb61-43a1-8ac6-6e3918bf9065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:48.573422 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400af2de-eb61-43a1-8ac6-6e3918bf9065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:48.573422 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400af2de-eb61-43a1-8ac6-6e3918bf9065 admin admin] PATH_INFO: `/v3/projects/1078ad0d7222439dbfda0cfdd5d8624b` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:48.574174 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400af2de-eb61-43a1-8ac6-6e3918bf9065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1078ad0d7222439dbfda0cfdd5d8624b)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:48.574174 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400af2de-eb61-43a1-8ac6-6e3918bf9065 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:48.620963 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-400af2de-eb61-43a1-8ac6-6e3918bf9065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1078ad0d7222439dbfda0cfdd5d8624b', 'request_id': 'req-400af2de-eb61-43a1-8ac6-6e3918bf9065'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:48.628004 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-400af2de-eb61-43a1-8ac6-6e3918bf9065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1078ad0d7222439dbfda0cfdd5d8624b', 'request_id': 'req-400af2de-eb61-43a1-8ac6-6e3918bf9065'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:48.633519 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-400af2de-eb61-43a1-8ac6-6e3918bf9065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1078ad0d7222439dbfda0cfdd5d8624b', 'request_id': 'req-400af2de-eb61-43a1-8ac6-6e3918bf9065'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:48.644250 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-400af2de-eb61-43a1-8ac6-6e3918bf9065 admin admin] The token cache is being invalidate because project 1078ad0d7222439dbfda0cfdd5d8624b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:18:48.644534 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-400af2de-eb61-43a1-8ac6-6e3918bf9065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:48.645261 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-400af2de-eb61-43a1-8ac6-6e3918bf9065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:18:48.647016 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1423/2846] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:18:48 2021] DELETE /identity/v3/projects/1078ad0d7222439dbfda0cfdd5d8624b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:18:48.653208 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3a094-1311-499d-b629-3ccec0346091 None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:48.653526 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3a094-1311-499d-b629-3ccec0346091 None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:48.653801 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3a094-1311-499d-b629-3ccec0346091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:48.672163 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-a1d3a094-1311-499d-b629-3ccec0346091 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:48.673352 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-a1d3a094-1311-499d-b629-3ccec0346091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:48.730869 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1424/2847] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:48.738983 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc56b14-3ec1-41d9-a3fd-2b375819a0a7 None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:48.739274 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc56b14-3ec1-41d9-a3fd-2b375819a0a7 None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:48.739555 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc56b14-3ec1-41d9-a3fd-2b375819a0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:48.757714 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-7bc56b14-3ec1-41d9-a3fd-2b375819a0a7 None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:48.758917 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-7bc56b14-3ec1-41d9-a3fd-2b375819a0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:48.766953 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1424/2848] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:48.771092 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3a094-1311-499d-b629-3ccec0346091 None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:48.780998 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3a094-1311-499d-b629-3ccec0346091 None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:48.785551 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f688e26-25b6-44d8-81bd-9b9af627e538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:48.786187 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f688e26-25b6-44d8-81bd-9b9af627e538 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:48.786465 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f688e26-25b6-44d8-81bd-9b9af627e538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:48.786736 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f688e26-25b6-44d8-81bd-9b9af627e538 admin admin] PATH_INFO: `/v3/domains` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:48.787451 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f688e26-25b6-44d8-81bd-9b9af627e538 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 16:18:48.787751 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f688e26-25b6-44d8-81bd-9b9af627e538 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:48.789343 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f688e26-25b6-44d8-81bd-9b9af627e538 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:48.801123 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1425/2849] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Dec 15 16:18:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 16:18:48.805297 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc56b14-3ec1-41d9-a3fd-2b375819a0a7 None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:48.814372 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc56b14-3ec1-41d9-a3fd-2b375819a0a7 None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:48.819048 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ab5ed-3360-4f01-b709-d03b98e676f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:48.819760 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ab5ed-3360-4f01-b709-d03b98e676f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:48.820011 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ab5ed-3360-4f01-b709-d03b98e676f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:48.820293 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ab5ed-3360-4f01-b709-d03b98e676f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:48.820999 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ab5ed-3360-4f01-b709-d03b98e676f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:48.822925 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ab5ed-3360-4f01-b709-d03b98e676f6 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:48.848280 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1425/2850] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Dec 15 16:18:48 2021] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:18:48.852009 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f688e26-25b6-44d8-81bd-9b9af627e538 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:48.862599 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f688e26-25b6-44d8-81bd-9b9af627e538 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:48.919713 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4c7bd-f16e-4e36-bc38-17b01ccc11b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:48.920446 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4c7bd-f16e-4e36-bc38-17b01ccc11b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:48.920776 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4c7bd-f16e-4e36-bc38-17b01ccc11b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:48.921092 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4c7bd-f16e-4e36-bc38-17b01ccc11b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:48.921879 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4c7bd-f16e-4e36-bc38-17b01ccc11b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:48.923847 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4c7bd-f16e-4e36-bc38-17b01ccc11b2 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:48.945098 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1426/2851] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Dec 15 16:18:48 2021] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 16:18:48.949265 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ab5ed-3360-4f01-b709-d03b98e676f6 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:48.959531 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ab5ed-3360-4f01-b709-d03b98e676f6 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:48.964912 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ca9f3-d29c-42e7-acd9-f23503745542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:48.965600 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ca9f3-d29c-42e7-acd9-f23503745542 admin admin] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:48.965886 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ca9f3-d29c-42e7-acd9-f23503745542 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:48.966163 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ca9f3-d29c-42e7-acd9-f23503745542 admin admin] PATH_INFO: `/v3/roles` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:48.966901 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ca9f3-d29c-42e7-acd9-f23503745542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:48.968503 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ca9f3-d29c-42e7-acd9-f23503745542 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:48.978822 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1426/2852] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:48 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:18:48.983561 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4c7bd-f16e-4e36-bc38-17b01ccc11b2 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:48.993434 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4c7bd-f16e-4e36-bc38-17b01ccc11b2 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:48.998274 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08af63-6778-4f7c-9c60-e08f1884af78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:48.998920 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08af63-6778-4f7c-9c60-e08f1884af78 admin admin] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:48.999201 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08af63-6778-4f7c-9c60-e08f1884af78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:48.999475 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08af63-6778-4f7c-9c60-e08f1884af78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:49.000206 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08af63-6778-4f7c-9c60-e08f1884af78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:49.001838 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08af63-6778-4f7c-9c60-e08f1884af78 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:49.011683 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1427/2853] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Dec 15 16:18:48 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 16:18:49.015488 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ca9f3-d29c-42e7-acd9-f23503745542 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:49.026129 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ca9f3-d29c-42e7-acd9-f23503745542 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:49.031792 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27fc53-3b9e-4d51-af97-6d1b3e80ddf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:49.032672 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27fc53-3b9e-4d51-af97-6d1b3e80ddf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:49.032954 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27fc53-3b9e-4d51-af97-6d1b3e80ddf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:49.033227 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27fc53-3b9e-4d51-af97-6d1b3e80ddf9 admin admin] PATH_INFO: `/v3/projects/6f55c3b20bed46bb92ec2880d43a35eb/users/610c1598c46e47d4adb7235c960cbd49/roles/530f09f883ac47cba230257bcf458141` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:49.049646 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27fc53-3b9e-4d51-af97-6d1b3e80ddf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f55c3b20bed46bb92ec2880d43a35eb, user_id=610c1598c46e47d4adb7235c960cbd49, role_id=530f09f883ac47cba230257bcf458141)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:49.052366 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27fc53-3b9e-4d51-af97-6d1b3e80ddf9 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:49.065875 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1427/2854] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Dec 15 16:18:49 2021] PUT /identity/v3/projects/6f55c3b20bed46bb92ec2880d43a35eb/users/610c1598c46e47d4adb7235c960cbd49/roles/530f09f883ac47cba230257bcf458141 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 16:18:49.077492 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f70292-5780-41ef-a1d8-8b1ca7161bab None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:49.077788 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f70292-5780-41ef-a1d8-8b1ca7161bab None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:49.078064 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f70292-5780-41ef-a1d8-8b1ca7161bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:49.104121 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-86f70292-5780-41ef-a1d8-8b1ca7161bab None None] MFA Rules not processed for user `610c1598c46e47d4adb7235c960cbd49`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:18:49.105879 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-86f70292-5780-41ef-a1d8-8b1ca7161bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:49.143464 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27fc53-3b9e-4d51-af97-6d1b3e80ddf9 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:49.145207 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-3c27fc53-3b9e-4d51-af97-6d1b3e80ddf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:49.172871 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1428/2855] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:18:49 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:18:49.184776 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f70292-5780-41ef-a1d8-8b1ca7161bab None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:18:49.186167 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-86f70292-5780-41ef-a1d8-8b1ca7161bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:49.220471 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27fc53-3b9e-4d51-af97-6d1b3e80ddf9 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:49.227992 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d0b83-da6d-45e4-b6f6-262041ecb266 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e186d6728a2341399252238c559002f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:49.228739 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d0b83-da6d-45e4-b6f6-262041ecb266 service placement] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:49.229029 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d0b83-da6d-45e4-b6f6-262041ecb266 service placement] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:49.229312 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d0b83-da6d-45e4-b6f6-262041ecb266 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:49.234834 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-761d0b83-da6d-45e4-b6f6-262041ecb266 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:18:49.248083 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d0b83-da6d-45e4-b6f6-262041ecb266 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:49.250662 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d0b83-da6d-45e4-b6f6-262041ecb266 service placement] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:49.257348 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f70292-5780-41ef-a1d8-8b1ca7161bab None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:18:49.260466 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1428/2856] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:49 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:18:49.262172 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa7396-c908-4d30-ba02-6a1f7d8fac20 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9072bd35fdf046669c196133f485d334', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:18:49.262863 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa7396-c908-4d30-ba02-6a1f7d8fac20 service glance] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:18:49.263142 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa7396-c908-4d30-ba02-6a1f7d8fac20 service glance] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:18:49.263413 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa7396-c908-4d30-ba02-6a1f7d8fac20 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:18:49.272488 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa7396-c908-4d30-ba02-6a1f7d8fac20 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:18:49.274031 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa7396-c908-4d30-ba02-6a1f7d8fac20 service glance] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:18:49.284446 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1429/2857] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:18:49 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:19:24.104838 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d0b83-da6d-45e4-b6f6-262041ecb266 service placement] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:19:24.163994 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d0b83-da6d-45e4-b6f6-262041ecb266 service placement] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:19:24.168788 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f0c85-fb84-4571-928b-ca49a36cc955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:19:24.169665 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f0c85-fb84-4571-928b-ca49a36cc955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:19:24.169945 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f0c85-fb84-4571-928b-ca49a36cc955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:19:24.170217 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f0c85-fb84-4571-928b-ca49a36cc955 admin admin] PATH_INFO: `/v3/users/610c1598c46e47d4adb7235c960cbd49` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:19:24.171407 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f0c85-fb84-4571-928b-ca49a36cc955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=610c1598c46e47d4adb7235c960cbd49)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:19:24.173327 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f0c85-fb84-4571-928b-ca49a36cc955 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:19:24.218780 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-6d6f0c85-fb84-4571-928b-ca49a36cc955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '610c1598c46e47d4adb7235c960cbd49'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:19:24.219416 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-6d6f0c85-fb84-4571-928b-ca49a36cc955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '610c1598c46e47d4adb7235c960cbd49'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:19:24.220014 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-6d6f0c85-fb84-4571-928b-ca49a36cc955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '610c1598c46e47d4adb7235c960cbd49'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:19:24.232078 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-6d6f0c85-fb84-4571-928b-ca49a36cc955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '610c1598c46e47d4adb7235c960cbd49'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:19:24.238847 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-6d6f0c85-fb84-4571-928b-ca49a36cc955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '610c1598c46e47d4adb7235c960cbd49'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:19:24.251746 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1429/2858] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:19:24 2021] DELETE /identity/v3/users/610c1598c46e47d4adb7235c960cbd49 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:19:24.256344 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b469ba-dc81-4945-8443-31d46872179c None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:19:24.256890 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b469ba-dc81-4945-8443-31d46872179c None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:19:24.256890 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b469ba-dc81-4945-8443-31d46872179c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:19:24.274081 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-96b469ba-dc81-4945-8443-31d46872179c None None] MFA Rules not processed for user `33aa1fa71819442bb0ab5bc31d11564d`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:19:24.275295 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-96b469ba-dc81-4945-8443-31d46872179c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:19:24.332297 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1430/2859] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:19:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:19:24.342164 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f0c85-fb84-4571-928b-ca49a36cc955 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:19:24.343546 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-6d6f0c85-fb84-4571-928b-ca49a36cc955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:19:24.399063 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f0c85-fb84-4571-928b-ca49a36cc955 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:19:24.402738 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068db76-1ff5-40e0-be8a-1cbca7e27804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:19:24.403362 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068db76-1ff5-40e0-be8a-1cbca7e27804 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:19:24.403641 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068db76-1ff5-40e0-be8a-1cbca7e27804 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:19:24.403914 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068db76-1ff5-40e0-be8a-1cbca7e27804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:19:24.412612 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068db76-1ff5-40e0-be8a-1cbca7e27804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:19:24.414059 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068db76-1ff5-40e0-be8a-1cbca7e27804 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:19:24.424031 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1430/2860] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:19:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:19:24.690914 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b469ba-dc81-4945-8443-31d46872179c None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:19:24.692531 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-96b469ba-dc81-4945-8443-31d46872179c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:19:24.704410 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b469ba-dc81-4945-8443-31d46872179c None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:19:24.709050 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c72fb-87ff-465c-96be-85eccb150162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:19:24.710000 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c72fb-87ff-465c-96be-85eccb150162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:19:24.710282 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c72fb-87ff-465c-96be-85eccb150162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:19:24.710553 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c72fb-87ff-465c-96be-85eccb150162 admin admin] PATH_INFO: `/v3/projects/6f55c3b20bed46bb92ec2880d43a35eb` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:19:24.711837 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c72fb-87ff-465c-96be-85eccb150162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f55c3b20bed46bb92ec2880d43a35eb)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:19:24.715312 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c72fb-87ff-465c-96be-85eccb150162 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:19:24.761617 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-455c72fb-87ff-465c-96be-85eccb150162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f55c3b20bed46bb92ec2880d43a35eb', 'request_id': 'req-455c72fb-87ff-465c-96be-85eccb150162'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:19:24.769558 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-455c72fb-87ff-465c-96be-85eccb150162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f55c3b20bed46bb92ec2880d43a35eb', 'request_id': 'req-455c72fb-87ff-465c-96be-85eccb150162'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:19:24.775130 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-455c72fb-87ff-465c-96be-85eccb150162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f55c3b20bed46bb92ec2880d43a35eb', 'request_id': 'req-455c72fb-87ff-465c-96be-85eccb150162'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:19:24.786861 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-455c72fb-87ff-465c-96be-85eccb150162 admin admin] The token cache is being invalidate because project 6f55c3b20bed46bb92ec2880d43a35eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:19:24.787279 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-455c72fb-87ff-465c-96be-85eccb150162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:19:24.787985 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-455c72fb-87ff-465c-96be-85eccb150162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:19:24.789639 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1431/2861] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:19:24 2021] DELETE /identity/v3/projects/6f55c3b20bed46bb92ec2880d43a35eb => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:19:54.414334 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf273bb-3046-48ed-b7b0-e29069259a9e None None] REQUEST_METHOD: `POST` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:19:54.414848 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf273bb-3046-48ed-b7b0-e29069259a9e None None] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:19:54.414956 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf273bb-3046-48ed-b7b0-e29069259a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:19:54.433488 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.auth.core [None req-4cf273bb-3046-48ed-b7b0-e29069259a9e None None] MFA Rules not processed for user `0c89b280c0864631a57aab8564633443`. Rule list: `[]` (Enabled: `True`). {{(pid=79289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:19:54.434768 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-4cf273bb-3046-48ed-b7b0-e29069259a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:19:54.491631 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1431/2862] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:19:54 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:20:06.131703 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59994bae-59b7-455f-8cd1-caa7ef693f5c None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:20:06.132185 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59994bae-59b7-455f-8cd1-caa7ef693f5c None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:20:06.132290 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59994bae-59b7-455f-8cd1-caa7ef693f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:20:06.150474 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-59994bae-59b7-455f-8cd1-caa7ef693f5c None None] MFA Rules not processed for user `dfb43739519b44368e274c788031766b`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:20:06.151669 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-59994bae-59b7-455f-8cd1-caa7ef693f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:20:06.204826 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1432/2863] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:20:06 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:21:02.954653 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf273bb-3046-48ed-b7b0-e29069259a9e None None] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:02.956759 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-4cf273bb-3046-48ed-b7b0-e29069259a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:03.022732 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf273bb-3046-48ed-b7b0-e29069259a9e None None] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:03.027234 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc4eb9-4904-481e-8d68-f4bd5930dfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:03.028096 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc4eb9-4904-481e-8d68-f4bd5930dfac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:03.028379 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc4eb9-4904-481e-8d68-f4bd5930dfac admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:03.028656 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc4eb9-4904-481e-8d68-f4bd5930dfac admin admin] PATH_INFO: `/v3/users/dfb43739519b44368e274c788031766b` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:03.029889 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc4eb9-4904-481e-8d68-f4bd5930dfac admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfb43739519b44368e274c788031766b)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:03.031814 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc4eb9-4904-481e-8d68-f4bd5930dfac admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:03.078724 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-09cc4eb9-4904-481e-8d68-f4bd5930dfac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfb43739519b44368e274c788031766b'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:03.079427 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-09cc4eb9-4904-481e-8d68-f4bd5930dfac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfb43739519b44368e274c788031766b'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:03.080021 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-09cc4eb9-4904-481e-8d68-f4bd5930dfac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfb43739519b44368e274c788031766b'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:03.092042 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-09cc4eb9-4904-481e-8d68-f4bd5930dfac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfb43739519b44368e274c788031766b'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:03.099097 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-09cc4eb9-4904-481e-8d68-f4bd5930dfac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfb43739519b44368e274c788031766b'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:03.110603 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1432/2864] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:21:02 2021] DELETE /identity/v3/users/dfb43739519b44368e274c788031766b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:03.290262 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59994bae-59b7-455f-8cd1-caa7ef693f5c None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:03.304758 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59994bae-59b7-455f-8cd1-caa7ef693f5c None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:03.361187 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3490c-4dc8-41b4-afba-bc9a6c7bd8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:03.362126 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3490c-4dc8-41b4-afba-bc9a6c7bd8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:03.362908 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3490c-4dc8-41b4-afba-bc9a6c7bd8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:03.363203 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3490c-4dc8-41b4-afba-bc9a6c7bd8a2 admin admin] PATH_INFO: `/v3/projects/e15dc48faa0c423e9cfb7e34facc959b` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:03.364428 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3490c-4dc8-41b4-afba-bc9a6c7bd8a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e15dc48faa0c423e9cfb7e34facc959b)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:03.366400 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3490c-4dc8-41b4-afba-bc9a6c7bd8a2 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:03.410436 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-97b3490c-4dc8-41b4-afba-bc9a6c7bd8a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e15dc48faa0c423e9cfb7e34facc959b', 'request_id': 'req-97b3490c-4dc8-41b4-afba-bc9a6c7bd8a2'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:03.417477 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-97b3490c-4dc8-41b4-afba-bc9a6c7bd8a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e15dc48faa0c423e9cfb7e34facc959b', 'request_id': 'req-97b3490c-4dc8-41b4-afba-bc9a6c7bd8a2'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:03.422971 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-97b3490c-4dc8-41b4-afba-bc9a6c7bd8a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e15dc48faa0c423e9cfb7e34facc959b', 'request_id': 'req-97b3490c-4dc8-41b4-afba-bc9a6c7bd8a2'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:03.434404 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-97b3490c-4dc8-41b4-afba-bc9a6c7bd8a2 admin admin] The token cache is being invalidate because project e15dc48faa0c423e9cfb7e34facc959b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:21:03.434688 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-97b3490c-4dc8-41b4-afba-bc9a6c7bd8a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:03.435331 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-97b3490c-4dc8-41b4-afba-bc9a6c7bd8a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:21:03.437099 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1433/2865] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:21:03 2021] DELETE /identity/v3/projects/e15dc48faa0c423e9cfb7e34facc959b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:21:48.893983 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc4eb9-4904-481e-8d68-f4bd5930dfac admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:21:48.895502 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-09cc4eb9-4904-481e-8d68-f4bd5930dfac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:48.951508 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc4eb9-4904-481e-8d68-f4bd5930dfac admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:21:48.997316 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71177db-977f-4124-ab47-af9b933e7534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:21:48.997970 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71177db-977f-4124-ab47-af9b933e7534 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:21:48.998250 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71177db-977f-4124-ab47-af9b933e7534 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:21:48.998522 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71177db-977f-4124-ab47-af9b933e7534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:21:49.000332 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-e71177db-977f-4124-ab47-af9b933e7534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:21:49.010486 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71177db-977f-4124-ab47-af9b933e7534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:21:49.011982 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71177db-977f-4124-ab47-af9b933e7534 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:21:49.020134 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1433/2866] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:21:48 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:07.346439 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6f357-63c7-4fc0-9e2f-f11cd0f3ef8a None None] REQUEST_METHOD: `POST` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:07.347048 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6f357-63c7-4fc0-9e2f-f11cd0f3ef8a None None] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:07.347048 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6f357-63c7-4fc0-9e2f-f11cd0f3ef8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:07.379150 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.auth.core [None req-55b6f357-63c7-4fc0-9e2f-f11cd0f3ef8a None None] MFA Rules not processed for user `0c89b280c0864631a57aab8564633443`. Rule list: `[]` (Enabled: `True`). {{(pid=79290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 16:22:07.380348 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-55b6f357-63c7-4fc0-9e2f-f11cd0f3ef8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:07.432387 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1434/2867] 10.222.0.36 () {58 vars in 957 bytes} [Wed Dec 15 16:22:07 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 16:22:07.468697 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71177db-977f-4124-ab47-af9b933e7534 service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:07.470128 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-e71177db-977f-4124-ab47-af9b933e7534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:07.524506 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71177db-977f-4124-ab47-af9b933e7534 service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:07.527989 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b059703-1980-4b6b-be7e-cec9d78bcd69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18ec9bcc0e481aa000833ec1c0988d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:07.528632 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b059703-1980-4b6b-be7e-cec9d78bcd69 service cinder] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:07.528916 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b059703-1980-4b6b-be7e-cec9d78bcd69 service cinder] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:07.529193 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b059703-1980-4b6b-be7e-cec9d78bcd69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:07.530971 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-1b059703-1980-4b6b-be7e-cec9d78bcd69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:07.599986 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b059703-1980-4b6b-be7e-cec9d78bcd69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:07.601466 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b059703-1980-4b6b-be7e-cec9d78bcd69 service cinder] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:07.612284 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1434/2868] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:07 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:08.328204 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6f357-63c7-4fc0-9e2f-f11cd0f3ef8a None None] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:08.329596 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-55b6f357-63c7-4fc0-9e2f-f11cd0f3ef8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:08.336718 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b059703-1980-4b6b-be7e-cec9d78bcd69 service cinder] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:08.338725 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-1b059703-1980-4b6b-be7e-cec9d78bcd69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:08.351225 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b059703-1980-4b6b-be7e-cec9d78bcd69 service cinder] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:08.355562 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0f353-2425-449c-909b-8228a7f94912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:08.356225 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0f353-2425-449c-909b-8228a7f94912 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:08.356787 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0f353-2425-449c-909b-8228a7f94912 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:08.356787 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0f353-2425-449c-909b-8228a7f94912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:08.358659 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c9e0f353-2425-449c-909b-8228a7f94912 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:08.374350 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0f353-2425-449c-909b-8228a7f94912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:08.376477 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0f353-2425-449c-909b-8228a7f94912 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:08.389192 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1435/2869] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:08 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 16:22:08.413022 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6f357-63c7-4fc0-9e2f-f11cd0f3ef8a None None] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:08.418073 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febfec9-f4c3-4075-b1ec-5ff14fccb0b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e186d6728a2341399252238c559002f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:08.418716 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febfec9-f4c3-4075-b1ec-5ff14fccb0b3 service placement] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:08.419004 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febfec9-f4c3-4075-b1ec-5ff14fccb0b3 service placement] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:08.419279 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febfec9-f4c3-4075-b1ec-5ff14fccb0b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:08.421051 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-5febfec9-f4c3-4075-b1ec-5ff14fccb0b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:08.433620 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febfec9-f4c3-4075-b1ec-5ff14fccb0b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:08.435226 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febfec9-f4c3-4075-b1ec-5ff14fccb0b3 service placement] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:08.446032 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1435/2870] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:08 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:10.822554 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0f353-2425-449c-909b-8228a7f94912 service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:10.824326 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-c9e0f353-2425-449c-909b-8228a7f94912 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:10.845134 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0f353-2425-449c-909b-8228a7f94912 service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:10.858013 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f28ba-6872-4a45-8924-cf57cbcf0179 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:10.858981 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f28ba-6872-4a45-8924-cf57cbcf0179 service nova] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:10.859611 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f28ba-6872-4a45-8924-cf57cbcf0179 service nova] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:10.860180 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f28ba-6872-4a45-8924-cf57cbcf0179 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:10.862858 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-311f28ba-6872-4a45-8924-cf57cbcf0179 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:10.878931 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f28ba-6872-4a45-8924-cf57cbcf0179 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:10.881414 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f28ba-6872-4a45-8924-cf57cbcf0179 service nova] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:10.903520 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1436/2871] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:10 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:12.998233 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febfec9-f4c3-4075-b1ec-5ff14fccb0b3 service placement] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:13.010452 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febfec9-f4c3-4075-b1ec-5ff14fccb0b3 service placement] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:13.015873 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9b107-b52b-4924-b4c5-5a2ebc78a38b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:13.016665 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9b107-b52b-4924-b4c5-5a2ebc78a38b service nova] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:13.016784 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9b107-b52b-4924-b4c5-5a2ebc78a38b service nova] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:13.017046 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9b107-b52b-4924-b4c5-5a2ebc78a38b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:13.018866 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-7aa9b107-b52b-4924-b4c5-5a2ebc78a38b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:13.030359 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9b107-b52b-4924-b4c5-5a2ebc78a38b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:13.031963 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9b107-b52b-4924-b4c5-5a2ebc78a38b service nova] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:13.041773 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1436/2872] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:12 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:22:21.057496 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f28ba-6872-4a45-8924-cf57cbcf0179 service nova] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:22:21.059102 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-311f28ba-6872-4a45-8924-cf57cbcf0179 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:21.074500 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f28ba-6872-4a45-8924-cf57cbcf0179 service nova] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:22:21.080050 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a131f5a-8a5f-483d-9df8-0d2676b09cdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc13934328e742f9a1a85d1c84ab83dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:22:21.080680 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a131f5a-8a5f-483d-9df8-0d2676b09cdc service nova] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:22:21.080960 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a131f5a-8a5f-483d-9df8-0d2676b09cdc service nova] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:22:21.081229 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a131f5a-8a5f-483d-9df8-0d2676b09cdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:22:21.082993 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-3a131f5a-8a5f-483d-9df8-0d2676b09cdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:22:21.096317 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a131f5a-8a5f-483d-9df8-0d2676b09cdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:22:21.097936 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a131f5a-8a5f-483d-9df8-0d2676b09cdc service nova] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:22:21.108889 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1437/2873] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:22:21 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:23:54.413141 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9b107-b52b-4924-b4c5-5a2ebc78a38b service nova] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:23:54.415508 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-7aa9b107-b52b-4924-b4c5-5a2ebc78a38b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:54.505455 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9b107-b52b-4924-b4c5-5a2ebc78a38b service nova] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:23:54.511100 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc34a5d-2f72-492a-b79a-b8128ebab936 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e186d6728a2341399252238c559002f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:23:54.511743 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc34a5d-2f72-492a-b79a-b8128ebab936 service placement] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:23:54.512055 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc34a5d-2f72-492a-b79a-b8128ebab936 service placement] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:23:54.512368 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc34a5d-2f72-492a-b79a-b8128ebab936 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:23:54.514243 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-5cc34a5d-2f72-492a-b79a-b8128ebab936 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:23:54.533876 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc34a5d-2f72-492a-b79a-b8128ebab936 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:23:54.535492 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc34a5d-2f72-492a-b79a-b8128ebab936 service placement] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:23:54.546048 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1437/2874] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:23:54 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:24:18.124984 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a131f5a-8a5f-483d-9df8-0d2676b09cdc service nova] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:24:18.161714 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a131f5a-8a5f-483d-9df8-0d2676b09cdc service nova] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:24:18.165294 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53080d10-30ad-4135-bf59-22fbb7ed3d70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2f08f47d4e6442a92901fb7d8bed0bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:24:18.165956 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53080d10-30ad-4135-bf59-22fbb7ed3d70 service neutron] REQUEST_METHOD: `GET` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:24:18.166242 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53080d10-30ad-4135-bf59-22fbb7ed3d70 service neutron] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:24:18.166520 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53080d10-30ad-4135-bf59-22fbb7ed3d70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:24:18.168304 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-53080d10-30ad-4135-bf59-22fbb7ed3d70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:24:18.248628 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53080d10-30ad-4135-bf59-22fbb7ed3d70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:24:18.250128 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53080d10-30ad-4135-bf59-22fbb7ed3d70 service neutron] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:24:18.268504 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1438/2875] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:24:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 16:24:24.368019 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc34a5d-2f72-492a-b79a-b8128ebab936 service placement] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:24:24.369601 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-5cc34a5d-2f72-492a-b79a-b8128ebab936 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:24:24.384109 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc34a5d-2f72-492a-b79a-b8128ebab936 service placement] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:24:24.388641 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760b786-63d8-42d1-9f27-453c250ec25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:24:24.389557 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760b786-63d8-42d1-9f27-453c250ec25b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:24:24.389846 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760b786-63d8-42d1-9f27-453c250ec25b admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:24:24.390123 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760b786-63d8-42d1-9f27-453c250ec25b admin admin] PATH_INFO: `/v3/users/0c89b280c0864631a57aab8564633443` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:24:24.391319 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760b786-63d8-42d1-9f27-453c250ec25b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c89b280c0864631a57aab8564633443)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:24:24.394022 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760b786-63d8-42d1-9f27-453c250ec25b admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:24:24.444330 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5760b786-63d8-42d1-9f27-453c250ec25b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c89b280c0864631a57aab8564633443'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:24:24.444971 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5760b786-63d8-42d1-9f27-453c250ec25b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c89b280c0864631a57aab8564633443'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:24:24.451548 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5760b786-63d8-42d1-9f27-453c250ec25b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c89b280c0864631a57aab8564633443'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:24:24.452157 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5760b786-63d8-42d1-9f27-453c250ec25b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c89b280c0864631a57aab8564633443'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:24:24.463759 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-5760b786-63d8-42d1-9f27-453c250ec25b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c89b280c0864631a57aab8564633443'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:24:24.476435 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1438/2876] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:24:24 2021] DELETE /identity/v3/users/0c89b280c0864631a57aab8564633443 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:24:24.649639 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53080d10-30ad-4135-bf59-22fbb7ed3d70 service neutron] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:24:24.661478 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53080d10-30ad-4135-bf59-22fbb7ed3d70 service neutron] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:24:24.718480 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9f6f5-e036-471a-911e-a3e02f1661c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:24:24.719324 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9f6f5-e036-471a-911e-a3e02f1661c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:24:24.719603 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9f6f5-e036-471a-911e-a3e02f1661c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:24:24.719875 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9f6f5-e036-471a-911e-a3e02f1661c1 admin admin] PATH_INFO: `/v3/projects/d37336bbfbab45f79ed53d56efe617c4` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:24:24.721128 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9f6f5-e036-471a-911e-a3e02f1661c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d37336bbfbab45f79ed53d56efe617c4)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:24:24.723705 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9f6f5-e036-471a-911e-a3e02f1661c1 admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:24:24.775129 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-22a9f6f5-e036-471a-911e-a3e02f1661c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd37336bbfbab45f79ed53d56efe617c4', 'request_id': 'req-22a9f6f5-e036-471a-911e-a3e02f1661c1'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:24:24.782363 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-22a9f6f5-e036-471a-911e-a3e02f1661c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd37336bbfbab45f79ed53d56efe617c4', 'request_id': 'req-22a9f6f5-e036-471a-911e-a3e02f1661c1'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:24:24.788428 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-22a9f6f5-e036-471a-911e-a3e02f1661c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd37336bbfbab45f79ed53d56efe617c4', 'request_id': 'req-22a9f6f5-e036-471a-911e-a3e02f1661c1'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:24:24.799426 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-22a9f6f5-e036-471a-911e-a3e02f1661c1 admin admin] The token cache is being invalidate because project d37336bbfbab45f79ed53d56efe617c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:24:24.799717 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-22a9f6f5-e036-471a-911e-a3e02f1661c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:24:24.800353 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-22a9f6f5-e036-471a-911e-a3e02f1661c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:24:24.801918 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1439/2877] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:24:24 2021] DELETE /identity/v3/projects/d37336bbfbab45f79ed53d56efe617c4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:24:24.805898 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760b786-63d8-42d1-9f27-453c250ec25b admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:24:24.807302 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-5760b786-63d8-42d1-9f27-453c250ec25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:24:24.820638 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760b786-63d8-42d1-9f27-453c250ec25b admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:24:24.876094 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923b658-2d34-49fc-9c56-f41a3152bcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:24:24.877206 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923b658-2d34-49fc-9c56-f41a3152bcc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:24:24.877712 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923b658-2d34-49fc-9c56-f41a3152bcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:24:24.878066 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923b658-2d34-49fc-9c56-f41a3152bcc5 admin admin] PATH_INFO: `/v3/users/c5eb100430ad40f1a1f5beb6df6184d3` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:24:24.879297 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923b658-2d34-49fc-9c56-f41a3152bcc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5eb100430ad40f1a1f5beb6df6184d3)` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:24:24.881222 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923b658-2d34-49fc-9c56-f41a3152bcc5 admin admin] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:24:24.926787 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-b923b658-2d34-49fc-9c56-f41a3152bcc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5eb100430ad40f1a1f5beb6df6184d3'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:24:24.927439 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-b923b658-2d34-49fc-9c56-f41a3152bcc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5eb100430ad40f1a1f5beb6df6184d3'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:24:24.933998 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-b923b658-2d34-49fc-9c56-f41a3152bcc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5eb100430ad40f1a1f5beb6df6184d3'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:24:24.934619 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-b923b658-2d34-49fc-9c56-f41a3152bcc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5eb100430ad40f1a1f5beb6df6184d3'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:24:24.946190 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.notifications [None req-b923b658-2d34-49fc-9c56-f41a3152bcc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5eb100430ad40f1a1f5beb6df6184d3'} {{(pid=79290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:24:24.958819 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1439/2878] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Dec 15 16:24:24 2021] DELETE /identity/v3/users/c5eb100430ad40f1a1f5beb6df6184d3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:24:25.141775 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9f6f5-e036-471a-911e-a3e02f1661c1 admin admin] Authenticating user token {{(pid=79289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:24:25.144209 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.fernet_utils [None req-22a9f6f5-e036-471a-911e-a3e02f1661c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:24:25.159827 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9f6f5-e036-471a-911e-a3e02f1661c1 admin admin] Validating token access rules against request {{(pid=79289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:24:25.217833 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b27331-7a36-4dfc-a761-fa2deb943b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33aa1fa71819442bb0ab5bc31d11564d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7bb9a879a6841dda52e30764e5ba9c7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:24:25.218691 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b27331-7a36-4dfc-a761-fa2deb943b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:24:25.218973 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b27331-7a36-4dfc-a761-fa2deb943b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:24:25.219258 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b27331-7a36-4dfc-a761-fa2deb943b1d admin admin] PATH_INFO: `/v3/projects/edfbca64f58045d185b9667be12525c4` {{(pid=79289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:24:25.220467 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b27331-7a36-4dfc-a761-fa2deb943b1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=edfbca64f58045d185b9667be12525c4)` {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:24:25.223133 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b27331-7a36-4dfc-a761-fa2deb943b1d admin admin] RBAC: Authorization granted {{(pid=79289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:24:25.270098 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-83b27331-7a36-4dfc-a761-fa2deb943b1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edfbca64f58045d185b9667be12525c4', 'request_id': 'req-83b27331-7a36-4dfc-a761-fa2deb943b1d'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:24:25.277242 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-83b27331-7a36-4dfc-a761-fa2deb943b1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edfbca64f58045d185b9667be12525c4', 'request_id': 'req-83b27331-7a36-4dfc-a761-fa2deb943b1d'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:24:25.282530 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-83b27331-7a36-4dfc-a761-fa2deb943b1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edfbca64f58045d185b9667be12525c4', 'request_id': 'req-83b27331-7a36-4dfc-a761-fa2deb943b1d'} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:24:25.293051 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-83b27331-7a36-4dfc-a761-fa2deb943b1d admin admin] The token cache is being invalidate because project edfbca64f58045d185b9667be12525c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 16:24:25.293337 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-83b27331-7a36-4dfc-a761-fa2deb943b1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:24:25.293981 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: DEBUG keystone.notifications [None req-83b27331-7a36-4dfc-a761-fa2deb943b1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 16:24:25.295525 dv-cinder-800704-2-iscsi devstack@keystone.service[79289]: [pid: 79289|app: 0|req: 1440/2879] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Dec 15 16:24:25 2021] DELETE /identity/v3/projects/edfbca64f58045d185b9667be12525c4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 16:28:57.139939 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923b658-2d34-49fc-9c56-f41a3152bcc5 admin admin] Authenticating user token {{(pid=79290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 16:28:57.141309 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-b923b658-2d34-49fc-9c56-f41a3152bcc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:28:57.209847 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923b658-2d34-49fc-9c56-f41a3152bcc5 admin admin] Validating token access rules against request {{(pid=79290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 16:28:57.270268 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa87d44-f6d5-49f4-ab8f-ea92f6aa15a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e186d6728a2341399252238c559002f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc314fbc91c54810b27f9fcad7129c64', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 16:28:57.270921 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa87d44-f6d5-49f4-ab8f-ea92f6aa15a2 service placement] REQUEST_METHOD: `GET` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 16:28:57.271204 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa87d44-f6d5-49f4-ab8f-ea92f6aa15a2 service placement] SCRIPT_NAME: `/identity` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 16:28:57.271481 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa87d44-f6d5-49f4-ab8f-ea92f6aa15a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 16:28:57.273266 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.fernet_utils [None req-9aa87d44-f6d5-49f4-ab8f-ea92f6aa15a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 16:28:57.284990 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa87d44-f6d5-49f4-ab8f-ea92f6aa15a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 16:28:57.286628 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa87d44-f6d5-49f4-ab8f-ea92f6aa15a2 service placement] RBAC: Authorization granted {{(pid=79290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 16:28:57.296461 dv-cinder-800704-2-iscsi devstack@keystone.service[79290]: [pid: 79290|app: 0|req: 1440/2880] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Dec 15 16:28:57 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)